murgen
September 22, 2022, 8:15pm
1
I'm mounting a s3 compatible bucket (iDrive e2) with rclone. Some folders are missing in the mount, even if I can see them when I run rclone lsd.
rclone v1.59.2
- os/version: ubuntu 20.04 (64 bit)
- os/kernel: 5.13.0-1027-oracle (aarch64)
- os/type: linux
- os/arch: arm64
- go/version: go1.18.6
- go/linking: static
- go/tags: none
iDrive e2 (s3 compatible)
rclone copy /tmp remote:tmp)
rclone mount idrive-e2-navidrome:navidrome-music /home/ubuntu/docker/navidrome/data/music \
--log-level INFO \
--rc \
--rc-no-auth \
--allow-other \
--buffer-size 3G \
--dir-cache-time 29h \
--read-only \
--vfs-cache-mode full \
--vfs-fast-fingerprint \
--vfs-cache-poll-interval 29h\
--vfs-cache-max-size 170G \
--vfs-cache-max-age 9999h \
--vfs-read-ahead 128M \
--vfs-read-chunk-size 16M \
--vfs-read-chunk-size-limit 128M \
--exclude="Kara/**" \
--exclude="Music/Divers/**" \
--exclude="*.mpc" \
--exclude="*.mpg" \
--exclude="*.avi" \
--exclude="*.mpeg" \
--exclude="*.zip" \
--exclude="*.rar" \
--exclude="*.mkv"
[idrive-e2-navidrome]
type = s3
provider = Other
access_key_id = REDACTED
secret_access_key = REDACTED
endpoint = o0v1.fra.idrivee2-20.com
acl = private
-vv flag
Can you share an example of said file that's missing?
murgen
September 22, 2022, 8:36pm
3
Sure. So far I've identified these ones, but I'm sure there are others since the total folder count seems off (something about 100+ folders missing on a total of ~3800)
(these folders are not empty)
murgen
September 22, 2022, 8:52pm
4
If that can help: I've already tried rclone rc vfs/forget and even removed manually all rclone vfs and vfsMeta cache folders, and restarted rclone.
ncw
September 22, 2022, 9:07pm
5
If you could list that directory "Deftones" and post the debug log from the mount you get from the listing.
I don't need the whole log, just what you get when you list that directory for the first time after starting the mount.
That should give a clue hopefully.
murgen
September 22, 2022, 9:18pm
6
I'm not sure if I understand correctly what you're asking. Isn't my screenshot above enough ?
edit: you mean like this ?
ubuntu@navidrome:~$ rclone lsf -R --max-depth 5 idrive-e2-navidrome:navidrome-music | grep "Deftones"
Music/Musique generale/Deftones/
Music/Musique generale/Deftones/1993 - (Like) Linus/
Music/Musique generale/Deftones/1995 - Adrenaline/
Music/Musique generale/Deftones/1997 - Around the Fur/
Music/Musique generale/Deftones/2000 - Back To School (Mini Maggit)/
Music/Musique generale/Deftones/2000 - White Pony/
Music/Musique generale/Deftones/2003 - Deftones/
Music/Musique generale/Deftones/2005 - B-Sides & Rarities/
Music/Musique generale/Deftones/2006 - Saturday Night Wrist/
Music/Musique generale/Deftones/2010 - Diamond Eyes/
Music/Musique generale/Deftones/2012 - Koi no Yokan/
Music/Musique generale/Deftones/2016 - Gore/
Music/Musique generale/Deftones/2020 - Ohms/
Music/Musique generale/Deftones/1993 - (Like) Linus/01 - Like Linus (a).m4a
Music/Musique generale/Deftones/1993 - (Like) Linus/02 - Some People.m4a
Music/Musique generale/Deftones/1993 - (Like) Linus/03 - Answers.m4a
Music/Musique generale/Deftones/1993 - (Like) Linus/04 - Hump.m4a
Music/Musique generale/Deftones/1993 - (Like) Linus/05 - Christmas.m4a
Music/Musique generale/Deftones/1993 - (Like) Linus/06 - Plastic.m4a
Music/Musique generale/Deftones/1993 - (Like) Linus/07 - Venison.m4a
Music/Musique generale/Deftones/1993 - (Like) Linus/08 - Gift.m4a
Music/Musique generale/Deftones/1993 - (Like) Linus/09 - Like Linus (b).m4a
Music/Musique generale/Deftones/1993 - (Like) Linus/10 - Freaks.m4a
Music/Musique generale/Deftones/1993 - (Like) Linus/11 - Engine No. 9 (a).m4a
Music/Musique generale/Deftones/1993 - (Like) Linus/12 - Root.m4a
Music/Musique generale/Deftones/1993 - (Like) Linus/13 - 7 Words.m4a
Music/Musique generale/Deftones/1993 - (Like) Linus/14 - Engine No. 9 (b).m4a
Music/Musique generale/Deftones/1993 - (Like) Linus/15 - Teething.m4a
Music/Musique generale/Deftones/1993 - (Like) Linus/cover.jpg
Music/Musique generale/Deftones/1995 - Adrenaline/01 - Bored.m4a
Music/Musique generale/Deftones/1995 - Adrenaline/02 - Minus Blindfold.m4a
Music/Musique generale/Deftones/1995 - Adrenaline/03 - One Weak.m4a
Music/Musique generale/Deftones/1995 - Adrenaline/04 - Nosebleed.m4a
Music/Musique generale/Deftones/1995 - Adrenaline/05 - Lifter.m4a
Music/Musique generale/Deftones/1995 - Adrenaline/06 - Root.m4a
Music/Musique generale/Deftones/1995 - Adrenaline/07 - 7 Words.m4a
Music/Musique generale/Deftones/1995 - Adrenaline/08 - Birthmark.m4a
Music/Musique generale/Deftones/1995 - Adrenaline/09 - Engine No. 9.m4a
Music/Musique generale/Deftones/1995 - Adrenaline/10 - Fireal.m4a
Music/Musique generale/Deftones/1995 - Adrenaline/11 - Fist.m4a
Music/Musique generale/Deftones/1995 - Adrenaline/folder.jpg
Music/Musique generale/Deftones/1997 - Around the Fur/01 - My Own Summer (Shove It).m4a
Music/Musique generale/Deftones/1997 - Around the Fur/02 - Lhabia.m4a
Music/Musique generale/Deftones/1997 - Around the Fur/03 - Mascara.m4a
Music/Musique generale/Deftones/1997 - Around the Fur/04 - Around the Fur.m4a
Music/Musique generale/Deftones/1997 - Around the Fur/05 - Rickets.m4a
Music/Musique generale/Deftones/1997 - Around the Fur/06 - Be Quiet and Drive (Far Away).m4a
Music/Musique generale/Deftones/1997 - Around the Fur/07 - Lotion.m4a
Music/Musique generale/Deftones/1997 - Around the Fur/08 - Dai the Flu.m4a
Music/Musique generale/Deftones/1997 - Around the Fur/09 - Headup.m4a
Music/Musique generale/Deftones/1997 - Around the Fur/10 - MX.m4a
Music/Musique generale/Deftones/1997 - Around the Fur/11 - Bong Hit.m4a
Music/Musique generale/Deftones/1997 - Around the Fur/12 - Damone.m4a
Music/Musique generale/Deftones/1997 - Around the Fur/folder.jpg
Music/Musique generale/Deftones/2000 - Back To School (Mini Maggit)/01 - Back to School (Mini Maggit).m4a
Music/Musique generale/Deftones/2000 - Back To School (Mini Maggit)/02 - Feiticeira (live).m4a
Music/Musique generale/Deftones/2000 - Back To School (Mini Maggit)/03 - Back to School (Mini Maggit) (live).m4a
Music/Musique generale/Deftones/2000 - Back To School (Mini Maggit)/04 - Nosebleed (live).m4a
Music/Musique generale/Deftones/2000 - Back To School (Mini Maggit)/05 - Teething (live).m4a
Music/Musique generale/Deftones/2000 - Back To School (Mini Maggit)/06 - Change (In the House of Flies) (acoustic).m4a
Music/Musique generale/Deftones/2000 - Back To School (Mini Maggit)/07 - Pink Maggit.m4a
Music/Musique generale/Deftones/2000 - Back To School (Mini Maggit)/folder.jpg
Music/Musique generale/Deftones/2000 - White Pony/01 - Feiticeira.m4a
Music/Musique generale/Deftones/2000 - White Pony/02 - Digital Bath.m4a
Music/Musique generale/Deftones/2000 - White Pony/03 - Elite.m4a
Music/Musique generale/Deftones/2000 - White Pony/04 - Rx Queen.m4a
Music/Musique generale/Deftones/2000 - White Pony/05 - Street Carp.m4a
Music/Musique generale/Deftones/2000 - White Pony/06 - Teenager.m4a
Music/Musique generale/Deftones/2000 - White Pony/07 - Knife Prty.m4a
Music/Musique generale/Deftones/2000 - White Pony/08 - Korea.m4a
Music/Musique generale/Deftones/2000 - White Pony/09 - Passenger.m4a
Music/Musique generale/Deftones/2000 - White Pony/10 - Change (In the House of Flies).m4a
Music/Musique generale/Deftones/2000 - White Pony/11 - Pink Maggit.m4a
Music/Musique generale/Deftones/2000 - White Pony/12 - The Boy's Republic.m4a
Music/Musique generale/Deftones/2000 - White Pony/folder.jpg
Music/Musique generale/Deftones/2003 - Deftones/01 - Hexagram.m4a
Music/Musique generale/Deftones/2003 - Deftones/02 - Needles and Pins.m4a
Music/Musique generale/Deftones/2003 - Deftones/03 - Minerva.m4a
Music/Musique generale/Deftones/2003 - Deftones/04 - Good Morning Beautiful.m4a
Music/Musique generale/Deftones/2003 - Deftones/05 - Deathblow.m4a
Music/Musique generale/Deftones/2003 - Deftones/06 - When Girls Telephone Boys.m4a
Music/Musique generale/Deftones/2003 - Deftones/07 - Battle‐Axe.m4a
Music/Musique generale/Deftones/2003 - Deftones/08 - Lucky You.m4a
Music/Musique generale/Deftones/2003 - Deftones/09 - Bloody Cape.m4a
Music/Musique generale/Deftones/2003 - Deftones/10 - Anniversary of an Uninteresting Event.m4a
Music/Musique generale/Deftones/2003 - Deftones/11 - Moana.m4a
Music/Musique generale/Deftones/2003 - Deftones/cover.jpg
Music/Musique generale/Deftones/2005 - B-Sides & Rarities/01 - Savory.m4a
Music/Musique generale/Deftones/2005 - B-Sides & Rarities/02 - Wax and Wane.m4a
Music/Musique generale/Deftones/2005 - B-Sides & Rarities/03 - Change (In the House of Flies) (acoustic).m4a
Music/Musique generale/Deftones/2005 - B-Sides & Rarities/04 - Simple Man.m4a
Music/Musique generale/Deftones/2005 - B-Sides & Rarities/05 - Sinatra.m4a
Music/Musique generale/Deftones/2005 - B-Sides & Rarities/06 - No Ordinary Love.m4a
Music/Musique generale/Deftones/2005 - B-Sides & Rarities/07 - Teenager (Idiot version).m4a
Music/Musique generale/Deftones/2005 - B-Sides & Rarities/08 - Crenshaw Punch,I’ll Throw Rocks at You.m4a
Music/Musique generale/Deftones/2005 - B-Sides & Rarities/09 - Black Moon.m4a
Music/Musique generale/Deftones/2005 - B-Sides & Rarities/10 - If Only Tonight We Could Sleep.m4a
Music/Musique generale/Deftones/2005 - B-Sides & Rarities/11 - Please Please Please Let Me Get What I Want.m4a
Music/Musique generale/Deftones/2005 - B-Sides & Rarities/12 - Digital Bath (acoustic).m4a
Music/Musique generale/Deftones/2005 - B-Sides & Rarities/13 - The Chauffeur.m4a
Music/Musique generale/Deftones/2005 - B-Sides & Rarities/14 - Be Quiet and Drive (Far Away) (acoustic).m4a
Music/Musique generale/Deftones/2005 - B-Sides & Rarities/folder.jpg
Music/Musique generale/Deftones/2006 - Saturday Night Wrist/01 - Hole in the Earth.m4a
Music/Musique generale/Deftones/2006 - Saturday Night Wrist/02 - Rapture.m4a
Music/Musique generale/Deftones/2006 - Saturday Night Wrist/03 - Beware.m4a
Music/Musique generale/Deftones/2006 - Saturday Night Wrist/04 - Cherry Waves.m4a
Music/Musique generale/Deftones/2006 - Saturday Night Wrist/05 - Mein.m4a
Music/Musique generale/Deftones/2006 - Saturday Night Wrist/06 - U,U,D,D,L,R,L,R,A,B,Select,Start.m4a
Music/Musique generale/Deftones/2006 - Saturday Night Wrist/07 - Xerces.m4a
Music/Musique generale/Deftones/2006 - Saturday Night Wrist/08 - Rats!Rats!Rats!.m4a
Music/Musique generale/Deftones/2006 - Saturday Night Wrist/09 - Pink Cellphone.m4a
Music/Musique generale/Deftones/2006 - Saturday Night Wrist/10 - Combat.m4a
Music/Musique generale/Deftones/2006 - Saturday Night Wrist/11 - Kimdracula.m4a
Music/Musique generale/Deftones/2006 - Saturday Night Wrist/12 - Rivière.m4a
Music/Musique generale/Deftones/2006 - Saturday Night Wrist/folder.jpg
Music/Musique generale/Deftones/2010 - Diamond Eyes/01 - Diamond Eyes.m4a
Music/Musique generale/Deftones/2010 - Diamond Eyes/02 - Royal.m4a
Music/Musique generale/Deftones/2010 - Diamond Eyes/03 - CMND_CTRL.m4a
Music/Musique generale/Deftones/2010 - Diamond Eyes/04 - You’ve Seen the Butcher.m4a
Music/Musique generale/Deftones/2010 - Diamond Eyes/05 - Beauty School.m4a
Music/Musique generale/Deftones/2010 - Diamond Eyes/06 - Prince.m4a
Music/Musique generale/Deftones/2010 - Diamond Eyes/07 - Rocket Skates.m4a
Music/Musique generale/Deftones/2010 - Diamond Eyes/08 - Sextape.m4a
Music/Musique generale/Deftones/2010 - Diamond Eyes/09 - Risk.m4a
Music/Musique generale/Deftones/2010 - Diamond Eyes/10 - 976-EVIL.m4a
Music/Musique generale/Deftones/2010 - Diamond Eyes/11 - This Place Is Death.m4a
Music/Musique generale/Deftones/2010 - Diamond Eyes/12 - Do You Believe (The Cardigans cover).mp3
Music/Musique generale/Deftones/2010 - Diamond Eyes/13 - Ghosts (Japan cover).mp3
Music/Musique generale/Deftones/2010 - Diamond Eyes/14 - Caress (Drive Like Jehu cover).mp3
Music/Musique generale/Deftones/2010 - Diamond Eyes/cover.jpg
Music/Musique generale/Deftones/2012 - Koi no Yokan/01 - Swerve City.m4a
Music/Musique generale/Deftones/2012 - Koi no Yokan/02 - Romantic Dreams.m4a
Music/Musique generale/Deftones/2012 - Koi no Yokan/03 - Leathers.m4a
Music/Musique generale/Deftones/2012 - Koi no Yokan/04 - Poltergeist.m4a
Music/Musique generale/Deftones/2012 - Koi no Yokan/05 - Entombed.m4a
Music/Musique generale/Deftones/2012 - Koi no Yokan/06 - Graphic Nature.m4a
Music/Musique generale/Deftones/2012 - Koi no Yokan/07 - Tempest.m4a
Music/Musique generale/Deftones/2012 - Koi no Yokan/08 - Gauze.m4a
Music/Musique generale/Deftones/2012 - Koi no Yokan/09 - Rosemary.m4a
Music/Musique generale/Deftones/2012 - Koi no Yokan/10 - Goon Squad.m4a
Music/Musique generale/Deftones/2012 - Koi no Yokan/11 - What Happened to You_.m4a
Music/Musique generale/Deftones/2012 - Koi no Yokan/cover.jpg
Music/Musique generale/Deftones/2016 - Gore/01 - Prayers_Triangles.m4a
Music/Musique generale/Deftones/2016 - Gore/02 - Acid Hologram.m4a
Music/Musique generale/Deftones/2016 - Gore/03 - Doomed User.m4a
Music/Musique generale/Deftones/2016 - Gore/04 - Geometric Headdress.m4a
Music/Musique generale/Deftones/2016 - Gore/05 - Hearts_Wires.m4a
Music/Musique generale/Deftones/2016 - Gore/06 - Pittura infamante.m4a
Music/Musique generale/Deftones/2016 - Gore/07 - Xenon.m4a
Music/Musique generale/Deftones/2016 - Gore/08 - (L)MIRL.m4a
Music/Musique generale/Deftones/2016 - Gore/09 - Gore.m4a
Music/Musique generale/Deftones/2016 - Gore/10 - Phantom Bride.m4a
Music/Musique generale/Deftones/2016 - Gore/11 - Rubicon.m4a
Music/Musique generale/Deftones/2016 - Gore/folder.jpg
Music/Musique generale/Deftones/2020 - Ohms/01 - Genesis.m4a
Music/Musique generale/Deftones/2020 - Ohms/02 - Ceremony.m4a
Music/Musique generale/Deftones/2020 - Ohms/03 - Urantia.m4a
Music/Musique generale/Deftones/2020 - Ohms/04 - Error.m4a
Music/Musique generale/Deftones/2020 - Ohms/05 - The Spell of Mathematics.m4a
Music/Musique generale/Deftones/2020 - Ohms/06 - Pompeji.m4a
Music/Musique generale/Deftones/2020 - Ohms/07 - This Link Is Dead.m4a
Music/Musique generale/Deftones/2020 - Ohms/08 - Radiant City.m4a
Music/Musique generale/Deftones/2020 - Ohms/09 - Headless.m4a
Music/Musique generale/Deftones/2020 - Ohms/10 - Ohms.m4a
Music/Musique generale/Deftones/2020 - Ohms/cover.jpg
murgen
September 23, 2022, 5:41am
7
Same with -vv:
ubuntu@navidrome:~$ rclone lsf -R -vv --max-depth 5 "idrive-e2-navidrome:navidrome-music/Music/Musique generale/Deftones/"
2022/09/23 05:40:40 DEBUG : rclone: Version "v1.59.2" starting with parameters ["rclone" "lsf" "-R" "-vv" "--max-depth" "5" "idrive-e2-navidrome:navidrome-music/Music/Musique generale/Deftones/"]
2022/09/23 05:40:40 DEBUG : Creating backend with remote "idrive-e2-navidrome:navidrome-music/Music/Musique generale/Deftones/"
2022/09/23 05:40:40 DEBUG : Using config file from "/home/ubuntu/.config/rclone/rclone.conf"
2022/09/23 05:40:40 DEBUG : fs cache: renaming cache item "idrive-e2-navidrome:navidrome-music/Music/Musique generale/Deftones/" to be canonical "idrive-e2-navidrome:navidrome-music/Music/Musique generale/Deftones"
1993 - (Like) Linus/
1995 - Adrenaline/
1997 - Around the Fur/
2000 - Back To School (Mini Maggit)/
2000 - White Pony/
2003 - Deftones/
2005 - B-Sides & Rarities/
2006 - Saturday Night Wrist/
2010 - Diamond Eyes/
2012 - Koi no Yokan/
2016 - Gore/
2020 - Ohms/
2006 - Saturday Night Wrist/01 - Hole in the Earth.m4a
2006 - Saturday Night Wrist/02 - Rapture.m4a
2006 - Saturday Night Wrist/03 - Beware.m4a
2006 - Saturday Night Wrist/04 - Cherry Waves.m4a
2006 - Saturday Night Wrist/05 - Mein.m4a
2006 - Saturday Night Wrist/06 - U,U,D,D,L,R,L,R,A,B,Select,Start.m4a
2006 - Saturday Night Wrist/07 - Xerces.m4a
2006 - Saturday Night Wrist/08 - Rats!Rats!Rats!.m4a
2006 - Saturday Night Wrist/09 - Pink Cellphone.m4a
2006 - Saturday Night Wrist/10 - Combat.m4a
2006 - Saturday Night Wrist/11 - Kimdracula.m4a
2006 - Saturday Night Wrist/12 - Rivière.m4a
2006 - Saturday Night Wrist/folder.jpg
2000 - White Pony/01 - Feiticeira.m4a
2000 - White Pony/02 - Digital Bath.m4a
2000 - White Pony/03 - Elite.m4a
2000 - White Pony/04 - Rx Queen.m4a
2000 - White Pony/05 - Street Carp.m4a
2000 - White Pony/06 - Teenager.m4a
2000 - White Pony/07 - Knife Prty.m4a
2000 - White Pony/08 - Korea.m4a
2000 - White Pony/09 - Passenger.m4a
2000 - White Pony/10 - Change (In the House of Flies).m4a
2000 - White Pony/11 - Pink Maggit.m4a
2000 - White Pony/12 - The Boy's Republic.m4a
2000 - White Pony/folder.jpg
1993 - (Like) Linus/01 - Like Linus (a).m4a
1993 - (Like) Linus/02 - Some People.m4a
1993 - (Like) Linus/03 - Answers.m4a
1993 - (Like) Linus/04 - Hump.m4a
1993 - (Like) Linus/05 - Christmas.m4a
1993 - (Like) Linus/06 - Plastic.m4a
1993 - (Like) Linus/07 - Venison.m4a
1993 - (Like) Linus/08 - Gift.m4a
1993 - (Like) Linus/09 - Like Linus (b).m4a
1993 - (Like) Linus/10 - Freaks.m4a
1993 - (Like) Linus/11 - Engine No. 9 (a).m4a
1993 - (Like) Linus/12 - Root.m4a
1993 - (Like) Linus/13 - 7 Words.m4a
1993 - (Like) Linus/14 - Engine No. 9 (b).m4a
1993 - (Like) Linus/15 - Teething.m4a
1993 - (Like) Linus/cover.jpg
1997 - Around the Fur/01 - My Own Summer (Shove It).m4a
1997 - Around the Fur/02 - Lhabia.m4a
1997 - Around the Fur/03 - Mascara.m4a
1997 - Around the Fur/04 - Around the Fur.m4a
1997 - Around the Fur/05 - Rickets.m4a
1997 - Around the Fur/06 - Be Quiet and Drive (Far Away).m4a
1997 - Around the Fur/07 - Lotion.m4a
1997 - Around the Fur/08 - Dai the Flu.m4a
1997 - Around the Fur/09 - Headup.m4a
1997 - Around the Fur/10 - MX.m4a
1997 - Around the Fur/11 - Bong Hit.m4a
1997 - Around the Fur/12 - Damone.m4a
1997 - Around the Fur/folder.jpg
1995 - Adrenaline/01 - Bored.m4a
1995 - Adrenaline/02 - Minus Blindfold.m4a
1995 - Adrenaline/03 - One Weak.m4a
1995 - Adrenaline/04 - Nosebleed.m4a
1995 - Adrenaline/05 - Lifter.m4a
1995 - Adrenaline/06 - Root.m4a
1995 - Adrenaline/07 - 7 Words.m4a
1995 - Adrenaline/08 - Birthmark.m4a
1995 - Adrenaline/09 - Engine No. 9.m4a
1995 - Adrenaline/10 - Fireal.m4a
1995 - Adrenaline/11 - Fist.m4a
1995 - Adrenaline/folder.jpg
2003 - Deftones/01 - Hexagram.m4a
2003 - Deftones/02 - Needles and Pins.m4a
2003 - Deftones/03 - Minerva.m4a
2003 - Deftones/04 - Good Morning Beautiful.m4a
2003 - Deftones/05 - Deathblow.m4a
2003 - Deftones/06 - When Girls Telephone Boys.m4a
2003 - Deftones/07 - Battle‐Axe.m4a
2003 - Deftones/08 - Lucky You.m4a
2003 - Deftones/09 - Bloody Cape.m4a
2003 - Deftones/10 - Anniversary of an Uninteresting Event.m4a
2003 - Deftones/11 - Moana.m4a
2003 - Deftones/cover.jpg
2000 - Back To School (Mini Maggit)/01 - Back to School (Mini Maggit).m4a
2000 - Back To School (Mini Maggit)/02 - Feiticeira (live).m4a
2000 - Back To School (Mini Maggit)/03 - Back to School (Mini Maggit) (live).m4a
2000 - Back To School (Mini Maggit)/04 - Nosebleed (live).m4a
2000 - Back To School (Mini Maggit)/05 - Teething (live).m4a
2000 - Back To School (Mini Maggit)/06 - Change (In the House of Flies) (acoustic).m4a
2000 - Back To School (Mini Maggit)/07 - Pink Maggit.m4a
2000 - Back To School (Mini Maggit)/folder.jpg
2010 - Diamond Eyes/01 - Diamond Eyes.m4a
2010 - Diamond Eyes/02 - Royal.m4a
2010 - Diamond Eyes/03 - CMND_CTRL.m4a
2010 - Diamond Eyes/04 - You’ve Seen the Butcher.m4a
2010 - Diamond Eyes/05 - Beauty School.m4a
2010 - Diamond Eyes/06 - Prince.m4a
2010 - Diamond Eyes/07 - Rocket Skates.m4a
2010 - Diamond Eyes/08 - Sextape.m4a
2010 - Diamond Eyes/09 - Risk.m4a
2010 - Diamond Eyes/10 - 976-EVIL.m4a
2010 - Diamond Eyes/11 - This Place Is Death.m4a
2010 - Diamond Eyes/12 - Do You Believe (The Cardigans cover).mp3
2010 - Diamond Eyes/13 - Ghosts (Japan cover).mp3
2010 - Diamond Eyes/14 - Caress (Drive Like Jehu cover).mp3
2010 - Diamond Eyes/cover.jpg
2005 - B-Sides & Rarities/01 - Savory.m4a
2005 - B-Sides & Rarities/02 - Wax and Wane.m4a
2005 - B-Sides & Rarities/03 - Change (In the House of Flies) (acoustic).m4a
2005 - B-Sides & Rarities/04 - Simple Man.m4a
2005 - B-Sides & Rarities/05 - Sinatra.m4a
2005 - B-Sides & Rarities/06 - No Ordinary Love.m4a
2005 - B-Sides & Rarities/07 - Teenager (Idiot version).m4a
2005 - B-Sides & Rarities/08 - Crenshaw Punch,I’ll Throw Rocks at You.m4a
2005 - B-Sides & Rarities/09 - Black Moon.m4a
2005 - B-Sides & Rarities/10 - If Only Tonight We Could Sleep.m4a
2005 - B-Sides & Rarities/11 - Please Please Please Let Me Get What I Want.m4a
2005 - B-Sides & Rarities/12 - Digital Bath (acoustic).m4a
2005 - B-Sides & Rarities/13 - The Chauffeur.m4a
2005 - B-Sides & Rarities/14 - Be Quiet and Drive (Far Away) (acoustic).m4a
2005 - B-Sides & Rarities/folder.jpg
2012 - Koi no Yokan/01 - Swerve City.m4a
2012 - Koi no Yokan/02 - Romantic Dreams.m4a
2012 - Koi no Yokan/03 - Leathers.m4a
2012 - Koi no Yokan/04 - Poltergeist.m4a
2012 - Koi no Yokan/05 - Entombed.m4a
2012 - Koi no Yokan/06 - Graphic Nature.m4a
2012 - Koi no Yokan/07 - Tempest.m4a
2012 - Koi no Yokan/08 - Gauze.m4a
2012 - Koi no Yokan/09 - Rosemary.m4a
2012 - Koi no Yokan/10 - Goon Squad.m4a
2012 - Koi no Yokan/11 - What Happened to You_.m4a
2012 - Koi no Yokan/cover.jpg
2016 - Gore/01 - Prayers_Triangles.m4a
2016 - Gore/02 - Acid Hologram.m4a
2016 - Gore/03 - Doomed User.m4a
2016 - Gore/04 - Geometric Headdress.m4a
2016 - Gore/05 - Hearts_Wires.m4a
2016 - Gore/06 - Pittura infamante.m4a
2016 - Gore/07 - Xenon.m4a
2016 - Gore/08 - (L)MIRL.m4a
2016 - Gore/09 - Gore.m4a
2016 - Gore/10 - Phantom Bride.m4a
2016 - Gore/11 - Rubicon.m4a
2016 - Gore/folder.jpg
2020 - Ohms/01 - Genesis.m4a
2020 - Ohms/02 - Ceremony.m4a
2020 - Ohms/03 - Urantia.m4a
2020 - Ohms/04 - Error.m4a
2020 - Ohms/05 - The Spell of Mathematics.m4a
2020 - Ohms/06 - Pompeji.m4a
2020 - Ohms/07 - This Link Is Dead.m4a
2020 - Ohms/08 - Radiant City.m4a
2020 - Ohms/09 - Headless.m4a
2020 - Ohms/10 - Ohms.m4a
2020 - Ohms/cover.jpg
2022/09/23 05:40:40 DEBUG : 20 go routines active
murgen
September 23, 2022, 7:37pm
8
Ok I've found exactly how many folders are missing: 57 (out of 3893): I've loaded a 2 weeks old navidrome DB (when I'm sure all my folders were there), and after a full scan, navidrome logged the list of deleted folders.
I still don't know why they're missing because I can't see any correlation between them. They're just folders with music albums in it, like all the other folders of this mount. I don't know why rclone is somehow skipping them.
If any one has any idea or any clue about this issue, that would be awesome
ncw
September 23, 2022, 8:21pm
9
I meant list the directory in the mount using os tools not rclone.
So stop rclone mount, start it again with -vv then list that directory eg with ls then stop the mount and post the log.
murgen
September 23, 2022, 9:25pm
10
Ok thanks.ls on "Deftones" folder (which is actually listing all its subfoders):
BUT here's the thing: I'm running rclone as a service, and I have this:ExecStartPost=rclone rc vfs/refresh recursive=true --rc-addr 127.0.0.1:5572 _async=true --fast-list ; docker-compose -f /home/ubuntu/docker/navidrome/docker-compose.yml up -d that runs just after rclone mount.
If I run rclone rc vfs/refresh recursive=true --rc-addr 127.0.0.1:5572 _async=true --fast-list just after running rclone mount as a command line, (just like my service is doing), and if I ls again once it's done, poof, some folders disappeared in the process. But the thing is, "Deftones" subfolders don't appear in the resulting log (which is essentially composed of file extensions that I exclude from the mount, see the full command in my first post)
So the culprit seems to be actually this command line:rclone rc vfs/refresh recursive=true --rc-addr 127.0.0.1:5572 _async=true --fast-list
murgen
September 24, 2022, 6:46am
11
If that can help, here's my rclone.service file :
[Unit]
Description=rclone mount
Documentation=http://rclone.org/docs/
After=network.service
StartLimitInterval=500
StartLimitBurst=5
[Service]
Type=notify
Restart=on-failure
RestartSec=5
ExecStart=rclone mount idrive-e2-navidrome:navidrome-music /home/ubuntu/docker/navidrome/data/music \
--log-level INFO \
--rc \
--rc-no-auth \
--allow-other \
--buffer-size 3G \
--dir-cache-time 29h \
--read-only \
--vfs-cache-mode full \
--vfs-fast-fingerprint \
--vfs-cache-poll-interval 29h\
--vfs-cache-max-size 170G \
--vfs-cache-max-age 9999h \
--vfs-read-ahead 128M \
--vfs-read-chunk-size 16M \
--vfs-read-chunk-size-limit 128M \
--exclude="Kara/**" \
--exclude="Music/Divers/**" \
--exclude="*.mpc" \
--exclude="*.mpg" \
--exclude="*.avi" \
--exclude="*.mpeg" \
--exclude="*.zip" \
--exclude="*.rar" \
--exclude="*.mkv"
ExecStop=/bin/fusermount -uz /home/ubuntu/docker/navidrome/data/music
ExecStartPost=rclone rc vfs/refresh recursive=true --rc-addr 127.0.0.1:5572 _async=true --fast-list ; docker-compose -f /home/ubuntu/docker/navidrome/docker-compose.yml up -d
ExecStopPost=docker-compose -f /home/ubuntu/docker/navidrome/docker-compose.yml down
[Install]
WantedBy=default.target
system
October 24, 2022, 6:46am
12
This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.
