Rclone mount with --vfs-cache-mode writes problem

Bazzu85 · August 6, 2021, 2:17pm

ok, so I switched back to the full mode..there wasn't performance improvements..

can you help me with the actual cache?
here's today logs (with lite verbose)

2021/08/06 09:13:57 INFO  : vfs cache: cleaned: objects 24 (was 7415) in use 1, to upload 0, uploading 0, total size 316.974M (was 317.030M)
2021/08/06 10:13:51 INFO  : 00 - Online Media/Serie Tv/Grey's Anatomy (2005)/Stagione 17 [Sonarr]/Greys.Anatomy.S17E17.1080p.WEB.H264-STRONTiUM.it.srt: vfs cache: removed cache file as Removing old cache file not in use
2021/08/06 10:13:51 INFO  : vfs cache RemoveNotInUse (maxAge=14400000000000, emptyOnly=false): item 00 - Online Media/Serie Tv/Grey's Anatomy (2005)/Stagione 17 [Sonarr]/Greys.Anatomy.S17E17.1080p.WEB.H264-STRONTiUM.it.srt was removed, freed 54664 bytes
2021/08/06 10:13:51 INFO  : 00 - Online Media/Serie Tv/Mike & Molly (2010)/Stagione 05 [480p x264] [ENG]/Mike & Molly (2010) - S05E15 - La guerra delle torte [PDTV 480p x264] [ENG].mkv: vfs cache: removed cache file as Removing old cache file not in use
2021/08/06 10:13:51 INFO  : vfs cache RemoveNotInUse (maxAge=14400000000000, emptyOnly=false): item 00 - Online Media/Serie Tv/Mike & Molly (2010)/Stagione 05 [480p x264] [ENG]/Mike & Molly (2010) - S05E15 - La guerra delle torte [PDTV 480p x264] [ENG].mkv was removed, freed 14741504 bytes
2021/08/06 10:13:51 INFO  : 00 - Online Media/Cartoni/Teen Titans Go! (2013)/Stagione 07 [Sonarr]/Teen.Titans.Go!.S07E11.T.is.for.Titans.1080p.AMZN.WEB-DL.DD+2.0.H.264-NTb.mkv: vfs cache: removed cache file as Removing old cache file not in use
2021/08/06 10:13:51 INFO  : vfs cache RemoveNotInUse (maxAge=14400000000000, emptyOnly=false): item 00 - Online Media/Cartoni/Teen Titans Go! (2013)/Stagione 07 [Sonarr]/Teen.Titans.Go!.S07E11.T.is.for.Titans.1080p.AMZN.WEB-DL.DD+2.0.H.264-NTb.mkv was removed, freed 16584704 bytes
2021/08/06 10:13:51 INFO  : 00 - Online Media/Serie Tv/Baywatch (1989)/Stagione 10 [360p x264] [ENG]/Baywatch (1989) - S10E13 - Oltre i limiti [360p x264] [ENG].mkv: vfs cache: removed cache file as Removing old cache file not in use
2021/08/06 10:13:51 INFO  : vfs cache RemoveNotInUse (maxAge=14400000000000, emptyOnly=false): item 00 - Online Media/Serie Tv/Baywatch (1989)/Stagione 10 [360p x264] [ENG]/Baywatch (1989) - S10E13 - Oltre i limiti [360p x264] [ENG].mkv was removed, freed 14741504 bytes
2021/08/06 10:13:51 INFO  : 00 - Online Media/Cartoni/Teen Titans Go! (2013)/Stagione 07 [Sonarr]/Teen.Titans.Go!.S07E10.Cy.&.Beasty.1080p.AMZN.WEB-DL.DD+2.0.H.264-NTb.mkv: vfs cache: removed cache file as Removing old cache file not in use
2021/08/06 10:13:51 INFO  : vfs cache RemoveNotInUse (maxAge=14400000000000, emptyOnly=false): item 00 - Online Media/Cartoni/Teen Titans Go! (2013)/Stagione 07 [Sonarr]/Teen.Titans.Go!.S07E10.Cy.&.Beasty.1080p.AMZN.WEB-DL.DD+2.0.H.264-NTb.mkv was removed, freed 15962112 bytes
2021/08/06 10:13:51 INFO  : vfs cache: cleaned: objects 19 (was 24) in use 1, to upload 0, uploading 0, total size 257.766M (was 316.974M)
2021/08/06 11:13:51 INFO  : vfs cache: cleaned: objects 19 (was 19) in use 1, to upload 0, uploading 0, total size 257.766M (was 257.766M)
2021/08/06 12:13:51 INFO  : vfs cache: cleaned: objects 23 (was 23) in use 1, to upload 0, uploading 0, total size 331.727M (was 331.727M)
2021/08/06 13:13:51 INFO  : vfs cache: cleaned: objects 23 (was 23) in use 1, to upload 0, uploading 0, total size 331.727M (was 331.727M)
2021/08/06 14:13:51 INFO  : vfs cache: cleaned: objects 31 (was 31) in use 1, to upload 0, uploading 0, total size 331.727M (was 331.727M)
2021/08/06 15:13:51 INFO  : vfs cache: cleaned: objects 102 (was 102) in use 1, to upload 0, uploading 0, total size 803.608M (was 803.608M)

has you see now there are 803M cached and here's the cache folder content

Danball Senki - Little Battlers eXperience (2011) - S03E05 - The Black Wind Camp T... [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E06 - Formation Attack [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E07 - The Fort Tank, Eld Ha... [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E08 - Deploy the Riding Arm... [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E09 - LBX Graveyard [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E10 - Large Droid Invades [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E11 - Old Tales [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E12 - Bandit, The Intruder [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E13 - Where I Belong [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E14 - Battle at Angel Piece [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E15 - Fated Showdown [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E16 - The Sleepy Giran Fore... [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E17 - The Formless LBX [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E18 - The Revealed Truth [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E19 - For the Sake of the W... [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E20 - Battle in the Death F... [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E21 - Awakening! Overload [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E22 - A New Unit [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E23 - Targeted Hikaru [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E24 - Porton`s Pride [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E25 - Road to Recovery [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E26 - Doubt the Second Worl... [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E27 - Resurrected Soldier [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E28 - Clash! Muraku vs Kyou... [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E29 - Revival of the Violet... [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E31 - Our Own World Allianc... [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E32 - The Moment The World ... [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E33 - Arata's Decision [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E34 - True Battle [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E35 - Real Wars In The Box [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E36 - Final Battle [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E37 - To Our Future [WEBDL 240p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E30 - Seledy`s Identity [WEBDL 480p x264] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E01 - The Day we Arrived on... [WEBDL 720p] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E02 - Dreadful War Time [WEBDL 720p] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E03 - The Violet Devil of D... [WEBDL 720p] [JAPANESE].mkv
Danball Senki - Little Battlers eXperience (2011) - S03E04 - Entrusting the New We... [WEBDL 720p] [JAPANESE].mkv
Teen Titans Go! (2013) - S04E44-E45 - Il 200° spettacolare episodio da narcisisti! [NetflixHD 720p HEVC] [ITA+ENG].mkv
Teen.Titans.Go!.S07E10.Cy.&.Beasty.1080p.AMZN.WEB-DL.DD+2.0.H.264-NTb.mkv
Teen.Titans.Go!.S07E11.T.is.for.Titans.1080p.AMZN.WEB-DL.DD+2.0.H.264-NTb.mkv
Baywatch (1989) - S10E13 - Oltre i limiti [360p x264] [ENG].mkv
Mike & Molly (2010) - S05E15 - La guerra delle torte [PDTV 480p x264] [ENG].mkv
Power Rangers (1993) - S04E50 - Un'annata da ricordare [WEBDL 360p x264] [ENG].mkv
Power Rangers (1993) - S04E33 - Un benvenuto d'oro (2) [WEBDL 360p] [ENG].mkv
Power Rangers (1993) - S04E27 - Il potere dorato [WEBDL 480p] [ENG].mkv
Power Rangers (1993) - S04E28 - Un piccolo problema [WEBDL 480p] [ENG].mkv
Power Rangers (1993) - S04E40 - Dov'è il Ranger n°5 [WEBDL 480p] [ENG].mkv
Power Rangers (1993) - S04E43 - Un breve mistero del tempo [WEBDL 480p] [ENG].mkv
Power Rangers (1993) - S04E45 - Un'altra canzone e un altro ballo [WEBDL 480p] [ENG].mkv
Power Rangers (1993) - S05E08 - Bicycle Built for the Blues [WEBDL 480p] [ENG].mkv
Power Rangers (1993) - S05E11 - Weight and See [WEBDL 480p] [ENG].mkv
Power Rangers (1993) - S05E25 - When Time Freezes Over [WEBDL 480p] [ENG].mkv
Power Rangers (1993) - S05E34 - The Turn of the Wretched Wrench [WEBDL 480p] [ENG].mkv
Power Rangers (1993) - S05E37 - The Accident [WEBDL 480p] [ENG].mkv
Power Rangers (1993) - S06E07 - Un ranger ladro [WEBDL 480p] [ENG].mkv
Power Rangers (1993) - S06E13 - Nonna combinaincontri [WEBDL 480p] [ENG].mkv
Power Rangers (1993) - S06E15 - Crisi d'identità [WEBDL 480p] [ENG].mkv
Power Rangers (1993) - S06E19 - Cambio di corpo [WEBDL 480p] [ENG].mkv
Power Rangers (1993) - S07E24 - Coraggio Verde [WEBDL 360p x264] [ENG].mkv
Power Rangers (1993) - S07E27 - L’ultima Puntata di Loyax [WEBDL 360p x264] [ENG].mkv

these files are never opened by me, but maybe checked from some apps on the server (emby/sonarr/radarr ecc).
how can I find wich app is generating the cache?

Animosity022 · August 6, 2021, 2:22pm

What's the actual problem you are having as I'm having a hard time following?

You'd have to use some process explorer or something on Windows to figure it out and it's probably not worth the effort as one of those apps are reading files as rclone doesn't request anything itself.

Bazzu85 · August 6, 2021, 2:54pm

what I want to discover is why this small pool of files are been caching every f***g day.
maybe a bugged app?
if an app constantly read this files generating cache is wasted disk usage/rotation (I'm on a mechanical disk)

Animosity022 · August 6, 2021, 2:55pm

You'd have to run some process explorer to see what's going on.

Or turn off all the apps and turn them on one by one to see what's doing it.

Not really sure on Windows as it's a bit simpler on Linux.

Oladunjoye_Olasubomi · August 11, 2021, 12:07pm

Continuing the discussion from [Rclone mount with --vfs-cache-mode writes problem]
I am unable to mount more than one cloud storage in google colab. When i mount the first one, the cell freeze and i am unable to mount he second one. below is my mount code

def MountCMD():

mPoint = f"/content/drives/{mountNam.value}"

os.makedirs(mPoint, exist_ok=True)

!rclone mount $mountNam.value: $mPoint --user-agent 'Mozilla' --buffer-size 256M --transfers 10 --vfs-cache-mode minimal --vfs-read-chunk-size 500M --vfs-cache-max-size 50G --vfs-cache-max-age 0h0m1s --vfs-cache-poll-interval 0m1s --cache-dir '/content/temp/rCloneTemp' --allow-other --daemon 

if os.path.isdir(mPoint)== True:

  print(f"Mount success! - \t{mPoint}")

else:

  print(f"Mount failed! - \t{mPoint}")

Animosity022 · August 11, 2021, 12:08pm

Best to make a new post and use the help and support template.

system · October 11, 2021, 8:09am

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.