Vfs cache not populating

What is the problem you are having with rclone?

vfs cache isnt being used.

Its only going as far as /home/plex/cached/vfs/gdrive/media/

It used to go to dirs like tv and moofies, and fill up and and then delete. Now it just sits there doing nothing.

Run the command 'rclone version' and share the full output of the command.

rclone v1.59.2

  • os/version: ubuntu 22.04 (64 bit)
  • os/kernel: 5.15.0-47-generic (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.18.6
  • go/linking: static
  • go/tags: none

Are you on the latest version of rclone? You can validate by checking the version listed here: Rclone downloads

yes

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

\\\
/usr/bin/rclone mount --allow-other --allow-non-empty --vfs-cache-mode=writes --dir-cache-time=360h --log-level=INFO --log-file=/home/plex/logs/rclone.log --poll-interval=15s --umask 002 --cache-dir=/home/plex/cache --vfs-cache-max-size=400G --vfs-cache-max-age=72h gdrive:/media/ /home/plex/media/cloud/ \\\

The rclone config contents with secrets removed.

\\
[gdrive]
type = drive
client_id = xxx
client_secret = xxx
scope = drive
token = {"access_token":"ya29.a0Aa4xrXPxHZ3Z3DtYDuTHopEyAGGM6EkwUdzJVc5EzJ0sz5XOZjuhJIv9pB-0z3FiSIXeWd2NEHrOPoeuR1NOP8YbFergHNFJ8U-AsVgV8BQ85Qwuyoyli5Bspz6dNAG0-fF2aqNjhyfOfZ30km5Cd-UDqyjr4JwaCgYKATASARMSFQEjDvL9_-TCkvaajTdZ3OGdwjZ-7Q0166","token_type":"Bearer","refresh_token":"1//0gqFBuCocIXhfCgYIARAAGBASNwF-L9IrhYN7nuk-8R9cgMcuZhB3W5qWxkZs1VuGQArDTlXho_ep2ZfRHCxMTYGOXFShWKxi4qg","expiry":"2022-09-19T05:46:33.875930963Z"}
team_drive =

\\

A log from the command with the -vv flag

\\\

2022/09/19 05:41:52 DEBUG : rclone: Version "v1.59.2" starting with parameters ["/usr/bin/rclone" "mount" "-vv" "--allow-other" "--allow-non-empty" "--vfs-cache-mode=writes" "--dir-cache-t>
2022/09/19 05:41:52 DEBUG : Creating backend with remote "gdrive:/media/"
2022/09/19 05:41:52 DEBUG : Using config file from "/home/plex/.config/rclone/rclone.conf"
2022/09/19 05:41:53 DEBUG : Google drive root 'media': 'root_folder_id = 0ANINpko81IIDUk9PVA' - save this in the config to speed up startup
2022/09/19 05:41:53 DEBUG : fs cache: renaming cache item "gdrive:/media/" to be canonical "gdrive:media"
2022/09/19 05:41:54 DEBUG : vfs cache: root is "/home/plex/cached"
2022/09/19 05:41:54 DEBUG : vfs cache: data root is "/home/plex/cached/vfs/gdrive/media"
2022/09/19 05:41:54 DEBUG : vfs cache: metadata root is "/home/plex/cached/vfsMeta/gdrive/media"
2022/09/19 05:41:54 DEBUG : Creating backend with remote "/home/plex/cached/vfs/gdrive/media"
2022/09/19 05:41:54 DEBUG : Creating backend with remote "/home/plex/cached/vfsMeta/gdrive/media"
2022/09/19 05:41:54 DEBUG : Google drive root 'media': Mounting on "/home/plex/media/cloud/"
2022/09/19 05:41:54 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/09/19 05:41:54 DEBUG : : Root:
2022/09/19 05:41:54 DEBUG : : >Root: node=/, err=<nil>
2022/09/19 05:42:05 DEBUG : /: Attr:
2022/09/19 05:42:05 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:05 DEBUG : /: Lookup: name="music"
2022/09/19 05:42:06 DEBUG : /: >Lookup: node=music/, err=<nil>
2022/09/19 05:42:06 DEBUG : music/: Attr:
2022/09/19 05:42:06 DEBUG : music/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:06 DEBUG : music/: Lookup: name="Ministry Of Sound - The Annual"
2022/09/19 05:42:06 DEBUG : music/: >Lookup: node=music/Ministry Of Sound - The Annual/, err=<nil>
2022/09/19 05:42:06 DEBUG : music/Ministry Of Sound - The Annual/: Attr:
2022/09/19 05:42:06 DEBUG : music/Ministry Of Sound - The Annual/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:06 DEBUG : music/Ministry Of Sound - The Annual/: Lookup: name=".grab"
2022/09/19 05:42:07 DEBUG : music/Ministry Of Sound - The Annual/: >Lookup: node=<nil>, err=no such file or directory
2022/09/19 05:42:07 DEBUG : /: Attr:
2022/09/19 05:42:07 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:07 DEBUG : /: Lookup: name="moofies"
2022/09/19 05:42:07 DEBUG : /: >Lookup: node=moofies/, err=<nil>
2022/09/19 05:42:07 DEBUG : moofies/: Attr:
2022/09/19 05:42:07 DEBUG : moofies/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:07 DEBUG : moofies/: Lookup: name="1980s"
2022/09/19 05:42:07 DEBUG : moofies/: >Lookup: node=moofies/1980s/, err=<nil>
2022/09/19 05:42:07 DEBUG : moofies/1980s/: Attr:
2022/09/19 05:42:07 DEBUG : moofies/1980s/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:07 DEBUG : moofies/1980s/: Lookup: name=".grab"
2022/09/19 05:42:09 DEBUG : Google drive root 'media': Checking for changes on remote
2022/09/19 05:42:19 DEBUG : moofies/1980s/: >Lookup: node=<nil>, err=no such file or directory
2022/09/19 05:42:19 DEBUG : /: Attr:
2022/09/19 05:42:19 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:19 DEBUG : /: Lookup: name="moofies"
2022/09/19 05:42:19 DEBUG : /: >Lookup: node=moofies/, err=<nil>
2022/09/19 05:42:19 DEBUG : moofies/: Attr:
2022/09/19 05:42:19 DEBUG : moofies/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:19 DEBUG : moofies/: Lookup: name="1990s"
2022/09/19 05:42:19 DEBUG : moofies/: >Lookup: node=moofies/1990s/, err=<nil>
2022/09/19 05:42:19 DEBUG : moofies/1990s/: Attr:
2022/09/19 05:42:19 DEBUG : moofies/1990s/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:19 DEBUG : moofies/1990s/: Lookup: name=".grab"
2022/09/19 05:42:24 DEBUG : Google drive root 'media': Checking for changes on remote
2022/09/19 05:42:31 DEBUG : moofies/1990s/: >Lookup: node=<nil>, err=no such file or directory
2022/09/19 05:42:31 DEBUG : /: Attr:
2022/09/19 05:42:31 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:31 DEBUG : /: Lookup: name="moofies"
2022/09/19 05:42:31 DEBUG : /: >Lookup: node=moofies/, err=<nil>
2022/09/19 05:42:31 DEBUG : moofies/: Attr:
2022/09/19 05:42:31 DEBUG : moofies/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:31 DEBUG : moofies/: Lookup: name="2000s"
2022/09/19 05:42:31 DEBUG : moofies/: >Lookup: node=moofies/2000s/, err=<nil>
2022/09/19 05:42:31 DEBUG : moofies/2000s/: Attr:
2022/09/19 05:42:31 DEBUG : moofies/2000s/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:31 DEBUG : moofies/2000s/: Lookup: name=".grab"
2022/09/19 05:42:39 DEBUG : Google drive root 'media': Checking for changes on remote
2022/09/19 05:42:49 DEBUG : moofies/2000s/: >Lookup: node=<nil>, err=no such file or directory
2022/09/19 05:42:49 DEBUG : /: Attr:
2022/09/19 05:42:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:49 DEBUG : /: Lookup: name="moofies"
2022/09/19 05:42:49 DEBUG : /: >Lookup: node=moofies/, err=<nil>
2022/09/19 05:42:49 DEBUG : moofies/: Attr:
2022/09/19 05:42:49 DEBUG : moofies/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:49 DEBUG : moofies/: Lookup: name="2010s"
2022/09/19 05:42:49 DEBUG : moofies/: >Lookup: node=moofies/2010s/, err=<nil>
2022/09/19 05:42:49 DEBUG : moofies/2010s/: Attr:
2022/09/19 05:42:49 DEBUG : moofies/2010s/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:49 DEBUG : moofies/2010s/: Lookup: name=".grab"
2022/09/19 05:42:54 DEBUG : Google drive root 'media': Checking for changes on remote
2022/09/19 05:42:54 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/09/19 05:43:09 DEBUG : Google drive root 'media': Checking for changes on remote
2022/09/19 05:43:24 DEBUG : Google drive root 'media': Checking for changes on remote
2022/09/19 05:43:39 DEBUG : Google drive root 'media': Checking for changes on remote
2022/09/19 05:43:50 DEBUG : moofies/2010s/: >Lookup: node=<nil>, err=no such file or directory
2022/09/19 05:43:50 DEBUG : /: Attr:
2022/09/19 05:43:50 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:43:50 DEBUG : /: Lookup: name="moofies"
2022/09/19 05:43:50 DEBUG : /: >Lookup: node=moofies/, err=<nil>
2022/09/19 05:43:50 DEBUG : moofies/: Attr:
2022/09/19 05:43:50 DEBUG : moofies/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:43:50 DEBUG : moofies/: Lookup: name="2020s"
2022/09/19 05:43:50 DEBUG : moofies/: >Lookup: node=moofies/2020s/, err=<nil>
2022/09/19 05:43:50 DEBUG : moofies/2020s/: Attr:
2022/09/19 05:43:50 DEBUG : moofies/2020s/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:43:50 DEBUG : moofies/2020s/: Lookup: name=".grab"
2022/09/19 05:43:54 DEBUG : Google drive root 'media': Checking for changes on remote
2022/09/19 05:43:54 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)

I should note - it used to work fine..... about 2 weeks ago i noticed some buffering, and have just realised the cache isnt working...

You only have writes so that would only populate in the cache if you write something. Perhaps you want to use full? The debug log has not writes in it.

Thanks. I guess I misunderstand write.... when would it write?

Nevermind.... i found the page that describes it and its pretty clear now.