Vfs cache not populating

filthyrich · September 19, 2022, 6:23am

What is the problem you are having with rclone?

vfs cache isnt being used.

Its only going as far as /home/plex/cached/vfs/gdrive/media/

It used to go to dirs like tv and moofies, and fill up and and then delete. Now it just sits there doing nothing.

Run the command 'rclone version' and share the full output of the command.

rclone v1.59.2

os/version: ubuntu 22.04 (64 bit)
os/kernel: 5.15.0-47-generic (x86_64)
os/type: linux
os/arch: amd64
go/version: go1.18.6
go/linking: static
go/tags: none

Are you on the latest version of rclone? You can validate by checking the version listed here: Rclone downloads

yes

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

\\\
/usr/bin/rclone mount --allow-other --allow-non-empty --vfs-cache-mode=writes --dir-cache-time=360h --log-level=INFO --log-file=/home/plex/logs/rclone.log --poll-interval=15s --umask 002 --cache-dir=/home/plex/cache --vfs-cache-max-size=400G --vfs-cache-max-age=72h gdrive:/media/ /home/plex/media/cloud/ \\\

The rclone config contents with secrets removed.

\\
[gdrive]
type = drive
client_id = xxx
client_secret = xxx
scope = drive
token = {"access_token":"ya29.a0Aa4xrXPxHZ3Z3DtYDuTHopEyAGGM6EkwUdzJVc5EzJ0sz5XOZjuhJIv9pB-0z3FiSIXeWd2NEHrOPoeuR1NOP8YbFergHNFJ8U-AsVgV8BQ85Qwuyoyli5Bspz6dNAG0-fF2aqNjhyfOfZ30km5Cd-UDqyjr4JwaCgYKATASARMSFQEjDvL9_-TCkvaajTdZ3OGdwjZ-7Q0166","token_type":"Bearer","refresh_token":"1//0gqFBuCocIXhfCgYIARAAGBASNwF-L9IrhYN7nuk-8R9cgMcuZhB3W5qWxkZs1VuGQArDTlXho_ep2ZfRHCxMTYGOXFShWKxi4qg","expiry":"2022-09-19T05:46:33.875930963Z"}
team_drive =

\\

A log from the command with the `-vv` flag

\\\

2022/09/19 05:41:52 DEBUG : rclone: Version "v1.59.2" starting with parameters ["/usr/bin/rclone" "mount" "-vv" "--allow-other" "--allow-non-empty" "--vfs-cache-mode=writes" "--dir-cache-t>
2022/09/19 05:41:52 DEBUG : Creating backend with remote "gdrive:/media/"
2022/09/19 05:41:52 DEBUG : Using config file from "/home/plex/.config/rclone/rclone.conf"
2022/09/19 05:41:53 DEBUG : Google drive root 'media': 'root_folder_id = 0ANINpko81IIDUk9PVA' - save this in the config to speed up startup
2022/09/19 05:41:53 DEBUG : fs cache: renaming cache item "gdrive:/media/" to be canonical "gdrive:media"
2022/09/19 05:41:54 DEBUG : vfs cache: root is "/home/plex/cached"
2022/09/19 05:41:54 DEBUG : vfs cache: data root is "/home/plex/cached/vfs/gdrive/media"
2022/09/19 05:41:54 DEBUG : vfs cache: metadata root is "/home/plex/cached/vfsMeta/gdrive/media"
2022/09/19 05:41:54 DEBUG : Creating backend with remote "/home/plex/cached/vfs/gdrive/media"
2022/09/19 05:41:54 DEBUG : Creating backend with remote "/home/plex/cached/vfsMeta/gdrive/media"
2022/09/19 05:41:54 DEBUG : Google drive root 'media': Mounting on "/home/plex/media/cloud/"
2022/09/19 05:41:54 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/09/19 05:41:54 DEBUG : : Root:
2022/09/19 05:41:54 DEBUG : : >Root: node=/, err=<nil>
2022/09/19 05:42:05 DEBUG : /: Attr:
2022/09/19 05:42:05 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:05 DEBUG : /: Lookup: name="music"
2022/09/19 05:42:06 DEBUG : /: >Lookup: node=music/, err=<nil>
2022/09/19 05:42:06 DEBUG : music/: Attr:
2022/09/19 05:42:06 DEBUG : music/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:06 DEBUG : music/: Lookup: name="Ministry Of Sound - The Annual"
2022/09/19 05:42:06 DEBUG : music/: >Lookup: node=music/Ministry Of Sound - The Annual/, err=<nil>
2022/09/19 05:42:06 DEBUG : music/Ministry Of Sound - The Annual/: Attr:
2022/09/19 05:42:06 DEBUG : music/Ministry Of Sound - The Annual/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:06 DEBUG : music/Ministry Of Sound - The Annual/: Lookup: name=".grab"
2022/09/19 05:42:07 DEBUG : music/Ministry Of Sound - The Annual/: >Lookup: node=<nil>, err=no such file or directory
2022/09/19 05:42:07 DEBUG : /: Attr:
2022/09/19 05:42:07 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:07 DEBUG : /: Lookup: name="moofies"
2022/09/19 05:42:07 DEBUG : /: >Lookup: node=moofies/, err=<nil>
2022/09/19 05:42:07 DEBUG : moofies/: Attr:
2022/09/19 05:42:07 DEBUG : moofies/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:07 DEBUG : moofies/: Lookup: name="1980s"
2022/09/19 05:42:07 DEBUG : moofies/: >Lookup: node=moofies/1980s/, err=<nil>
2022/09/19 05:42:07 DEBUG : moofies/1980s/: Attr:
2022/09/19 05:42:07 DEBUG : moofies/1980s/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:07 DEBUG : moofies/1980s/: Lookup: name=".grab"
2022/09/19 05:42:09 DEBUG : Google drive root 'media': Checking for changes on remote
2022/09/19 05:42:19 DEBUG : moofies/1980s/: >Lookup: node=<nil>, err=no such file or directory
2022/09/19 05:42:19 DEBUG : /: Attr:
2022/09/19 05:42:19 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:19 DEBUG : /: Lookup: name="moofies"
2022/09/19 05:42:19 DEBUG : /: >Lookup: node=moofies/, err=<nil>
2022/09/19 05:42:19 DEBUG : moofies/: Attr:
2022/09/19 05:42:19 DEBUG : moofies/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:19 DEBUG : moofies/: Lookup: name="1990s"
2022/09/19 05:42:19 DEBUG : moofies/: >Lookup: node=moofies/1990s/, err=<nil>
2022/09/19 05:42:19 DEBUG : moofies/1990s/: Attr:
2022/09/19 05:42:19 DEBUG : moofies/1990s/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:19 DEBUG : moofies/1990s/: Lookup: name=".grab"
2022/09/19 05:42:24 DEBUG : Google drive root 'media': Checking for changes on remote
2022/09/19 05:42:31 DEBUG : moofies/1990s/: >Lookup: node=<nil>, err=no such file or directory
2022/09/19 05:42:31 DEBUG : /: Attr:
2022/09/19 05:42:31 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:31 DEBUG : /: Lookup: name="moofies"
2022/09/19 05:42:31 DEBUG : /: >Lookup: node=moofies/, err=<nil>
2022/09/19 05:42:31 DEBUG : moofies/: Attr:
2022/09/19 05:42:31 DEBUG : moofies/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:31 DEBUG : moofies/: Lookup: name="2000s"
2022/09/19 05:42:31 DEBUG : moofies/: >Lookup: node=moofies/2000s/, err=<nil>
2022/09/19 05:42:31 DEBUG : moofies/2000s/: Attr:
2022/09/19 05:42:31 DEBUG : moofies/2000s/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:31 DEBUG : moofies/2000s/: Lookup: name=".grab"
2022/09/19 05:42:39 DEBUG : Google drive root 'media': Checking for changes on remote
2022/09/19 05:42:49 DEBUG : moofies/2000s/: >Lookup: node=<nil>, err=no such file or directory
2022/09/19 05:42:49 DEBUG : /: Attr:
2022/09/19 05:42:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:49 DEBUG : /: Lookup: name="moofies"
2022/09/19 05:42:49 DEBUG : /: >Lookup: node=moofies/, err=<nil>
2022/09/19 05:42:49 DEBUG : moofies/: Attr:
2022/09/19 05:42:49 DEBUG : moofies/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:49 DEBUG : moofies/: Lookup: name="2010s"
2022/09/19 05:42:49 DEBUG : moofies/: >Lookup: node=moofies/2010s/, err=<nil>
2022/09/19 05:42:49 DEBUG : moofies/2010s/: Attr:
2022/09/19 05:42:49 DEBUG : moofies/2010s/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:42:49 DEBUG : moofies/2010s/: Lookup: name=".grab"
2022/09/19 05:42:54 DEBUG : Google drive root 'media': Checking for changes on remote
2022/09/19 05:42:54 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/09/19 05:43:09 DEBUG : Google drive root 'media': Checking for changes on remote
2022/09/19 05:43:24 DEBUG : Google drive root 'media': Checking for changes on remote
2022/09/19 05:43:39 DEBUG : Google drive root 'media': Checking for changes on remote
2022/09/19 05:43:50 DEBUG : moofies/2010s/: >Lookup: node=<nil>, err=no such file or directory
2022/09/19 05:43:50 DEBUG : /: Attr:
2022/09/19 05:43:50 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:43:50 DEBUG : /: Lookup: name="moofies"
2022/09/19 05:43:50 DEBUG : /: >Lookup: node=moofies/, err=<nil>
2022/09/19 05:43:50 DEBUG : moofies/: Attr:
2022/09/19 05:43:50 DEBUG : moofies/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:43:50 DEBUG : moofies/: Lookup: name="2020s"
2022/09/19 05:43:50 DEBUG : moofies/: >Lookup: node=moofies/2020s/, err=<nil>
2022/09/19 05:43:50 DEBUG : moofies/2020s/: Attr:
2022/09/19 05:43:50 DEBUG : moofies/2020s/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2022/09/19 05:43:50 DEBUG : moofies/2020s/: Lookup: name=".grab"
2022/09/19 05:43:54 DEBUG : Google drive root 'media': Checking for changes on remote
2022/09/19 05:43:54 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)

filthyrich · September 19, 2022, 6:38am

I should note - it used to work fine..... about 2 weeks ago i noticed some buffering, and have just realised the cache isnt working...

Animosity022 · September 19, 2022, 11:01am

You only have writes so that would only populate in the cache if you write something. Perhaps you want to use full? The debug log has not writes in it.

filthyrich · September 20, 2022, 5:17am

Thanks. I guess I misunderstand write.... when would it write?

Nevermind.... i found the page that describes it and its pretty clear now.

system · October 20, 2022, 5:18am

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.