What is the problem you are having with rclone?
I am having an issue with rclone that I cannot solve. It seems like the VFS cache is causing google 403 errors when I mount my drive. I have been using the same mount command for over 2 years with almost no issues.
rclone mount 631_crypt: ~/rclone --dir-cache-time 2m --vfs-cache-max-age 1h --vfs-read-chunk-size 64M --vfs-read-chunk-size-limit 2G --drive-chunk-size 64M --buffer-size 16M --timeout 1h --vfs-cache-mode full -vv
It seems to fix itself when I delete the cache directories on my local drive. I have tried setting poll interval to 10m and it still polls every minute. It doesnt seem to respect the max-age as I have tried to change it to a few different lower values and tried changing the dir-cache-time as well. I have tried using a new client ID and secret from google, new toke even changing drives. No luck.
This is my latest mount attempt: rclone mount 631_crypt: ~/rclone --dir-cache-time 1m --vfs-cache-max-age 1m --vfs-read-chunk-size 64M --vfs-read-chunk-size-limit off --drive-chunk-size 64M --buffer-size 32M --timeout 1h --vfs-cache-mode full --vfs-cache-poll-interval 10m -vv
Run the command 'rclone version' and share the full output of the command.
rclone v1.61.1
- os/version: ubuntu 18.04 (64 bit)
- os/kernel: 5.4.0-105-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.19.4
- go/linking: static
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
Google Drive
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
rclone mount 631_crypt: ~/rclone --dir-cache-time 2m --vfs-cache-max-age 1h --vfs-read-chunk-size 64M --vfs-read-chunk-size-limit 2G --drive-chunk-size 64M --buffer-size 16M --timeout 1h --vfs-cache-mode full -vv
The rclone config contents with secrets removed.
[631_crypt]
type = crypt
remote = 631_nov1:data
filename_encryption = standard
directory_name_encryption = true
A log from the command with the -vv
flag
2023/01/29 15:26:32 DEBUG : rclone: Version "v1.61.1" starting with parameters ["rclone" "mount" "631_crypt:" "/home7/mrl1991/rclone" "--dir-cache-time" "1m" "--vfs-cache-max-age" "1m" "--vfs-read-chunk-size" "64M" "--vfs-read-chunk-size-limit" "off" "--drive-chunk-size" "64M" "--buffer-size" "32M" "--timeout" "1h" "--vfs-cache-mode" "full" "--vfs-cache-poll-interval" "10m" "-vv"]
2023/01/29 15:26:32 DEBUG : Creating backend with remote "631_crypt:"
2023/01/29 15:26:32 DEBUG : Using config file from "/home7/mrl1991/.config/rclone/rclone.conf"
2023/01/29 15:26:32 DEBUG : Creating backend with remote "631_nov1:data"
2023/01/29 15:26:32 DEBUG : 631_nov1: detected overridden config - adding "{84KcY}" suffix to name
2023/01/29 15:26:32 DEBUG : fs cache: renaming cache item "631_nov1:data" to be canonical "631_nov1{84KcY}:data"
2023/01/29 15:26:33 DEBUG : vfs cache: root is "/home7/mrl1991/.cache/rclone"
2023/01/29 15:26:33 DEBUG : vfs cache: data root is "/home7/mrl1991/.cache/rclone/vfs/631_crypt"
2023/01/29 15:26:33 DEBUG : vfs cache: metadata root is "/home7/mrl1991/.cache/rclone/vfsMeta/631_crypt"
2023/01/29 15:26:33 DEBUG : Creating backend with remote "/home7/mrl1991/.cache/rclone/vfs/631_crypt/"
2023/01/29 15:26:33 DEBUG : fs cache: renaming cache item "/home7/mrl1991/.cache/rclone/vfs/631_crypt/" to be canonical "/home7/mrl1991/.cache/rclone/vfs/631_crypt"
2023/01/29 15:26:33 DEBUG : Creating backend with remote "/home7/mrl1991/.cache/rclone/vfsMeta/631_crypt/"
2023/01/29 15:26:33 DEBUG : fs cache: renaming cache item "/home7/mrl1991/.cache/rclone/vfsMeta/631_crypt/" to be canonical "/home7/mrl1991/.cache/rclone/vfsMeta/631_crypt"
2023/01/29 15:26:34 DEBUG : media/tv/Poker Face (2023)/Season 1/Poker Face (2023) - S01E01 - Dead Man's Hand.mkv: vfs cache: truncate to size=7883285722 (not needed as size correct)
2023/01/29 15:26:34 DEBUG : media/tv/Poker Face (2023)/Season 1/Poker Face (2023) - S01E01 - Dead Man's Hand.mkv: vfs cache: setting modification time to 2023-01-27 10:39:50 -0500 EST
2023/01/29 15:26:34 INFO : media/tv/Poker Face (2023)/Season 1/Poker Face (2023) - S01E01 - Dead Man's Hand.mkv: vfs cache: queuing for upload in 5s
2023/01/29 15:26:35 DEBUG : Formula1.2021.Round13.Netherlands.FP1.SkySportsF1HD.1080p.H264.English-egortech.mkv: Skipping undecryptable file name: illegal base32 data at input byte 8
2023/01/29 15:26:36 DEBUG : media/tv/Poker Face (2023)/Season 1: Added virtual directory entry vAddFile: "Poker Face (2023) - S01E01 - Dead Man's Hand.mkv"
2023/01/29 15:26:36 DEBUG : Encrypted drive '631_crypt:': Mounting on "/home7/mrl1991/rclone"
2023/01/29 15:26:36 DEBUG : vfs cache RemoveNotInUse (maxAge=60000000000, emptyOnly=false): item media/tv/Poker Face (2023)/Season 1/Poker Face (2023) - S01E01 - Dead Man's Hand.mkv not removed, freed 0 bytes
2023/01/29 15:26:36 INFO : vfs cache: cleaned: objects 1 (was 1) in use 1, to upload 1, uploading 0, total size 7.342Gi (was 7.342Gi)
2023/01/29 15:26:36 DEBUG : : Root:
2023/01/29 15:26:36 DEBUG : : >Root: node=/, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Lookup: name=".Trash"
2023/01/29 15:26:36 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/01/29 15:26:36 DEBUG : /: Lookup: name=".Trash-1081"
2023/01/29 15:26:36 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/01/29 15:26:36 DEBUG : /: Lookup: name=".xdg-volume-info"
2023/01/29 15:26:36 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/01/29 15:26:36 DEBUG : /: Lookup: name="autorun.inf"
2023/01/29 15:26:36 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Attr:
2023/01/29 15:26:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2023/01/29 15:26:36 DEBUG : /: ReadDirAll:
2023/01/29 15:26:36 DEBUG : /: >ReadDirAll: item=4, err=<nil>
2023/01/29 15:26:36 DEBUG : /: Lookup: name="autorun.inf"
2023/01/29 15:26:36 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory
2023/01/29 15:26:39 DEBUG : media/tv/Poker Face (2023)/Season 1/Poker Face (2023) - S01E01 - Dead Man's Hand.mkv: vfs cache: starting upload
2023/01/29 15:26:40 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2023/01/29 15:26:40 DEBUG : pacer: Rate limited, increasing sleep to 1.303699156s
2023/01/29 15:26:40 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2023/01/29 15:26:40 DEBUG : pacer: Rate limited, increasing sleep to 2.570892244s
2023/01/29 15:26:42 DEBUG : pacer: low level retry 3/10 (error googleapi: Error 403: User rate limit exceeded., userRateLimitExceeded)
2023/01/29 15:26:42 DEBUG : pacer: Rate limited, increasing sleep to 4.136328072s