What is the problem you are having with rclone?
I have an issue where some changes made to my Gdrive are not being picked up by polling in a Windows mount, when the changes are made from another box.
Scenario: I have an unlimited Gdrive which I access from three different boxes. The first is a mount on a shared seedbox, running things like Sonarr, Radarr etc, and this is where the majority of updates are done to the mount. The second is an Ubuntu VPS where I run Plex so access is largely read only (although the mount is read/write, same as the seedbox). Thirdly, I have a mount on my Windows 10 PC for ad-hoc access, and it's with this that I am having the problem.
What happens is, any changes made to the mount on the Seedbox are being picked up ok by the VPS, but not always by the Windows mount - if files are created in the seedbox, they don't always appear on the Windows mount, files deleted don't disapear and so on. However, all changes made on the seedbox are picked up on the VPS (and by Plex). Also, after doing further testing, it seems I only get this problem when I have folders under folders. So if I have a structure such has "topfolder/subfolder", Windows correctly recognises the changes and updates the directory cache, but if I have another level of folders, such as "topfolder/subfolder/subsubfolder" it doesn't pick up any changes that have been made via the seedbox.
I've created a test mount and have reproduced the issue. I am simply creating a new empty file on the seedbox mount, two folders deep, which appears on the VPS but not on Windows. There is an interesting part in the debug logs that may indicate what's happening. On the VPS, when polling detects the change, I see:
2020/05/27 12:50:20 DEBUG : Google drive root 'Encrypted': Checking for changes on remote
2020/05/27 12:50:20 DEBUG : : changeNotify: relativePath="Sub1/Subsub1/emptyfile1", type=3
2020/05/27 12:50:20 DEBUG : Sub1/Subsub1: invalidating directory cache
2020/05/27 12:50:20 DEBUG : : >changeNotify:
However, on the Windows mount I see:
2020/05/27 12:50:29 DEBUG : Google drive root 'Encrypted': Checking for changes on remote
2020/05/27 12:50:29 DEBUG : : changeNotify: relativePath="Sub1/Subsub1/emptyfile1", type=3
2020/05/27 12:50:29 DEBUG : : >changeNotify:
Note the missing line: - Sub1/Subsub1: invalidating directory cache
So it looks like on Windows that any changes to folders more than one deep are being recognised but the directory cache isn't being invalidated and hence why I can't see the changes in Windows Explorer or using DIR on the mounted drive.
Is this a bug?
What is your rclone version (output from rclone version
)
rclone v1.51.0
- os/arch: windows/amd64
- go version: go1.13.7
Which OS you are using and how many bits (eg Windows 7, 64 bit)
Seedbox - some flavour of Debian, 64bit
VPS - Ubuntu 18.04 64 bit
Windows - 10, 64 bit
Which cloud storage system are you using? (eg Google Drive)
GSuite
The command you were trying to run (eg rclone copy /tmp remote:tmp
)
Seedbox mount: /home18/renzz27/rclonenew/rclone mount Gsuite-Crypt: /home18/renzz27/files/Test-mount/ --dir-cache-time 24h --allow-other --drive-chunk-size 512M --vfs-cache-mode writes --log-file /home18/renzz27/files/rclone-test-mount.log --user-agent Laurie --buffer-size 256M --config /home18/renzz27/files/rclone-test.conf -vv --poll-interval 15s
VPS mount: rclone mount Gsuite-Crypt: /home/lauried/files/Test-mount/ --dir-cache-time 24h --allow-other --drive-chunk-size 512M --vfs-cache-mode writes --log-file /home/lauried/files/rclone-test-mount.log --user-agent Laurie --buffer-size 256M --config /home/lauried/files/rclone-test.conf -vv --poll-interval 15s
Windows mount: c:\video\rclone\rclone.exe mount Gsuite-Crypt: x: --dir-cache-time 24h --drive-chunk-size 512M --vfs-cache-mode writes --log-file c:\video\rclone\rclone-test-mount.log --user-agent Laurie --buffer-size 256M --config C:\Users\renzz\.config\rclone\rclone-test.conf -vv --poll-interval 15s
A log from the command with the -vv
flag (eg output from rclone -vv copy /tmp remote:tmp
)
A zip with debug logs from all three servers is at https://wsi.li/RNe0YY4OEjZkdH/2582009
My test rclone.conf is:
[Gsuite]
type = drive
client_id = xxxxxx
client_secret = xxxxxx
scope = drive
root_folder_id = 0AIBwCvABIKkBUk9PVA
service_account_file =
token = xxxxxx
[Gsuite-Crypt]
type = crypt
remote = Gsuite:Encrypted
filename_encryption = standard
password = xxxxxx
password2 = xxxxxx