I have a bash script that bulk moves files into subdirectories. I use it on both local and rclone-mounted remote directories, and it worked perfectly until today.
I have 2 machines that both connect to the same GDrive backend. Machine 1 executes the script through an rclone-gdrive mount and the copy performs as normal. When completed, I can browse the directory from Machine 1 and everything is there as it should be. I can open, copy and delete the files as normal.
When I tried to access the same directory using a command-line
rclone ls from Machine 2, the directory appears empty. All the files and associated subdirectories are gone.
I initially thought Machine 1 borked the copy and was pulling them from VFS cache, so I performed a
rclone rc vfs/refresh on Machine 1 and every appeared to be fine. I could open and manipulate the files as normal. I then stopped and restarted the rclone mount on Machine 1 and the files disappeared.
So two things: How was Machine 1 able to access the files if they are, in fact, gone and two: why were the files gone. I've literally run this script hundreds of times across three different machines/OSs and rclone mount configurations with no issue.
v1.55 amd64 on Machine 1
v1.51 arm64 on Machine 2 (raspberry pi)
x64 Ubuntu Linux on Machine 1
arm64 Ubuntu Linux on Machine 2 (raspberry pi)
I was running
mv from the OS over an rclone mount.
[gdrive] type = drive client_id = [REDACTED] client_secret = [REDACTED] token = [REDACTED] root_folder_id = 0AO9MZRXNwt_jUk9PVA [crypt_gdrive] type = crypt remote = gdrive:crypt filename_encryption = standard password = [REDACTED] password2 = [REDACTED]
sample log file, filenames have been changed to protect the innocent.
2021/06/08 18:29:42 INFO : dir1/1998/file1.txt: Moved (server-side) to: dir1/1998/file1/file1.txt 2021/06/08 18:29:42 INFO : dir1/1998/file1.txt: vfs cache: renamed in cache to "dir1/1998/file1/file1.txt" 2021/06/08 18:29:43 INFO : dir1/1998/file2.txt: Moved (server-side) to: dir1/1998/file2/file2.txt 2021/06/08 18:29:43 INFO : dir1/1998/file2.txt: vfs cache: renamed in cache to "dir1/1998/file2/file2.txt" 2021/06/08 18:29:44 INFO : dir1/1998/file3.txt: Moved (server-side) to: dir1/1998/file3/file3.txt 2021/06/08 18:29:44 INFO : dir1/1998/file3.txt: vfs cache: renamed in cache to "dir1/1998/file3/file3.txt" 2021/06/08 18:30:30 INFO : vfs cache: cleaned: objects 7716 (was 7716) in use 0, to upload 0, uploading 0, total size 48.707G (was 48.707G)