"corrupted on transfer: sizes differ" for rclonelink in GDrive

What is the problem you are having with rclone?

Hi guys,
I'm having a problem syncing local folder to Google Drive containing (a lot of) symlink. I got a lot of "corrupted on transfer: sizes differ" and no .rclonelink file are created in GDrive. Do you know why?
Thanks,
Domi

What is your rclone version (output from rclone version)

rclone v1.53.1
- os/arch: windows/amd64
- go version: go1.15

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Windows 10, 64 bit

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync [LOCAL_FOLDER] gdrive:[TARGET_FOLDER] -l

The rclone config contents with secrets removed.

[gdrive]
type = drive
client_id = XXX
client_secret = XXX
scope = drive
root_folder_id = XXX
token = {"access_token":"XXX","expiry":"XXX"}

A log from the command with the -vv flag

2020/10/09 18:04:56 DEBUG : rclone: Version "v1.53.1" starting with parameters ["XXXXXXX\\Documents\\Codice\\rclone\\rclone.exe" "sync" "../professioniR/" "gdrive:professioniR" "-lvv"]
2020/10/09 18:04:56 DEBUG : Creating backend with remote "../professioniR/"
2020/10/09 18:04:56 DEBUG : Using config file from "XXXXXXX\\.config\\rclone\\rclone.conf"
2020/10/09 18:04:56 DEBUG : fs cache: renaming cache item "../professioniR/" to be canonical "//?/C:/Users/scido/Documents/Codice/professioniR"
2020/10/09 18:04:56 DEBUG : Creating backend with remote "gdrive:professioniR"
[CUT]
2020/10/09 18:05:02 ERROR : renv/library/R-3.5/x86_64-w64-mingw32/R6.rclonelink: corrupted on transfer: sizes differ 0 vs 112
2020/10/09 18:05:02 INFO  : renv/library/R-3.5/x86_64-w64-mingw32/R6.rclonelink: Removing failed copy
2020/10/09 18:05:02 ERROR : renv/library/R-3.5/x86_64-w64-mingw32/RColorBrewer.rclonelink: corrupted on transfer: sizes differ 0 vs 132
2020/10/09 18:05:02 INFO  : renv/library/R-3.5/x86_64-w64-mingw32/RColorBrewer.rclonelink: Removing failed copy
2020/10/09 18:05:02 ERROR : renv/library/R-3.5/x86_64-w64-mingw32/BH.rclonelink: corrupted on transfer: sizes differ 0 vs 115
2020/10/09 18:05:02 INFO  : renv/library/R-3.5/x86_64-w64-mingw32/BH.rclonelink: Removing failed copy
2020/10/09 18:05:03 DEBUG : renv/library/R-3.5/x86_64-w64-mingw32/renv/help/figures/logo.svg: Size and modification time the same (differ by -184.5µs, within tolerance 1ms)
2020/10/09 18:05:03 DEBUG : renv/library/R-3.5/x86_64-w64-mingw32/renv/help/figures/logo.svg: Unchanged skipping
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/u/FB36617C: Size and modification time the same (differ by -551.4µs, within tolerance 1ms)
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/u/FB36617C: Unchanged skipping
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/u/FB36617C-contents: Size and modification time the same (differ by -551µs, within tolerance 1ms)
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/u/FB36617C-contents: Unchanged skipping
2020/10/09 18:05:03 DEBUG : renv/library/R-3.5/x86_64-w64-mingw32/renv/resources/WELCOME: Size and modification time the same (differ by -361.3µs, within tolerance 1ms)
2020/10/09 18:05:03 DEBUG : renv/library/R-3.5/x86_64-w64-mingw32/renv/resources/WELCOME: Unchanged skipping
2020/10/09 18:05:03 DEBUG : renv/library/R-3.5/x86_64-w64-mingw32/renv/resources/activate.R: Size and modification time the same (differ by -367.7µs, within tolerance 1ms)
2020/10/09 18:05:03 DEBUG : renv/library/R-3.5/x86_64-w64-mingw32/renv/resources/activate.R: Unchanged skipping
2020/10/09 18:05:03 DEBUG : renv/library/R-3.5/x86_64-w64-mingw32/renv/resources/scripts-git-askpass.sh: Size and modification time the same (differ by -366.4µs, within tolerance 1ms)
2020/10/09 18:05:03 DEBUG : renv/library/R-3.5/x86_64-w64-mingw32/renv/resources/scripts-git-askpass.sh: Unchanged skipping
2020/10/09 18:05:03 DEBUG : renv/library/R-3.5/x86_64-w64-mingw32/renv/resources/scripts-repos-cache.R: Size and modification time the same (differ by -361.7µs, within tolerance 1ms)
2020/10/09 18:05:03 DEBUG : renv/library/R-3.5/x86_64-w64-mingw32/renv/resources/scripts-repos-cache.R: Unchanged skipping
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/465E1BB5: Size and modification time the same (differ by -552µs, within tolerance 1ms)
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/465E1BB5: Unchanged skipping
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/C9B6809F: Size and modification time the same (differ by -549µs, within tolerance 1ms)
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/D6850A36: Size and modification time the same (differ by -551.1µs, within tolerance 1ms)
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/C9B6809F: Unchanged skipping
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/7839E1ED: Size and modification time the same (differ by -554.5µs, within tolerance 1ms)
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/7839E1ED: Unchanged skipping
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/C7883CBE: Size and modification time the same (differ by -552.6µs, within tolerance 1ms)
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/C7883CBE: Unchanged skipping
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/C7883CBE-contents: Size and modification time the same (differ by -559.5µs, within tolerance 1ms)
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/C7883CBE-contents: Unchanged skipping
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/C9B6809F-contents: Size and modification time the same (differ by -550.9µs, within tolerance 1ms)
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/C9B6809F-contents: Unchanged skipping
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/465E1BB5-contents: Size and modification time the same (differ by -568.1µs, within tolerance 1ms)
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/465E1BB5-contents: Unchanged skipping
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/7839E1ED-contents: Size and modification time the same (differ by -571.3µs, within tolerance 1ms)
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/7839E1ED-contents: Unchanged skipping
2020/10/09 18:05:03 DEBUG : Google drive root 'professioniR': Waiting for checks to finish
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/D6850A36: Unchanged skipping
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/D6850A36-contents: Size and modification time the same (differ by -550.6µs, within tolerance 1ms)
2020/10/09 18:05:03 DEBUG : .Rproj.user/3D59072B/sources/per/t/D6850A36-contents: Unchanged skipping
2020/10/09 18:05:03 DEBUG : Google drive root 'professioniR': Waiting for transfers to finish
2020/10/09 18:05:04 ERROR : renv/library/R-3.5/x86_64-w64-mingw32/DBI.rclonelink: corrupted on transfer: sizes differ 0 vs 114
2020/10/09 18:05:04 INFO  : renv/library/R-3.5/x86_64-w64-mingw32/DBI.rclonelink: Removing failed copy
2020/10/09 18:05:04 ERROR : renv/library/R-3.5/x86_64-w64-mingw32/Rcpp.rclonelink: corrupted on transfer: sizes differ 0 vs 116
2020/10/09 18:05:04 INFO  : renv/library/R-3.5/x86_64-w64-mingw32/Rcpp.rclonelink: Removing failed copy
2020/10/09 18:05:05 ERROR : renv/library/R-3.5/x86_64-w64-mingw32/askpass.rclonelink: corrupted on transfer: sizes differ 0 vs 120
2020/10/09 18:05:05 INFO  : renv/library/R-3.5/x86_64-w64-mingw32/askpass.rclonelink: Removing failed copy
2020/10/09 18:05:05 ERROR : renv/library/R-3.5/x86_64-w64-mingw32/assertthat.rclonelink: corrupted on transfer: sizes differ 0 vs 128
2020/10/09 18:05:05 INFO  : renv/library/R-3.5/x86_64-w64-mingw32/assertthat.rclonelink: Removing failed copy
2020/10/09 18:05:06 ERROR : renv/library/R-3.5/x86_64-w64-mingw32/backports.rclonelink: corrupted on transfer: sizes differ 0 vs 127
2020/10/09 18:05:06 INFO  : renv/library/R-3.5/x86_64-w64-mingw32/backports.rclonelink: Removing failed copy

I think I've fixed this bug already...

Try the release candidate for 1.53.2

Hi Nick,
thank you for your reply. I'm sorry but with the RC version I get the same error.
Please let me know if you need more information.
Thanks,
Domi

Sorry, I didn't merge the fix for this yet...

Can you try this and let me know how it goes?

v1.54.0-beta.4817.cc17cbf03.fix-4581-win-links on branch fix-4581-win-links (uploaded in 15-30 mins)

Hi Nick,
I can't find the build for windows. Will it be available in the next hours?
I can confirm it's a bug in Windows build, in Linux 1.53.1 versione works flawlessly.
Thanks,
Domi

Sorry the windows version didn't build due to a bug in the unit tests. I've fixed that now, can you try this?

v1.54.0-beta.4817.c4bf83335.fix-4581-win-links on branch fix-4581-win-links (uploaded in 15-30 mins)

It works!
Thank you,
Domi

Thanks for testing

I've merged this to master now which means it will be in the latest beta in 15-30 mins and released in v1.53.2

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.