Rclone check and errors in log file

What is the problem you are having with rclone?

i love rlcone and rclone likes me. it is still early in our relationship, i first meet rlcone at 1.47...

i do not understand the log output for rclone --check as per the log, see below
there are two files in the local folder 1.txt and 2.txt.
yet somehow there are 4 differences found and 5 errors.
what are the 4 differences for only 2 files?
what are the 5 errors?

thanks much,
david

What is your rclone version (output from rclone version)

Version "v1.49.1

Which OS you are using and how many bits (eg Windows 7, 64 bit)

W10.64bit

Which cloud storage system are you using? (eg Google Drive)

wasabi

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone: Version "v1.49.1" starting with parameters ["rclone.exe" "check" "b:\one\data\rclone\source\one" "wasabi01:en07.one\backup\" "--log-level" "DEBUG" "--log-file=C:\data\rclone\logs\one\20190830_163039\one_20190830_163039_rclone.log"]

A log from the command with the -vv flag (eg output from rclone -vv copy /tmp remote:tmp)

2019/08/30 16:30:40 DEBUG : rclone: Version "v1.49.1" starting with parameters ["rclone.exe" "check" "b:\one\data\rclone\source\one" "wasabi01:en07.one\backup\" "--log-level" "DEBUG" "--log-file=C:\data\rclone\logs\one\20190830_163039\one_20190830_163039_rclone.log"]
2019/08/30 16:30:40 DEBUG : Using RCLONE_CONFIG_PASS password.
2019/08/30 16:30:40 DEBUG : Using config file from "C:\data\rclone\scripts\rclone.conf"
2019/08/30 16:30:41 INFO : S3 bucket en07.one path backup: Waiting for checks to finish
2019/08/30 16:30:41 ERROR : 1.txt: Sizes differ
2019/08/30 16:30:41 ERROR : 2.txt: Sizes differ
2019/08/30 16:30:41 NOTICE: S3 bucket en07.one path backup: 4 differences found
2019/08/30 16:30:41 Failed to check with 5 errors: last error was: 2 differences found

Da fuck Rclone!? have you been cheating on me with this dude? I thought was we had was special! :broken_heart:
:smiley:

Difficult to say for sure without digging into the code, but here is my educated guess:

rclone either checks equality via comparing checksums OR size+modtime - depending on settings and if checksums are already availiable (such as on many cloud filesystems).

In local transfers it does not use checksums unless you force it with --checksum
so in this case it will use size + modtime.

If neither match on 2 files, that is 4 things that mismatched. Each one of those will be counted as an error I bet.
There is probably another error at the end because the entire check operation did not finish without errors, so that in itself would count as error #5.

hypothesis:
if you add 2 more test files that don't match in either size or modtime you should be getting 8 differences and 9 errors.

If you force --checksum to the above you should get 4 difference and 5 errors.
Easy enough to test I guess.

In short this looks pretty normal to me, but take what I said with a grain of salt and consider it an educated guess because it's hard to say anything like this with confidence without looking up the exact code - and I am way too tired to do that right now (but it's all on github if you want to check yourself of course).

thanks, and no, rclone is not cheating on you yet, cause tho i love rclone, it only likes me, for now...

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.