Corrupted on transfer: MD5 hash differ (AWS S3)

Hi Guys, now I'm having the problem in the opposite direction, remote to PC.

Config is still:

type = s3
provider = AWS
env_auth = true
region = us-east-2
upload_cutoff = 0
access_key_id = 
secret_access_key = /

I also tried adding copy_cutoff = 0 but that didn't do anything.
Of course adding --ignore-checksum masks this issue.

C:\Users\me>rclone copy my-remote:my-bucket/code/common-git-commands C:\Users\me\Downloads\common-git-commands -vv
2020/09/05 05:32:51 DEBUG : rclone: Version "v1.53.0" starting with parameters ["rclone" "copy" "my-remote:my-bucket/code/common-git-commands" "C:\\Users\\me\\Downloads\\common-git-commands" "-vv"]
2020/09/05 05:32:51 DEBUG : Using RCLONE_CONFIG_PASS password.
2020/09/05 05:32:51 DEBUG : Using config file from "c:\\rclone\\rclone.conf"
2020/09/05 05:32:51 DEBUG : Creating backend with remote "my-remote:my-bucket/code/common-git-commands"
2020/09/05 05:32:51 DEBUG : Creating backend with remote "C:\\Users\\me\\Downloads\\common-git-commands"
2020/09/05 05:32:51 DEBUG : fs cache: renaming cache item "C:\\Users\\me\\Downloads\\common-git-commands" to be canonical "//?/C:/Users/me/Downloads/common-git-commands"
2020/09/05 05:32:51 DEBUG : Local file system at //?/C:/Users/me/Downloads/common-git-commands: Waiting for checks to finish
2020/09/05 05:32:51 DEBUG : Local file system at //?/C:/Users/me/Downloads/common-git-commands: Waiting for transfers to finish
2020/09/05 05:32:51 DEBUG : SWTM-2088_Atlassian-Git-Cheatsheet.pdf: MD5 = d614e6329f8f0e40db117bea591f6db5 (S3 bucket my-bucket path code/common-git-commands)
2020/09/05 05:32:51 DEBUG : SWTM-2088_Atlassian-Git-Cheatsheet.pdf: MD5 = 11533f634f23869bdded63e80c897073 (Local file system at //?/C:/Users/me/Downloads/common-git-commands)
2020/09/05 05:32:51 ERROR : SWTM-2088_Atlassian-Git-Cheatsheet.pdf: corrupted on transfer: MD5 hash differ "d614e6329f8f0e40db117bea591f6db5" vs "11533f634f23869bdded63e80c897073"
2020/09/05 05:32:51 INFO  : SWTM-2088_Atlassian-Git-Cheatsheet.pdf: Removing failed copy
2020/09/05 05:32:51 DEBUG : common-commands.txt: MD5 = 2df9564ff76d6c9d90fd662b95340758 (S3 bucket my-bucket path code/common-git-commands)
2020/09/05 05:32:51 DEBUG : common-commands.txt: MD5 = 1e2d761dfd15454304231da1ca7102e6 (Local file system at //?/C:/Users/me/Downloads/common-git-commands)
2020/09/05 05:32:51 ERROR : common-commands.txt: corrupted on transfer: MD5 hash differ "2df9564ff76d6c9d90fd662b95340758" vs "1e2d761dfd15454304231da1ca7102e6"
2020/09/05 05:32:51 INFO  : common-commands.txt: Removing failed copy
2020/09/05 05:32:51 INFO  : There was nothing to transfer
2020/09/05 05:32:51 ERROR : Attempt 1/3 failed with 2 errors and: corrupted on transfer: MD5 hash differ "2df9564ff76d6c9d90fd662b95340758" vs "1e2d761dfd15454304231da1ca7102e6"
2020/09/05 05:32:51 DEBUG : Local file system at //?/C:/Users/me/Downloads/common-git-commands: Waiting for checks to finish
2020/09/05 05:32:51 DEBUG : Local file system at //?/C:/Users/me/Downloads/common-git-commands: Waiting for transfers to finish
2020/09/05 05:32:52 DEBUG : common-commands.txt: MD5 = 2df9564ff76d6c9d90fd662b95340758 (S3 bucket my-bucket path code/common-git-commands)
2020/09/05 05:32:52 DEBUG : common-commands.txt: MD5 = 1e2d761dfd15454304231da1ca7102e6 (Local file system at //?/C:/Users/me/Downloads/common-git-commands)
2020/09/05 05:32:52 ERROR : common-commands.txt: corrupted on transfer: MD5 hash differ "2df9564ff76d6c9d90fd662b95340758" vs "1e2d761dfd15454304231da1ca7102e6"
2020/09/05 05:32:52 INFO  : common-commands.txt: Removing failed copy
2020/09/05 05:32:52 DEBUG : SWTM-2088_Atlassian-Git-Cheatsheet.pdf: MD5 = d614e6329f8f0e40db117bea591f6db5 (S3 bucket my-bucket path code/common-git-commands)
2020/09/05 05:32:52 DEBUG : SWTM-2088_Atlassian-Git-Cheatsheet.pdf: MD5 = 11533f634f23869bdded63e80c897073 (Local file system at //?/C:/Users/me/Downloads/common-git-commands)
2020/09/05 05:32:52 ERROR : SWTM-2088_Atlassian-Git-Cheatsheet.pdf: corrupted on transfer: MD5 hash differ "d614e6329f8f0e40db117bea591f6db5" vs "11533f634f23869bdded63e80c897073"
2020/09/05 05:32:52 INFO  : SWTM-2088_Atlassian-Git-Cheatsheet.pdf: Removing failed copy
2020/09/05 05:32:52 INFO  : There was nothing to transfer
2020/09/05 05:32:52 ERROR : Attempt 2/3 failed with 2 errors and: corrupted on transfer: MD5 hash differ "d614e6329f8f0e40db117bea591f6db5" vs "11533f634f23869bdded63e80c897073"
2020/09/05 05:32:52 DEBUG : Local file system at //?/C:/Users/me/Downloads/common-git-commands: Waiting for checks to finish
2020/09/05 05:32:52 DEBUG : Local file system at //?/C:/Users/me/Downloads/common-git-commands: Waiting for transfers to finish
2020/09/05 05:32:52 DEBUG : common-commands.txt: MD5 = 2df9564ff76d6c9d90fd662b95340758 (S3 bucket my-bucket path code/common-git-commands)
2020/09/05 05:32:52 DEBUG : common-commands.txt: MD5 = 1e2d761dfd15454304231da1ca7102e6 (Local file system at //?/C:/Users/me/Downloads/common-git-commands)
2020/09/05 05:32:52 ERROR : common-commands.txt: corrupted on transfer: MD5 hash differ "2df9564ff76d6c9d90fd662b95340758" vs "1e2d761dfd15454304231da1ca7102e6"
2020/09/05 05:32:52 INFO  : common-commands.txt: Removing failed copy
2020/09/05 05:32:52 DEBUG : SWTM-2088_Atlassian-Git-Cheatsheet.pdf: MD5 = d614e6329f8f0e40db117bea591f6db5 (S3 bucket my-bucket path code/common-git-commands)
2020/09/05 05:32:52 DEBUG : SWTM-2088_Atlassian-Git-Cheatsheet.pdf: MD5 = 11533f634f23869bdded63e80c897073 (Local file system at //?/C:/Users/me/Downloads/common-git-commands)
2020/09/05 05:32:52 ERROR : SWTM-2088_Atlassian-Git-Cheatsheet.pdf: corrupted on transfer: MD5 hash differ "d614e6329f8f0e40db117bea591f6db5" vs "11533f634f23869bdded63e80c897073"
2020/09/05 05:32:52 INFO  : SWTM-2088_Atlassian-Git-Cheatsheet.pdf: Removing failed copy
2020/09/05 05:32:52 INFO  : There was nothing to transfer
2020/09/05 05:32:52 ERROR : Attempt 3/3 failed with 2 errors and: corrupted on transfer: MD5 hash differ "d614e6329f8f0e40db117bea591f6db5" vs "11533f634f23869bdded63e80c897073"
2020/09/05 05:32:52 INFO  :
Transferred:      210.302k / 210.302 kBytes, 100%, 230.619 kBytes/s, ETA 0s
Errors:                 2 (retrying may help)
Elapsed time:         1.5s

2020/09/05 05:32:52 DEBUG : 6 go routines active
2020/09/05 05:32:52 Failed to copy with 2 errors: last error was: corrupted on transfer: MD5 hash differ "d614e6329f8f0e40db117bea591f6db5" vs "11533f634f23869bdded63e80c897073"

I'll have a play with this next week. Thanks for the Kms guide. I'll post updates here.

1 Like

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.