It’s never completed without error. After an hour it usually exits like so:
2018/02/28 14:50:29 INFO : S3 bucket natalian: Waiting for checks to finish
2018/02/28 14:50:30 INFO : S3 bucket natalian: Waiting for transfers to finish
2018/02/28 14:50:30 ERROR : S3 bucket natalian: not deleting files as there were IO errors
2018/02/28 14:50:30 ERROR : S3 bucket natalian: not deleting directories as there were IO errors
2018/02/28 14:50:30 ERROR : Attempt 3/3 failed with 1 errors and: corrupted on transfer: sizes differ 361475 vs 5487094
2018/02/28 14:50:30 Failed to sync: corrupted on transfer: sizes differ 361475 vs 5487094
Any ideas how to proceed? I’ve retried the command about 10 times over the space of two weeks. I don’t have a good idea if it’s working through the issues.
I’m an Archlinux user.
- os/arch: linux/amd64
- go version: go1.9.2
Once the mirror is complete, I will hopefully setup a service to run rclone based on a YYYY-MM prefix every day, to make sure the mirror is good.
Since I’m having so much difficulty mirroring my data, I’m wondering how other businesses backup their data amongst cloud services !!
I was trying to replicate this problem to report it to digital ocean but I couldn’t… What is in that 2013-07-30/encode.log.gz file? Any chance you could email it to me at firstname.lastname@example.org so I can experiment further?