Hi, I’m the author of https://natalian.org/2018/01/27/S3_versus_Spaces/ and I’m simply trying to mirror my authoratative S3 bucket to Digital Ocean’s “Space” with
rclone sync --fast-list -v s3:s.natalian.org spaces:natalian.
It’s never completed without error. After an hour it usually exits like so:
2018/02/28 14:50:29 INFO : S3 bucket natalian: Waiting for checks to finish
2018/02/28 14:50:30 INFO : S3 bucket natalian: Waiting for transfers to finish
2018/02/28 14:50:30 ERROR : S3 bucket natalian: not deleting files as there were IO errors
2018/02/28 14:50:30 ERROR : S3 bucket natalian: not deleting directories as there were IO errors
2018/02/28 14:50:30 ERROR : Attempt 3/3 failed with 1 errors and: corrupted on transfer: sizes differ 361475 vs 5487094
2018/02/28 14:50:30 Failed to sync: corrupted on transfer: sizes differ 361475 vs 5487094
Any ideas how to proceed? I’ve retried the command about 10 times over the space of two weeks. I don’t have a good idea if it’s working through the issues.
I’m an Archlinux user.
- os/arch: linux/amd64
- go version: go1.9.2
Once the mirror is complete, I will hopefully setup a service to run rclone based on a YYYY-MM prefix every day, to make sure the mirror is good.
Since I’m having so much difficulty mirroring my data, I’m wondering how other businesses backup their data amongst cloud services !!