Hi, I’m the author of https://natalian.org/2018/01/27/S3_versus_Spaces/ and I’m simply trying to mirror my authoratative S3 bucket to Digital Ocean’s “Space” with
rclone sync --fast-list -v s3:s.natalian.org spaces:natalian.
It’s never completed without error. After an hour it usually exits like so:
2018/02/28 14:50:29 INFO : S3 bucket natalian: Waiting for checks to finish 2018/02/28 14:50:30 INFO : S3 bucket natalian: Waiting for transfers to finish 2018/02/28 14:50:30 ERROR : S3 bucket natalian: not deleting files as there were IO errors 2018/02/28 14:50:30 ERROR : S3 bucket natalian: not deleting directories as there were IO errors 2018/02/28 14:50:30 ERROR : Attempt 3/3 failed with 1 errors and: corrupted on transfer: sizes differ 361475 vs 5487094 2018/02/28 14:50:30 Failed to sync: corrupted on transfer: sizes differ 361475 vs 5487094
Any ideas how to proceed? I’ve retried the command about 10 times over the space of two weeks. I don’t have a good idea if it’s working through the issues.
I’m an Archlinux user.
rclone v1.39 - os/arch: linux/amd64 - go version: go1.9.2
Once the mirror is complete, I will hopefully setup a service to run rclone based on a YYYY-MM prefix every day, to make sure the mirror is good.
Since I’m having so much difficulty mirroring my data, I’m wondering how other businesses backup their data amongst cloud services !!