Many errors when syncing to ACD

Hello everyone,

I am using rclone to sync a large number of medium-sized files (4-8 GB) to my amazon cloud drive and encrypt them on the fly. Basically it works, but I get a lot of errors and sometimes file uploads restart without the error count being increased. My hardware and connection should be sufficiently stable and powerful.
I know this is mosty a problem on amazon’s side of things, but I still have a few questions: What exactly are Errors. Why didn’t the error count increase when it restarted the upload? Are there ways to reduce error rates (I already reduced the number of parallel transfers from 4 to 2)?

What my rclone spits out:

2017/04/05 16:30:17 
Transferred:   214.833 GBytes (601.098 kBytes/s)
Errors:                38
Checks:                19
Transferred:           11
Elapsed time:  104h6m1.4s
Transferring:
 * file-a: 55% done, 291.229 kBytes/s, ETA: 3h33m6s
 * file-b: 52% done, 245.479 kBytes/s, ETA: 4h26m29s

2017/04/05 16:31:17 
Transferred:   214.864 GBytes (601.089 kBytes/s)
Errors:                38
Checks:                19
Transferred:           11
Elapsed time:  104h7m1.4s
Transferring:
 * file-a: 55% done, 286.446 kBytes/s, ETA: 3h35m41s
 * file-b: 53% done, 277.797 kBytes/s, ETA: 3h54m30s

2017/04/05 16:32:17 
Transferred:   214.896 GBytes (601.082 kBytes/s)
Errors:                38
Checks:                19
Transferred:           11
Elapsed time:  104h8m1.4s
Transferring:
 * file-a: 55% done, 297.455 kBytes/s, ETA: 3h26m40s
 * file-b: 53% done, 262.249 kBytes/s, ETA: 4h7m27s

2017/04/05 16:33:17 
Transferred:   214.930 GBytes (601.081 kBytes/s)
Errors:                38
Checks:                19
Transferred:           11
Elapsed time:  104h9m1.4s
Transferring:
 * file-a: 55% done, 316.752 kBytes/s, ETA: 3h13m7s
 * file-b: 53% done, 293.799 kBytes/s, ETA: 3h39m54s

2017/04/05 16:34:17 
2017/04/05 18:39:17
Transferred:   219.143 GBytes (600.750 kBytes/s)
Errors:                38
Checks:                19
Transferred:           11
Elapsed time:  106h15m1.4s
Transferring:
 * file-a: 82% done, 298.360 kBytes/s, ETA: 1h20m56s
 * file-b:  0% done, 316.501 kBytes/s, ETA: 7h14m22s

2017/04/05 18:40:17
Transferred:   219.178 GBytes (600.752 kBytes/s)
Errors:                38
Checks:                19
Transferred:           11
Elapsed time:  106h16m1.4s
Transferring:
 * file-a: 82% done, 293.366 kBytes/s, ETA: 1h21m18s
 * file-b:  1% done, 317.735 kBytes/s, ETA: 7h11m41s

2017/04/05 18:41:17
Transferred:   219.213 GBytes (600.754 kBytes/s)
Errors:                38
Checks:                19
Transferred:           11
Elapsed time:  106h17m1.4s
Transferring:
 * file-a: 83% done, 302.254 kBytes/s, ETA: 1h17m56s
 * file-b:  1% done, 312.158 kBytes/s, ETA: 7h18m23s

Errors are when rclone gave up transferring a file.

On a retry the errors are cleared - the idea is that if the sync is successful the errors will be 0.

That I don’t know, alas :frowning:

1 Like