Good day!
I did have 12 errors during sync. And after finished rclone retried the whole sync due to these 12 errors. But it didn’t retried any of these files before.
How do I tell rclone to retry to sync erorred files immediately?
Thanks.
I’m pretty sure it retries 10 times before it fails. Do you have a log with the issue you are referring to?
@Animosity022, maybe my options?
Fortunately yes 
With DEBUG level!
$ grep -E -v '(skipping|identical|Copied)' sync.log
2018/10/22 22:08:41 DEBUG : rclone: Version "v1.43.1" starting with parameters ["rclone" "--checkers=8" "--checksum" "--exclude-from=/home/sasha/yandex-photoes-exclude.txt" "--log-file=/home/sasha/sync.log" "--log-level=DEBUG" "--no-update-modtime" "--one-file-system" "--stats=0" "--track-renames" "--transfers=32" "sync" "PHOTOES" "yandex:backups.new/PHOTOES"]
2018/10/22 22:08:41 DEBUG : Using config file from "/home/sasha/.config/rclone/rclone.conf"
2018/10/22 22:08:41 ERROR : Yandex backups.new/PHOTOES: Ignoring --track-renames as the destination does not support server-side move or copy
2018/10/22 22:08:41 DEBUG : Фото деловые: Excluded from sync (and deletion)
2018/10/22 22:17:50 ERROR : 2018/2018-01-03..13 Приезд Кати [Катя]/VID_20180113_115144.3gp: Failed to copy: [500 - InternalServerError] Internal Server Error (Ошибка сервера.)
2018/10/22 22:26:22 ERROR : 2011/2011-12-28 Школа Миши/img397.jpg: Failed to copy: [500 - InternalServerError] Internal Server Error (Ошибка сервера.)
2018/10/22 22:36:29 ERROR : 2018/2018-03-30..04-09 Италия [Катя]/DCIM/P80405-142748.jpg: Failed to copy: [500 - InternalServerError] Internal Server Error (Ошибка сервера.)
2018/10/22 23:25:00 ERROR : Школа 882/014 сборы19.05.08/P1030378.JPG: Failed to copy: [500 - InternalServerError] Internal Server Error (Ошибка сервера.)
2018/10/22 23:36:38 ERROR : 2018/2018-08-16..24 Турция/IMG_1172.JPG: Failed to copy: [404 - DiskNotFoundError] Resource not found. (Не удалось найти запрошенный ресурс.)
2018/10/22 23:40:09 ERROR : 2018/2018-08-16..24 Турция/IMG_1190.MOV: Failed to copy: [404 - DiskNotFoundError] Resource not found. (Не удалось найти запрошенный ресурс.)
2018/10/23 00:01:39 INFO : Yandex backups.new/PHOTOES: Waiting for checks to finish
2018/10/23 00:01:39 INFO : Yandex backups.new/PHOTOES: Waiting for transfers to finish
2018/10/23 00:12:56 ERROR : 2015/2015-12-27 Белочка в Парке Победы/DSCN0361.JPG: Failed to copy: [500 - InternalServerError] Internal Server Error (Ошибка сервера.)
2018/10/23 00:12:56 ERROR : 2008/2008-08-02..16 Поход в Архангельск (Люба, Миша)/S7301663.JPG: Failed to copy: [500 - InternalServerError] Internal Server Error (Ошибка сервера.)
2018/10/23 00:19:41 ERROR : 2009/2009-08-22 Макс 2009/IMG_1433.jpg: Failed to copy: [500 - InternalServerError] Internal Server Error (Ошибка сервера.)
2018/10/23 00:29:37 ERROR : 2007/2007-09-30..10-04 Сочи/IMG_0683.jpg: Failed to copy: [500 - InternalServerError] Internal Server Error (Ошибка сервера.)
2018/10/23 00:29:38 ERROR : Школа 882/029 день здоровья 21.02.09/DSC01098.JPG: Failed to copy: [500 - InternalServerError] Internal Server Error (Ошибка сервера.)
2018/10/23 00:46:19 ERROR : 2007/2007-06-18..07-13 Одесса [Саша]/ХАДЖИБЕЙ/S7301775.JPG: Failed to copy: [500 - InternalServerError] Internal Server Error (Ошибка сервера.)
2018/10/23 01:06:29 DEBUG : Yandex backups.new/PHOTOES: failed to copy 12 directories
2018/10/23 01:06:29 DEBUG : Yandex backups.new/PHOTOES: copied 1 directories
2018/10/23 01:06:29 ERROR : Yandex backups.new/PHOTOES: not deleting files as there were IO errors
2018/10/23 01:06:29 ERROR : Yandex backups.new/PHOTOES: not deleting directories as there were IO errors
2018/10/23 01:06:29 ERROR : Attempt 1/3 failed with 12 errors and: [500 - InternalServerError] Internal Server Error (Ошибка сервера.)
2018/10/23 01:06:29 ERROR : Yandex backups.new/PHOTOES: Ignoring --track-renames as the destination does not support server-side move or copy
2018/10/23 01:06:29 DEBUG : Фото деловые: Excluded from sync (and deletion)
2018/10/23 02:05:49 INFO : Yandex backups.new/PHOTOES: Waiting for checks to finish
2018/10/23 02:47:37 INFO : Yandex backups.new/PHOTOES: Waiting for transfers to finish
2018/10/23 02:47:37 DEBUG : Yandex backups.new/PHOTOES: copied 1 directories
2018/10/23 02:47:37 INFO : Waiting for deletions to finish
2018/10/23 02:47:37 ERROR : Attempt 2/3 succeeded
2018/10/23 02:47:37 DEBUG : 1221 go routines active
2018/10/23 02:47:37 DEBUG : rclone: Version "v1.43.1" finishing with parameters ["rclone" "--checkers=8" "--checksum" "--exclude-from=/home/sasha/yandex-photoes-exclude.txt" "--log-file=/home/sasha/sync.log" "--log-level=DEBUG" "--no-update-modtime" "--one-file-system" "--stats=0" "--track-renames" "--transfers=32" "sync" "PHOTOES" "yandex:backups.new/PHOTOES"]
Let’s track one file:
$ grep 'VID_20180113_115144.3gp' sync.log
2018/10/22 22:17:50 ERROR : 2018/2018-01-03..13 Приезд Кати [Катя]/VID_20180113_115144.3gp: Failed to copy: [500 - InternalServerError] Internal Server Error (Ошибка сервера.)
2018/10/23 01:14:55 DEBUG : 2018/2018-01-03..13 Приезд Кати [Катя]/VID_20180113_115144.3gp: Size and MD5 of src and dst objects identical
2018/10/23 01:14:55 DEBUG : 2018/2018-01-03..13 Приезд Кати [Катя]/VID_20180113_115144.3gp: Unchanged skipping
P.S.
I remember it was several month ago. So, maybe bad options
I’d grab the later version as it looks like you are using a version behind.
Those errors look to be specific to that backend and are 500s which don’t seem to retry. I’d retry with the latest version and open an issue on github for it.
The feature you are looking for is called --low-level-retries. However Yandex doesn’t support these yet.
Fortunately the Yandex backend is being re-written as we speak so hopefully it will gain that soon!
Meanwhile, rclone will clean up by doing a retry of the whole sync as you’ve seen.