I have been using Rclone with Linux successfully for a while, so I suggested my dad try it out to back up a 4TB drive on WIN. For some reason, in the midst of transfers, it will crash. Most of the time, I simply restart. Sometimes I have to delete the remote and add it again. However on the most recent folder “MUSIC” which has a large amount of audio and video files, it seems to keep crashing fatally…meaning I can’t close the command prompt and the whole system has to have a hard reboot. If I try and restart through the Start button, it hangs on the restarting page,
The most recent crash, I took a screen grab of the error message. Does anyone know what this is related to? Do I need to try syncing by subfolders instead (is the main folder too large)? Any advice would be appreciated.
My command line is simple -
rclone copy I:\MUSIC\ amazon:/4tbbackup/MUSIC/ -v
This last time, it ran for about an hour and then crashed…which seems to be consistent on this folder. I am wondering if it’s getting to the same point and crashing (the files are larger, so they may not be finishing and restarting?)
I have found out some more info - I took a screen grab of some sort of error that occurred, though Rclone still says “Errors 0”. It seemed like it reset the transfers of the files after a quick string of messages…so while the files were well on their way to being complete, they are now back at 0.
Is any of the info below a clue?
2016/11/17 15:58:20 OPERA - Audio and Video/Mozart/Mozart - Le Nozze di Figaro - Bohm 1976 Prey - Freni mkv/Le nozze di Figaro 2 of 2 - Mozart - Prey - Freni.mkv: Upload error detected but didn’t finish upload: HTTP code 504: “504 GATEWAY_TIMEOUT”, no response body
(“504 GATEWAY_TIMEOUT”)
2016/11/17 15:58:20 pacer: Rate limited, sleeping for 549.16732ms (1 consecutive low level retries)
2016/11/17 15:58:20 pacer: low level retry 1/1 (error HTTP code 504: “504 GATEWAY_TIMEOUT”, no response body
)
2016/11/17 15:58:20 OPERA - Audio and Video/Mozart/Mozart - Le Nozze di Figaro - Bohm 1976 Prey - Freni mkv/Le nozze di Figaro 1 of 2 - Mozart - Prey - Freni.mkv: Upload error detected but didn’t finish upload: HTTP code 504: “504 GATEWAY_TIMEOUT”, no response body
(“504 GATEWAY_TIMEOUT”)
2016/11/17 15:58:20 pacer: Rate limited, sleeping for 1.632969758s (2 consecutive low level retries)
2016/11/17 15:58:20 pacer: low level retry 1/1 (error HTTP code 504: “504 GATEWAY_TIMEOUT”, no response body
)
2016/11/17 15:58:20 ANDRE RIEU/Andre Rieu - The Flying Dutchman (2004) Kerkrade/VIDEO_TS/VTS_01_2.VOB: Upload error detected but didn’t finish upload: HTTP code 504: “504 GATEWAY_TIMEOUT”, no response body
(“504 GATEWAY_TIMEOUT”)
2016/11/17 15:58:20 pacer: Rate limited, sleeping for 1.331776148s (3 consecutive low level retries)
2016/11/17 15:58:20 pacer: low level retry 1/1 (error HTTP code 504: “504 GATEWAY_TIMEOUT”, no response body
)
2016/11/17 15:58:20 ANDRE RIEU/Andre Rieu - The Flying Dutchman (2004) Kerkrade/VIDEO_TS/VTS_01_2.VOB: Received error: HTTP code 504: “504 GATEWAY_TIMEOUT”, no response body
low level retry 1/10
2016/11/17 15:58:21 OPERA - Audio and Video/Mozart/Mozart - Le Nozze di Figaro - Bohm 1976 Prey - Freni mkv/Le nozze di Figaro 1 of 2 - Mozart - Prey - Freni.mkv: Received error: HTTP code 504: “504 GATEWAY_TIMEOUT”, no response body
low level retry 1/10
2016/11/17 15:58:21 pacer: Resetting sleep to minimum 20ms on success
2016/11/17 15:58:21 OPERA - Audio and Video/Mozart/Mozart - Le Nozze di Figaro - Bohm 1976 Prey - Freni mkv/Le nozze di Figaro 2 of 2 - Mozart - Prey - Freni.mkv: Received error: HTTP code 504: “504 GATEWAY_TIMEOUT”, no response body
Exceptions can also occur because of a full disk, an underlying device failure, or a memory allocation failure.
So maybe the disk is full or is dying: I suggest you look at the SMART stats on the disk and give the computer a general health check - maybe run memtest86 on it, or check the disks (which you could do with my stressdisk program.
If Go crashes it always produces a nice backtrace so that crash looks like something else at a lower level in the OS.
Thanks for the replies!
I was able to get the transfer to finish by pulling the files which kept failing out of their folders, finishing the large transfer, and then copying them back in and running Rclone again.
Strange!
