Copy from Dropbox to Google Drive yields "Failed to copy: failed to open source object:", "server closed idle connection" error

I am trying to copy files from dropbox to google drive. Most of the files go through alright, but a few have the following:

2018/11/05 04:11:09 ERROR : Folder1/to_gdrive.mkv: Failed to copy: failed to open source object: Post https://content.dropboxapi.com/2/files/download: http: server closed idle connection

Does anyone know what this means? Is it a rate limiting error?

Hmm, I haven’t seen that before. rclone (the go runtime) keeps idle http connections for re-use. It looks like that when rclone comes to use it, it gets an error http: server closed idle connection

This seems to be related to this go issue:

What I should probably do is make that error a retriable error then the problem will disappear.

Here is a beta with that fix in

https://beta.rclone.org/branch/v1.44-037-g4f1d2094-fix-closed-idle-conn-beta/ (uploaded in 15-30 mins)

Can you give it a go please?

Hi,

I gave it a go and the error “Failed to open source…” went away. HOWEVER, a

“Failed to copy: failed to open source object: unexpected end of JSON input”

Error appeared about 50 times, which didn’t happen before. Is there something I am doing wrong? Also, what would be the best way to remedy the failed to copy instances? Would sync work well?

Thanks for testing. I’ve merged that fix into the latest beta now (uploaded in 15-30 mins).

No, that looks like another networking related error…

Just run the copy command again and it will pick up any missing bits.

The connection dropped during transfer (I am on a server with time limits that I forgot to remove) and a ton of files didn’t go through. In general, would it be better to use copy or sync in this case with regards to completeness and speed?

They both will perform the same in that regard. Re-running the command should work fine.