Copy from Dropbox to Google Drive yields "Failed to copy: failed to open source object:", "server closed idle connection" error


#1

I am trying to copy files from dropbox to google drive. Most of the files go through alright, but a few have the following:

2018/11/05 04:11:09 ERROR : Folder1/to_gdrive.mkv: Failed to copy: failed to open source object: Post https://content.dropboxapi.com/2/files/download: http: server closed idle connection

Does anyone know what this means? Is it a rate limiting error?


#2

Hmm, I haven’t seen that before. rclone (the go runtime) keeps idle http connections for re-use. It looks like that when rclone comes to use it, it gets an error http: server closed idle connection

This seems to be related to this go issue:

What I should probably do is make that error a retriable error then the problem will disappear.

Here is a beta with that fix in

https://beta.rclone.org/branch/v1.44-037-g4f1d2094-fix-closed-idle-conn-beta/ (uploaded in 15-30 mins)

Can you give it a go please?


#3

Hi,

I gave it a go and the error “Failed to open source…” went away. HOWEVER, a

“Failed to copy: failed to open source object: unexpected end of JSON input”

Error appeared about 50 times, which didn’t happen before. Is there something I am doing wrong? Also, what would be the best way to remedy the failed to copy instances? Would sync work well?


#4

Thanks for testing. I’ve merged that fix into the latest beta now (uploaded in 15-30 mins).

No, that looks like another networking related error…

Just run the copy command again and it will pick up any missing bits.


#5

The connection dropped during transfer (I am on a server with time limits that I forgot to remove) and a ton of files didn’t go through. In general, would it be better to use copy or sync in this case with regards to completeness and speed?


#6

They both will perform the same in that regard. Re-running the command should work fine.