Rclone copy/sync issue

MLZC · March 23, 2019, 4:51pm

Thank you for reading my question.

I an using “rclone copy” to transfer shared folders to my google drive. But something went wrong.

code here

rclone copy -v mydrive:A mydrive:A
rclone sync mydrive:A mydrive:A

sync error code here

2019/03/22 19:39:16 ERROR : S H E-2gether 4ever Encore live concert in Taipei 2014 1080i BluRay REMUX AVC DTS -HD MA 5.1 -HDS/BDMV/STREAM/00000.m2ts: Failed to copy: googleapi: Error 500: Internal Error, internalError
2019/03/22 19:39:16 ERROR : Google drive root 'Media/Music': not deleting files as there were IO errors
2019/03/22 19:39:16 ERROR : Google drive root 'Media/Music': not deleting directories as there were IO errors
2019/03/22 19:39:16 ERROR : Attempt 1/3 failed with 1 errors and: googleapi: Error 500: Internal Error, internalError
2019/03/22 21:51:25 ERROR : S H E-2gether 4ever Encore live concert in Taipei 2014 1080i BluRay REMUX AVC DTS -HD MA 5.1 -HDS/BDMV/STREAM/00000.m2ts: Failed to copy: googleapi: Error 500: Internal Error, internalError
2019/03/22 21:51:25 ERROR : Google drive root 'Media/Music': not deleting files as there were IO errors
2019/03/22 21:51:25 ERROR : Google drive root 'Media/Music': not deleting directories as there were IO errors
2019/03/22 21:51:25 ERROR : Attempt 2/3 failed with 1 errors and: googleapi: Error 500: Internal Error, internalError
2019/03/23 00:09:55 ERROR : S H E-2gether 4ever Encore live concert in Taipei 2014 1080i BluRay REMUX AVC DTS -HD MA 5.1 -HDS/BDMV/STREAM/00000.m2ts: Failed to copy: googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded
2019/03/23 00:09:55 ERROR : Google drive root 'Media/Music': not deleting files as there were IO errors
2019/03/23 00:09:55 ERROR : Google drive root 'Media/Music': not deleting directories as there were IO errors
2019/03/23 00:09:55 ERROR : Attempt 3/3 failed with 1 errors and: googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded
2019/03/23 00:09:55 Failed to sync: googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded

copy error code here

2019/03/23 16:44:06 INFO  : 
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 0
Checks:              9219 / 9219, 100%
Transferred:            0 / 1, 0%
Elapsed time:    6h6m1.4s
Transferring:
 * 极客时间-已经完结的课程/11 大咖说/In…16期 续彬/InfoQ大咖说-续彬.m4v: transferring

2019/03/23 16:45:06 INFO  : 
Transferred:   	         0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors:                 0
Checks:              9219 / 9219, 100%
Transferred:            0 / 1, 0%
Elapsed time:    6h7m1.4s
Transferring:
 * 极客时间-已经完结的课程/11 大咖说/In…16期 续彬/InfoQ大咖说-续彬.m4v: transferring

This code block has been repeated all the time, but the file cannot be copied over.

Firstly, I am using a deep os with a memory size of 0.6g. And I added 2g of swap space.

Second, I have replaced default api by my own. And the upper limit of 750G is far from reaching.

Finally, I try to replace “rclone copy” with “rclone sync”,but the problem still exists.

I would like to know the reason for this problem and how to fix this problem.

ncw · March 25, 2019, 11:24am

That is an error from google.

If you run with -vv --dump bodies --retries 1 then it may show more information.

MLZC · March 25, 2019, 1:38pm

Thank for your replay, I try to run the follow code.

rclone copy -vv --dump bodies --retries 1 gdswccd:SHE gdswccd:test

2019/03/25 21:38:15 DEBUG : HTTP/1.1 500 Internal Server Error
Transfer-Encoding: chunked
Cache-Control: private, max-age=0
Content-Type: application/json; charset=UTF-8
Date: Mon, 25 Mar 2019 13:37:08 GMT
Expires: Mon, 25 Mar 2019 13:37:08 GMT
Server: GSE
Vary: Origin
Vary: X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 1; mode=block

84
{"error":{"errors":[{"domain":"global","reason":"internalError","message":"Internal Error"}],"code":500,"message":"Internal Error"}}
0

2019/03/25 21:38:15 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2019/03/25 21:38:15 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 500: Internal Error, internalError)
2019/03/25 21:38:15 DEBUG : pacer: Rate limited, increasing sleep to 2.15455162s
2019/03/25 21:38:15 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2019/03/25 21:38:15 DEBUG : HTTP REQUEST (req 0xc000418900)
2019/03/25 21:38:15 DEBUG : POST /drive/v3/files/1vxrEePt0zBcs7uDtdUxfKtutRntI_ciF/copy?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink&keepRevisionForever=false&prettyPrint=false&supportsTeamDrives=false HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/v1.46.0-103-gc3aab713-fix-3033-copy-transfer-beta
Content-Length: 182
Authorization: XXXX
Content-Type: application/json
Accept-Encoding: gzip

{"description":"00000.m2ts","mimeType":"video/vnd.dlna.mpeg-tts","modifiedTime":"2019-03-19T20:01:58.016000000Z","name":"00000.m2ts","parents":["1Inwx_aUADagkPXqVRxvaRei_8WIhabhU"]}
2019/03/25 21:38:15 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2019/03/25 21:38:15 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2019/03/25 21:38:15 DEBUG : HTTP RESPONSE (req 0xc000418900)
2019/03/25 21:38:15 DEBUG : HTTP/1.1 403 Forbidden
Transfer-Encoding: chunked
Cache-Control: private, max-age=0
Content-Type: application/json; charset=UTF-8
Date: Mon, 25 Mar 2019 13:38:15 GMT
Expires: Mon, 25 Mar 2019 13:38:15 GMT
Server: GSE
Vary: Origin
Vary: X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 1; mode=block

97
{"error":{"errors":[{"domain":"usageLimits","reason":"rateLimitExceeded","message":"Rate Limit Exceeded"}],"code":403,"message":"Rate Limit Exceeded"}}
0

2019/03/25 21:38:15 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2019/03/25 21:38:15 DEBUG : pacer: low level retry 3/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2019/03/25 21:38:15 DEBUG : pacer: Rate limited, increasing sleep to 4.463359852s
2019/03/25 21:38:17 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2019/03/25 21:38:17 DEBUG : HTTP REQUEST (req 0xc0001b0100)
2019/03/25 21:38:17 DEBUG : POST /drive/v3/files/1vxrEePt0zBcs7uDtdUxfKtutRntI_ciF/copy?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink&keepRevisionForever=false&prettyPrint=false&supportsTeamDrives=false HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/v1.46.0-103-gc3aab713-fix-3033-copy-transfer-beta
Content-Length: 182
Authorization: XXXX
Content-Type: application/json
Accept-Encoding: gzip

ncw · March 25, 2019, 10:48pm

Not much of a clue there, alas.

You could try looking through these issues to see if anything looks relevant: https://issuetracker.google.com/issues?q=drive%20copy%20"internal%20error"

system · June 23, 2019, 10:48pm

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.