I'm trying to clone data using rclone sync from one OneDrive account (consumer) to another OneDrive account (OD for business). It's a lot of data, about 800GB. I've successfully synced about 95% of the data but now I'm getting an error saying that I have done "too many requests."
At the same time, I am cloning the data from OneDrive for Business to a Google Drive account, and am having 0 problems.
I've set up a OneDrive API key for me to use, to try to get around throttling issues. But when I try to sync data from the ODC (consumer) account I get errors; when doing it with the ODB (business) account to GDrive, everything works fine.
I'm getting the following error when doing --dump bodies:
2019-08-12 23:00:40 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2019-08-12 23:00:40 DEBUG : HTTP RESPONSE (req 0xc0003f1300)
2019-08-12 23:00:40 DEBUG : HTTP/1.1 429 Too Many Requests
Date: Tue, 13 Aug 2019 04:00:39 GMT
Ms-Cv: JNN7JuQBqE+XTP3wu/QQXA.0
P3p: CP="BUS CUR CONo FIN IVDo ONL OUR PHY SAMo TELo"
Retry-After: 444896
Strict-Transport-Security: max-age=31536000; includeSubDomains
Www-Authenticate: Bearer realm="OneDriveAPI", error="invalid_token", error_description="Invalid auth token"
X-Asmversion: UNKNOWN; 19.303.805.2003
X-Clienterrorcode: ThrottledRequest
X-Errorcodechain: AccessDenied,ThrottledRequest
X-Msedge-Ref: Ref A: 3B45C1A3360D4F17968A8A9336B5E070 Ref B: DALEDGE1510 Ref C: 2019-08-13T04:00:40Z
X-Msnserver: BN2BAPCF8D75FAA
X-Qosstats: {"ApiId":0,"ResultType":2,"SourcePropertyId":0,"TargetPropertyId":42}
X-Throwsite: 3062.afa1
Content-Length: 0
2019-08-12 23:00:40 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2019-08-12 23:00:40 DEBUG : Couldn't decode error response: EOF
2019-08-12 23:00:40 DEBUG : pacer: low level retry 1/10 (error 429 Too Many Requests: )
2019-08-12 23:00:40 DEBUG : pacer: Rate limited, increasing sleep to 20ms