OneDrive API locked out even with custom API key?

I'm trying to clone data using rclone sync from one OneDrive account (consumer) to another OneDrive account (OD for business). It's a lot of data, about 800GB. I've successfully synced about 95% of the data but now I'm getting an error saying that I have done "too many requests."

At the same time, I am cloning the data from OneDrive for Business to a Google Drive account, and am having 0 problems.

I've set up a OneDrive API key for me to use, to try to get around throttling issues. But when I try to sync data from the ODC (consumer) account I get errors; when doing it with the ODB (business) account to GDrive, everything works fine.

I'm getting the following error when doing --dump bodies:

2019-08-12 23:00:40 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

2019-08-12 23:00:40 DEBUG : HTTP RESPONSE (req 0xc0003f1300)

2019-08-12 23:00:40 DEBUG : HTTP/1.1 429 Too Many Requests

Date: Tue, 13 Aug 2019 04:00:39 GMT



Retry-After: 444896

Strict-Transport-Security: max-age=31536000; includeSubDomains

Www-Authenticate: Bearer realm="OneDriveAPI", error="invalid_token", error_description="Invalid auth token"

X-Asmversion: UNKNOWN; 19.303.805.2003

X-Clienterrorcode: ThrottledRequest

X-Errorcodechain: AccessDenied,ThrottledRequest

X-Msedge-Ref: Ref A: 3B45C1A3360D4F17968A8A9336B5E070 Ref B: DALEDGE1510 Ref C: 2019-08-13T04:00:40Z

X-Msnserver: BN2BAPCF8D75FAA

X-Qosstats: {"ApiId":0,"ResultType":2,"SourcePropertyId":0,"TargetPropertyId":42}

X-Throwsite: 3062.afa1

Content-Length: 0

2019-08-12 23:00:40 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<

2019-08-12 23:00:40 DEBUG : Couldn't decode error response: EOF

2019-08-12 23:00:40 DEBUG : pacer: low level retry 1/10 (error 429 Too Many Requests: )

2019-08-12 23:00:40 DEBUG : pacer: Rate limited, increasing sleep to 20ms

That does look like you've been throttled at onedrive but I'm not clear whether it is at the source or the destination.

Onedrive has some quite vicious rate limiting and not as much is known about it as the Google drive rate limiting.

It appears to be at the source (ODC), because when I do ODB → Google Drive, there aren't any issues.

Is there a way to appeal the throttling? I mostly just want to finish this process... and it looks like it's a 4 day retry-after period (retry-after: 444896)...

Probably wait 24h doing nothing then try again - that is what I'd try first.

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.