What is the problem you are having with rclone? For almost 12 months we've been using rclone to copy backup files to google drive. Yesterday the larger files started failing with: Failed to copy: googleapi: got HTTP response code 429 with body: your computer or network may be sending automated q…

The error message says this [image] Shannon: We're sorry... but your computer or network may be sending automated queries. To protect our users, we can't process your request right now. I suspect that is some new Google rate limiting kicking in. I think it is breaking this legitimate use of…

@GBoudreau Your problems with Drive started the same time mine did. It's weird that the --drive-upload-cutoff 1000T has worked for you and others but not for me. Would you mind sharing what other options (if any) that you're passing to rclone? Prior to November 15, I was passing no other options to …

I use no other options: rclone copy --drive-upload-cutoff 1000T source target

--drive-upload-cutoff 1000T works for me with copy, but not with mount. Anyone else experiencing this?

Oh! --drive-upload-cutoff 1000T does in fact work for me w/ rclone copy but does not work with rclone mount. Good catch! cc @ncw

Glad to know I'm not the only one! Would love to know if there is a workaround for us mount users :blush:

it possible my data corrupt using --drive-upload-cutoff 1000T?

For a long term approach, this issue should be escalated to Google so that they could roll the limit back.

Is it normal to get this error when using: --drive-upload-cutoff 1000T Here is the error: 2022/11/23 11:41:13 DEBUG : pacer: low level retry 1/1 (error Post "<a href="https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&keepRevisionForever=false&prettyPrint=false&supportsAllDrives=true&uploadType=resumable&upload_id=ADPycdvuH-UWrbgRAd7AKCsRJ4i8hqLTQVwvXpJZw_zaJdJNZR9xvYDZmw85o1zu7Ca3py4sjdKiRos-zkbXLDHKnpYrGHoBLdZS" rel="noopener nofollow ugc">https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime…

I had created a single test file 13.550 GiB, then tried to upload with --drive-upload-cutoff 1000T but when the progress was about >90% then the Transfer size became doubled (13.55 GiB became 27.1 GiB). This process kept looping over and over again without finishing or printing any error. Looks weir…

[image] lairai: Looks weird, right? Not at all. Rclone wil retry 3 time and you'd see it more obvious with debug. It failed and retried 1 time by that log and it would double the size, etc. All expected.

rclone forum

Google drive uploads failing, http 429

Help and Support

show post in topic

Home
Categories
Guidelines
Terms of Service
Privacy Policy

Powered by Discourse, best viewed with JavaScript enabled