Failed to size: couldn't list directory: googleapi: Error 403: User Rate Limit Exceeded

Help and Support
1

What is the problem you are having with rclone?

rclone size fails with error

Failed to size: couldn't list directory: googleapi: Error 403: User Rate Limit Exceeded

This is a simple size command. How long do I need to wait before I can use it?

I am using client ID.

What is your rclone version (output from rclone version)

rclone v1.57.0
- os/version: slackware 14.2+ (64 bit)
- os/kernel: 4.19.107-Unraid (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.17.2
- go/linking: static
- go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone size remote: --fast-list -vv

The rclone config contents with secrets removed.

[remote]
type = drive
client_id = 
client_secret =
scope = drive
token = 
root_folder_id = 

[remote-crypt]
type = crypt
remote = remote:/crypt
filename_encryption = standard
directory_name_encryption = true
password = 
password2 =

Question: If I have client ID on remote: do I need it for remote:/crypt too?

In any case I'm having the issue with just remote:

A log from the command with the -vv flag

Paste  log here
2

That's a normal message if you hit the API too hard.

You just wait and it should finish.

3

The point is it doesn't finish. It fails without producing an output.

4

How would I know that as there's no log file?

Can you run the command and share the full output of the debug log file.

5

The first line of my post says:

rclone size fails with error

and gives the error.

It doesn't complete. It fails with no output.

I tried to generate a log file but it ran for hours without ever finishing. When I ran it overnight it gave the start 403 errors and then, as I said, failed with that error.

6

So when you run:

rclone size remote: -vv

No output at all? No debug? Nothing?

Example output:

felix@gemini:~$ rclone size GD: -vv --fast-list
2021/11/18 13:46:02 DEBUG : Setting --config "/opt/rclone/rclone.conf" from environment variable RCLONE_CONFIG="/opt/rclone/rclone.conf"
2021/11/18 13:46:02 DEBUG : rclone: Version "v1.57.0" starting with parameters ["rclone" "size" "GD:" "-vv" "--fast-list"]
2021/11/18 13:46:02 DEBUG : Creating backend with remote "GD:"
2021/11/18 13:46:02 DEBUG : Using config file from "/opt/rclone/rclone.conf"
2021/11/18 13:46:04 DEBUG : Google drive root '': Disabling ListR to work around bug in drive as multi listing (4) returned no entries
2021/11/18 13:46:04 DEBUG : Google drive root '': Recycled 4 entries
2021/11/18 13:46:04 DEBUG : Google drive root '': Recycled 5 entries
2021/11/18 13:46:04 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordingly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=286927808882, userRateLimitExceeded)
2021/11/18 13:46:04 DEBUG : pacer: Rate limited, increasing sleep to 1.060685089s
2021/11/18 13:46:04 DEBUG : pacer: Reducing sleep to 0s
7

Without -vv the output was as quoted:

Failed to size: couldn't list directory: googleapi: Error 403: User Rate Limit Exceeded, etc.

I've tried running since with -vv and it hasn't completed after several hours.

8

I'm happy to help here, but if you can't post a log, I can't offer any advice.

A log from the command with the -vv flag

Paste  log here

That's what is needed.

That's why we have it template.
That's why I've asked 3 times now.

9

With good faith I will try to post if it ever completes.

10

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.