Rate limited, reducing sleep to 0s

What is the problem you are having with rclone?

Pacer increases sleep but then immediately reduces it to 0s.

What is your rclone version (output from rclone version)

rclone v1.53.2
- os/arch: linux/amd64
- go version: go1.15.3

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Distributor ID: Ubuntu
Description: Ubuntu 18.04.5 LTS
Release: 18.04
Codename: bionic
Linux nephele 5.6.3-050603-generic #202004080837 SMP Wed Apr 8 08:39:44 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

/usr/bin/rclone copy /data/ gdrive:/ -vv --config /home/nephele/.config/rclone/rclone.conf --drive-stop-on-upload-limit --exclude=Media/** --copy-links --transfers=4 --checkers=6 --stats-log-level=NOTICE --log-file=/var/log/rclone.log --track-renames --fast-list

The rclone config contents with secrets removed.

[gdrive]
type = drive
client_id = 3277<xxxx>23558rmcpne.apps.googleusercontent.com
client_secret = <xxx>
scope = drive
root_folder_id = 1hAUkaLSa<xxxxx>sXjl5qpBgiH55
token = {"access_token":"<xxxxx>","token_type":"Bearer","refresh_token":"1//<xxxx>A","expiry":"2020-10-30T13:25:56.163548844-04:00"}
team_drive =

A log from the command with the -vv flag

2020/10/30 12:59:58 DEBUG : rclone: Version "v1.53.2" starting with parameters ["/usr/bin/rclone" "copy" "/data/" "gdrive:/" "-vv" "--config" "/home/nephele/.config/rclone/rclone.conf" "--drive-stop-on-upload-limit" "--exclude=Media/**" "--copy-links" "--transfers=4" "--checkers=6" "--stats-log-level=NOTICE" "--log-file=/var/log/rclone.log" "--track-renames" "--fast-list"]
2020/10/30 12:59:58 DEBUG : Creating backend with remote "/data/"
2020/10/30 12:59:58 DEBUG : Using config file from "/home/nephele/.config/rclone/rclone.conf"
2020/10/30 12:59:58 DEBUG : Creating backend with remote "gdrive:/"
2020/10/30 12:59:58 DEBUG : fs cache: renaming cache item "gdrive:/" to be canonical "gdrive:"
2020/10/30 12:59:58 ERROR : Google drive root '': Ignoring --track-renames as it doesn't work with copy or move, only sync
2020/10/30 12:59:59 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordingly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=327771190171, userRateLimitExceeded)
2020/10/30 12:59:59 DEBUG : pacer: Rate limited, increasing sleep to 1.785593578s
2020/10/30 12:59:59 DEBUG : pacer: Reducing sleep to 0s

Do you have more of the log? It normally goes back to normal once it's working without any issues.

It's just more of the same-

pacer: low level retry x/10 (403 error)
pacer: rate limited, increasing sleep to x.x (1-16 seconds)
pacer: reducing sleep to 0s

all the in same second

Can you share the full log?

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.