Very High CPU Usage on Unraid when Running rclone Sync Command

rclone19051 · January 30, 2022, 7:49pm

Here's a debug log i was able to output for the first 45 mins of the below command. You can see it has checked about 50 of the ~2200 files which if you interpolate means this script would take more than a day just to check. I wonder if I'm actually experiencing issues with Google API limits + rclone is checking md5?

rclone sync --transfers 8 --checkers 16 --progress --delete-during --no-update-modtime --contimeout 60s --timeout 300s --retries 3 --low-level-retries 10 --drive-chunk-size=64M --drive-upload-cutoff=64M --stats 1s --stats-file-name-length 0 --fast-list --drive-acknowledge-abuse --log-level DEBUG --log-file=/mnt/user/Personal/Logs/rclone_$(date +%Y%m%d_%H%M%S).txt "/mnt/user/Movies" "REMOTE:REMOTE/Movies"

Animosity022 · January 30, 2022, 8:15pm

Having things too high makes things slower:

2022/01/30 14:01:21 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordin
gly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=185026326912, userRateLimitExceeded)
2022/01/30 14:01:21 DEBUG : pacer: Rate limited, increasing sleep to 1.122399013s
2022/01/30 14:01:21 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordin
gly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=185026326912, userRateLimitExceeded)
2022/01/30 14:01:21 DEBUG : pacer: Rate limited, increasing sleep to 2.850602937s
2022/01/30 14:01:21 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordin
gly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=185026326912, userRateLimitExceeded)
2022/01/30 14:01:21 DEBUG : pacer: Rate limited, increasing sleep to 4.409799249s
2022/01/30 14:01:21 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordin
gly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=185026326912, userRateLimitExceeded)
2022/01/30 14:01:21 DEBUG : pacer: Rate limited, increasing sleep to 8.385612751s
2022/01/30 14:01:21 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordin
gly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=185026326912, userRateLimitExceeded)
2022/01/30 14:01:21 DEBUG : pacer: Rate limited, increasing sleep to 16.514849582s
2022/01/30 14:01:21 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordin
gly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=185026326912, userRateLimitExceeded)
2022/01/30 14:01:21 DEBUG : pacer: Rate limited, increasing sleep to 16.757115522s
2022/01/30 14:01:21 DEBUG : pacer: Reducing sleep to 0s
2022/01/30 14:01:22 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordin
gly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=185026326912, userRateLimitExceeded)
2022/01/30 14:01:22 DEBUG : pacer: Rate limited, increasing sleep to 1.361459285s
2022/01/30 14:01:22 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordin
gly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=185026326912, userRateLimitExceeded)
2022/01/30 14:01:22 DEBUG : pacer: Rate limited, increasing sleep to 2.241724064s
2022/01/30 14:01:22 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordin
gly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=185026326912, userRateLimitExceeded)
2022/01/30 14:01:22 DEBUG : pacer: Rate limited, increasing sleep to 4.575562339s
2022/01/30 14:01:22 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordin
gly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=185026326912, userRateLimitExceeded)
2022/01/30 14:01:22 DEBUG : pacer: Rate limited, increasing sleep to 8.148615091s
2022/01/30 14:01:22 DEBUG : pacer: Reducing sleep to 0s
2022/01/30 14:01:23 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordin
gly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=185026326912, userRateLimitExceeded)
2022/01/30 14:01:23 DEBUG : pacer: Rate limited, increasing sleep to 1.035459154s
2022/01/30 14:01:23 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403:

Those all slow things down quite a bit as you wait a few seconds here/there.

What's your quota per 100 seconds in the admin console?

rclone19051 · January 30, 2022, 8:24pm

I had setup my own client ID many years ago, not sure if anything Google has changed but see below quotas.

system · March 1, 2022, 8:24pm

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.