Using ls on an union leads to User Rate Limit Exceeded

hacktek · April 20, 2021, 4:07am

What is the problem you are having with rclone?

Running ls on an union results in User Rate Limit Exceeded consistently and returns no results. Running the same command on the individual remotes works.

What is your rclone version (output from `rclone version`)

1.55 but I've also tested the latest beta
rclone v1.56.0-beta.5415.b9d0ed4f5

os/version: ubuntu 18.04 (64 bit)
os/kernel: 4.15.0-137-generic (x86_64)
os/type: linux
os/arch: amd64
go/version: go1.16.3
go/linking: static
go/tags: none

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Ubuntu 18.04 x64

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

$ rclone ls google: -vvvv
2021/04/19 22:00:52 DEBUG : Using config file from "/home/hacktek/.config/rclone/rclone.conf"
2021/04/19 22:00:52 DEBUG : rclone: Version "v1.56.0-beta.5415.b9d0ed4f5" starting with parameters ["rclone" "ls" "google:" "-vvvv"]
2021/04/19 22:00:52 DEBUG : Creating backend with remote "google:"
2021/04/19 22:00:52 DEBUG : Creating backend with remote "google2:"
2021/04/19 22:00:52 DEBUG : Creating backend with remote "google1:"
2021/04/19 22:00:52 DEBUG : union root '': actionPolicy = *policy.EpAll, createPolicy = *policy.EpMfs, searchPolicy = *policy.FF
2021/04/19 22:00:53 DEBUG : Temporary manual requests: No export formats found for "application/vnd.google-apps.form"
2021/04/19 22:00:53 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordingly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=102646426726, userRateLimitExceeded)
2021/04/19 22:00:53 DEBUG : pacer: Rate limited, increasing sleep to 1.415211046s
2021/04/19 22:00:53 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordingly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=102646426726, userRateLimitExceeded)
2021/04/19 22:00:53 DEBUG : pacer: Rate limited, increasing sleep to 2.787841898s
2021/04/19 22:00:53 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordingly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=102646426726, userRateLimitExceeded)
2021/04/19 22:00:53 DEBUG : pacer: Rate limited, increasing sleep to 4.772750861s
2021/04/19 22:00:53 DEBUG : pacer: Reducing sleep to 0s
2021/04/19 22:00:53 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordingly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=102646426726, userRateLimitExceeded)
2021/04/19 22:00:53 DEBUG : pacer: Rate limited, increasing sleep to 1.39458083s
2021/04/19 22:00:53 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordingly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=102646426726, userRateLimitExceeded)
2021/04/19 22:00:53 DEBUG : pacer: Rate limited, increasing sleep to 2.164200423s
2021/04/19 22:00:53 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordingly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=102646426726, userRateLimitExceeded)
2021/04/19 22:00:53 DEBUG : pacer: Rate limited, increasing sleep to 1.26885383s
2021/04/19 22:00:53 DEBUG : pacer: Reducing sleep to 0s
2021/04/19 22:00:53 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordingly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=102646426726, userRateLimitExceeded)
2021/04/19 22:00:53 DEBUG : pacer: Rate limited, increasing sleep to 1.126746865s
2021/04/19 22:00:54 DEBUG : pacer: Reducing sleep to 0s

Same thing on the individual remotes (filenames removed):

$ rclone ls google1: -vvvv
2021/04/19 22:03:14 DEBUG : Using config file from "/home/hacktek/.config/rclone/rclone.conf"
2021/04/19 22:03:14 DEBUG : rclone: Version "v1.56.0-beta.5415.b9d0ed4f5" starting with parameters ["rclone" "ls" "google1:" "-vvvv"]
2021/04/19 22:03:14 DEBUG : Creating backend with remote "google1:"
2021/04/19 22:03:15 DEBUG : Temporary manual requests: No export formats found for "application/vnd.google-apps.form"
5276795471 
7372595200 
28573102080 
        0 testwrite
12629032960 
2939504640 
7328040960 
15399649280 
  3246080 
   931840 
43350937600 
1853880320 
 39536640

$ rclone ls google2: -vvvv
2021/04/19 22:04:10 DEBUG : Using config file from "/home/hacktek/.config/rclone/rclone.conf"
2021/04/19 22:04:10 DEBUG : rclone: Version "v1.56.0-beta.5415.b9d0ed4f5" starting with parameters ["rclone" "ls" "google2:" "-vvvv"]
2021/04/19 22:04:10 DEBUG : Creating backend with remote "google2:"
        0 
      389 
      651
      205
     3203
      307
      152

The rclone config contents with secrets removed.

[google1]
type = drive
scope = drive
team_drive = yyyy

[google2]
type = drive
scope = drive
team_drive = xxxx

[google]
type = union
remotes = google1: google2:

A log from the command with the `-vv` flag

See above

hacktek · April 20, 2021, 4:32am

The plot thickens...if I run ls through the union on a path that only exists on one of the two remotes it works. If I run it on a path that exists in both, it fails.

Exists in both:

$ rclone ls google:Media -vvvvvv
2021/04/19 22:28:43 DEBUG : Using config file from "/home/hacktek/.config/rclone/rclone.conf"
2021/04/19 22:28:43 DEBUG : rclone: Version "v1.56.0-beta.5415.b9d0ed4f5" starting with parameters ["rclone" "ls" "google:Media" "-vvvvvv"]
2021/04/19 22:28:43 DEBUG : Creating backend with remote "google:Media"
2021/04/19 22:28:43 DEBUG : Creating backend with remote "google2:"
2021/04/19 22:28:43 DEBUG : Creating backend with remote "google1:"
2021/04/19 22:28:43 DEBUG : Creating backend with remote "google2:/Media"
2021/04/19 22:28:43 DEBUG : Creating backend with remote "google1:/Media"
2021/04/19 22:28:43 DEBUG : fs cache: renaming cache item "google1:/Media" to be canonical "google1:Media"
2021/04/19 22:28:43 DEBUG : fs cache: renaming cache item "google2:/Media" to be canonical "google2:Media"
2021/04/19 22:28:43 DEBUG : union root 'Media': actionPolicy = *policy.EpAll, createPolicy = *policy.EpMfs, searchPolicy = *policy.FF
2021/04/19 22:29:00 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordingly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=102646426726, userRateLimitExceeded)
2021/04/19 22:29:00 DEBUG : pacer: Rate limited, increasing sleep to 1.166933928s
2021/04/19 22:29:00 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordingly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=102646426726, userRateLimitExceeded)

Exists in google1:

$ rclone ls google:Media/TV/TV_ -vvvv | head
2021/04/19 22:31:07 DEBUG : Using config file from "/home/hacktek/.config/rclone/rclone.conf"
2021/04/19 22:31:07 DEBUG : rclone: Version "v1.56.0-beta.5415.b9d0ed4f5" starting with parameters ["rclone" "ls" "google:Media/TV/TV_" "-vvvv"]
2021/04/19 22:31:07 DEBUG : Creating backend with remote "google:Media/TV/TV_"
2021/04/19 22:31:07 DEBUG : Creating backend with remote "google2:"
2021/04/19 22:31:07 DEBUG : Creating backend with remote "google1:"
2021/04/19 22:31:07 DEBUG : Creating backend with remote "google2:/Media/TV/TV_"
2021/04/19 22:31:07 DEBUG : Creating backend with remote "google1:/Media/TV/TV_"
2021/04/19 22:31:08 DEBUG : fs cache: renaming cache item "google1:/Media/TV/TV_" to be canonical "google1:Media/TV/TV_"
2021/04/19 22:31:08 DEBUG : fs cache: renaming cache item "google2:/Media/TV/TV_" to be canonical "google2:Media/TV/TV_"
2021/04/19 22:31:08 DEBUG : union root 'Media/TV/TV_': actionPolicy = *policy.EpAll, createPolicy = *policy.EpMfs, searchPolicy = *policy.FF
1824605253 Adu...

Exists only in google2:

$ rclone ls google:Media/TV/TV -vvvv | head
2021/04/19 22:32:18 DEBUG : Using config file from "/home/hacktek/.config/rclone/rclone.conf"
2021/04/19 22:32:18 DEBUG : rclone: Version "v1.56.0-beta.5415.b9d0ed4f5" starting with parameters ["rclone" "ls" "google:Media/TV/TV" "-vvvv"]
2021/04/19 22:32:18 DEBUG : Creating backend with remote "google:Media/TV/TV"
2021/04/19 22:32:18 DEBUG : Creating backend with remote "google2:"
2021/04/19 22:32:18 DEBUG : Creating backend with remote "google1:"
2021/04/19 22:32:18 DEBUG : Creating backend with remote "google2:/Media/TV/TV"
2021/04/19 22:32:18 DEBUG : Creating backend with remote "google1:/Media/TV/TV"
2021/04/19 22:32:19 DEBUG : fs cache: renaming cache item "google1:/Media/TV/TV" to be canonical "google1:Media/TV/TV"
2021/04/19 22:32:19 DEBUG : fs cache: renaming cache item "google2:/Media/TV/TV" to be canonical "google2:Media/TV/TV"
2021/04/19 22:32:19 DEBUG : union root 'Media/TV/TV': actionPolicy = *policy.EpAll, createPolicy = *policy.EpMfs, searchPolicy = *policy.FF
1449872855 The O...

ncw · April 20, 2021, 10:17am

Can you do a bit of detective work?

If you add -vv --dump headers to your queries, that will show the transactions with the drive API that rclone does.

I expect in the failing scenario rclone is doing something a bit different which is provoking the user rate limit exceeded.

Can you also try --disable ListR with your 3 tests and see if that makes any difference.

Also what does rclone backend features google: say?

hacktek · April 20, 2021, 1:00pm

These are headers from the union:

2021/04/20 06:53:09 DEBUG : HTTP REQUEST (req 0xc000c1c600)
2021/04/20 06:53:09 DEBUG : GET /drive/v3/files?alt=json&corpora=drive&driveId=0ANKPn_ioW4hcUk9PVA&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyT
rashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=t
rue&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%271-APT3rVVuhNtw5kAmkVmUct0K2pBPcBY%27+in+parents+or+%271-NlXN1Y_rHKJf9n4nv_77KNrtleE9jyN%27+in+parents+or
+%2713QySToFyy9_dNBb2-cih_KYHUBgeF216%27+in+parents+or+%2717g6HCWxkLH_lkpohfkMBk2DpUfiIIi1M%27+in+parents+or+%2717qvvjzSHtAhgNiEBAVNhg2INCvijbyig%27+in+parents+or+%2717
r_waSyxHFZ9nqdnR0GXM7jN3-7OEW7c%27+in+parents+or+%271AzcAv3rlkko11hWBTatw1HGIRFzDjdiK%27+in+parents+or+%271Fd5OL6y314ZPJmuG9TXEye5yavbqSyaC%27+in+parents+or+%271FtrrbVm
aQWim-6534aiY1D3Iz244mEnM%27+in+parents+or+%271KM8yn5g0FzBH0Ryb7_X45GEPakGeWy1L%27+in+parents+or+%271N7thfj9WpXbnVUSYciiLVCtLVZRaLiny%27+in+parents+or+%271Rqs_77eeTNxYH
8beC7y3Bij_PXovdXUC%27+in+parents+or+%271TcLmcet3Dx_IoA80kZc7Olnc1tCXBxST%27+in+parents+or+%271VdTawv5BoFSWEZxxPs9XGNNfDUwXzS8y%27+in+parents+or+%271WUIWU6p5HHi0BxfPwrL
sBo1ISPZLa41C%27+in+parents+or+%271csIWqvzEUiMlX4eOd8b-w4an1y7qiFAh%27+in+parents+or+%271emYIpMkW5Y95v9X2MM6YMZoGzeH17eaR%27+in+parents+or+%271iaufXS-e9GhOHVzypGyjduSun
fBTEWrx%27+in+parents+or+%271jSxe_6ZNGbGek_MXzSo3vA53JWxO3MIn%27+in+parents+or+%271jxvit7VPaL3iitv3im767CqiurswwSO_%27+in+parents+or+%271mMWABkWhrKLXuHcoZ76qX9cGvrgcp1z
A%27+in+parents+or+%271o6C30YFqDCJu42zoG7Wup-HXKSUIeAd7%27+in+parents+or+%271pekTnR6O_4tGqnUr1Eptj01Lce7wJcvm%27+in+parents+or+%271qa5sZ7u2XUi3VtQnOhlx6ItO6xKhGsUu%27+i
n+parents+or+%271rG6_rqFwHJCR4gDf7p2dhoDp1kTyyY0U%27+in+parents+or+%271ygwXXQ8JxrtHCMrrD0-s4IUINlipld0F%27+in+parents+or+%271ylo_95YSt0TsUygK-XvcJb3PE1RKJFxm%27+in+pare
nts+or+%271zXvLO2k2u6S-rBS7aopBOD8fGvAHtc5K%27+in+parents%29&supportsAllDrives=true HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/v1.56.0-beta.5415.b9d0ed4f5
Authorization: XXXX
X-Goog-Api-Client: gl-go/1.16.3 gdcl/20210128
Accept-Encoding: gzip

2021/04/20 06:53:09 DEBUG : HTTP RESPONSE (req 0xc000c1c600)
2021/04/20 06:53:09 DEBUG : HTTP/1.1 403 Forbidden
Transfer-Encoding: chunked
Alt-Svc: h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
Cache-Control: private, max-age=0
Content-Security-Policy: frame-ancestors 'self'
Content-Type: application/json; charset=UTF-8
Date: Tue, 20 Apr 2021 12:53:09 GMT
Expires: Tue, 20 Apr 2021 12:53:09 GMT
Server: GSE
Vary: Origin
Vary: X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 1; mode=block

2021/04/20 06:53:09 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/04/20 06:53:09 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordingly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas?project=102646426726, userRateLimitExceeded)
2021/04/20 06:53:09 DEBUG : pacer: Rate limited, increasing sleep to 1.316205031s

Headers from regular backend:

2021/04/20 06:55:04 DEBUG : HTTP REQUEST (req 0xc000417e00)
2021/04/20 06:55:04 DEBUG : GET /drive/v3/files?alt=json&corpora=drive&driveId=0ANKPn_ioW4hcUk9PVA&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=true&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%270ANKPn_ioW4hcUk9PVA%27+in+parents%29+and+%28name%3D%27Media%27%29+and+%28mimeType%3D%27application%2Fvnd.google-apps.folder%27+or+mimeType%3D%27application%2Fvnd.google-apps.shortcut%27%29&supportsAllDrives=true HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/v1.56.0-beta.5415.b9d0ed4f5
Authorization: XXXX
X-Goog-Api-Client: gl-go/1.16.3 gdcl/20210128
Accept-Encoding: gzip

2021/04/20 06:55:04 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/04/20 06:55:04 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/04/20 06:55:04 DEBUG : HTTP RESPONSE (req 0xc000417e00)
2021/04/20 06:55:04 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Alt-Svc: h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Security-Policy: frame-ancestors 'self'
Content-Type: application/json; charset=UTF-8
Date: Tue, 20 Apr 2021 12:55:04 GMT
Expires: Mon, 01 Jan 1990 00:00:00 GMT
Pragma: no-cache
Server: GSE
Vary: Origin
Vary: X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 1; mode=block

rclone backend features google:

{
        "Name": "google",
        "Root": "",
        "String": "union root ''",
        "Precision": 1000000,
        "Hashes": [
                "MD5"
        ],
        "Features": {
                "About": true,
                "BucketBased": false,
                "BucketBasedRootOK": false,
                "CanHaveEmptyDirectories": true,
                "CaseInsensitive": false,
                "ChangeNotify": true,
                "CleanUp": false,
                "Command": false,
                "Copy": true,
                "DirCacheFlush": true,
                "DirMove": true,
                "Disconnect": false,
                "DuplicateFiles": false,
                "GetTier": false,
                "IsLocal": false,
                "ListR": true,
                "MergeDirs": false,
                "Move": true,
                "OpenWriterAt": false,
                "PublicLink": false,
                "Purge": true,
                "PutStream": true,
                "PutUnchecked": false,
                "ReadMimeType": true,
                "ServerSideAcrossConfigs": false,
                "SetTier": false,
                "SetWrapper": false,
                "Shutdown": false,
                "SlowHash": false,
                "SlowModTime": false,
                "UnWrap": false,
                "UserInfo": false,
                "WrapFs": false,
                "WriteMimeType": true
        }
}

--disable ListR seems to work, albeit slower.

ncw · April 20, 2021, 1:42pm

Thanks for that. The logs don't look unusual.

I wonder if this is caused by you using effectively two google drives at once from the same IP. Are they both configured with the same user?

You could try --tpslimit 10 to see if that helps (raise and lower the number).

hacktek · April 20, 2021, 4:06pm

I do see a huge spike in API requests if I run it as I described initially. From the tests:

I switched the remotes to use different accounts and I see the same issue.
I do not see the same issue if I do --tpslimit 8 (although this account has increased quota set to 10,000 hps so I should be able to run this at a much higher rate, but can't for some reason)
I do not see the same issue if I do --disable ListR

To give some context, I found this while doing rc vfs/refresh and seeing it hang (and crazy high API denials on the console). Adding --disable ListR to the command seems to have fixed it and it takes roughly 4 minutes to go through the entire list (which is OK considering the size of these drives).

time /usr/bin/rclone rc vfs/refresh \
>   dir=Media \
>   dir2=Remux \
>   recursive=true \
>   --user-agent='Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36' \
>   --config /home/hacktek/.config/rclone/rclone.conf \
>   --timeout=1h \
>   -vvv \
>   --disable ListR \
>   --rc-addr=localhost:5572
2021/04/20 10:00:05 DEBUG : Using config file from "/home/hacktek/.config/rclone/rclone.conf"
2021/04/20 10:00:05 DEBUG : rclone: Version "v1.56.0-beta.5416.7afb4487e" starting with parameters ["/usr/bin/rclone" "rc" "vfs/refresh" "dir=Media" "dir2=Remux" "recursive=true" "--user-agent=Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36" "--config" "/home/hacktek/.config/rclone/rclone.conf" "--timeout=1h" "-vvv" "--disable" "ListR" "--rc-addr=localhost:5572"]
{
        "result": {
                "Media": "OK",
                "Remux": "OK"
        }
}
2021/04/20 10:04:07 DEBUG : 4 go routines active

real    4m1.567s
user    0m0.055s
sys     0m0.000s

I've been running this without --disable ListR for a long time and never noticed this so it's either always been a problem or I simply didn't see it til now.

ncw · April 20, 2021, 8:49pm

Hmm, I wonder if there is some per IP quota.

Drive has lots of quotas which aren't visible or tweakable so it wouldn't suprise me.

ListR should use fewer transactions so disabling it should be a bad thing to do.

I wonder if there is something it doesn't like. Do you have an unusual layout of files or directories?

I'm not sure --disable ListR on rclone rc will affect the remote end - can you run a few more tests?

hacktek · May 1, 2021, 6:30pm

I thought about the per IP quota as the first possibility because it seemed to start right when I switched servers but then I was able to reproduce it on the old server as well, so I'm not sure. Could have definitely been some hidden drive limit.

I haven't had time to run additional tests but things do appear to be working properly with the changes I did to disable listR and reduce tps (even over RC). There was an immediate change in behavior when I added those so I think they do apply.

I don't have anything that I'd consider unusual on the directory structure, it goes something like this:

google1:

Media/A/A_
Media/B/B_

google2:

Media/A/A
Media/A/A-{A,B,C,D...}
Media/B/B
Media/B/B-{A,B,C,D...}

Only the "base" paths would be shared (Media/A and Media/B) but the rest of the paths are different as you can see. Even though the same file might exist in both drives, it's never going to exist in the same path.

ncw · May 1, 2021, 9:36pm

That might have to remain a Google mystery to add to the nearly infinite list of them we have already!

system · July 1, 2021, 5:36pm

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.