What is the problem you are having with rclone?
It looks like --fast-list doesn't do a fast-list on the subfolder but rather on the folder specified in the config.
My source folder is a folder with 10 shortcuts and I only need a fast-list of one of the shortcuts.
The problem is that it does a fast-list of all Shortcuts and this takes atleast 10 minutes and has multiple 403 errors as you can see in the log. (this time only one)
Is there a way to limit this to only a subfolder?
Thanks.
Run the command 'rclone version' and share the full output of the command.
rclone v1.58.1
- os/version: Microsoft Windows 10 Home 21H2 (64 bit)
- os/kernel: 10.0.19044.1706 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.17.9
- go/linking: dynamic
- go/tags: cmount
Which cloud storage system are you using? (eg Google Drive)
Google Drive
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone sync remote_acc:shortcut remote_acc:folder -P -vv --fast-list --tpslimit 9 --checkers 9 --transfers 4 --order-by size,ascending --fast-list --check-first
The rclone config contents with secrets removed.
[remote_acc]
type = drive
client_id =
client_secret =
scope = drive
token =
root_folder_id = 1rahg...
A log from the command with the -vv flag
C:\Users\User>rclone sync remote_acc:shortcut remote_acc:folder -P -vv --fast-list --tpslimit 9 --checkers 9 --transfers 4 --order-by size,ascending --fast-list --check-first
2022/05/28 14:24:50 INFO : Starting transaction limiter: max 9 transactions/s with burst 1
2022/05/28 14:24:50 DEBUG : rclone: Version "v1.58.1" starting with parameters ["rclone" "sync" "remote_acc:shortcut" "remote_acc:folder" "-P" "-vv" "--fast-list" "--tpslimit" "9" "--checkers" "9" "--transfers" "4" "--order-by" "size,ascending" "--fast-list" "--check-first"]
2022/05/28 14:24:50 DEBUG : Creating backend with remote "remote_acc:shortcut"
2022/05/28 14:24:50 DEBUG : Using config file from "C:\\Users\\Username\\.config\\rclone\\rclone.conf"
2022/05/28 14:24:51 DEBUG : Creating backend with remote "remote_acc:folder"
2022-05-28 14:24:51 INFO : Google drive root 'folder': Running all checks before starting transfers
2022-05-28 14:24:53 DEBUG : Google drive root 'shortcut': Disabling ListR to work around bug in drive as multi listing (4) returned no entries
2022-05-28 14:24:53 DEBUG : Google drive root 'shortcut': Recycled 4 entries
2022-05-28 14:24:53 DEBUG : Google drive root 'shortcut': Recycled 5 entries
2022-05-28 14:24:53 DEBUG : Google drive root 'shortcut': Recycled 2 entries
2022-05-28 14:27:39 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: User Rate Limit Exceeded. Rate of requests for user exceed configured project quota. You may consider re-evaluating expected per-user traffic to the API and adjust project quota limits accordingly. You may monitor aggregate quota usage and adjust limits in the API Console: https://console.developers.google.com/apis/api/drive.googleapis.com/quotas, userRateLimitExceeded)
2022-05-28 14:27:39 DEBUG : pacer: Rate limited, increasing sleep to 1.709509693s
2022-05-28 14:27:39 DEBUG : pacer: Reducing sleep to 0s
2022-05-28 14:32:48 DEBUG : Google drive root 'folder': Waiting for checks to finish
2022-05-28 14:32:48 INFO : Google drive root 'folder': Checks finished, now starting transfers
2022-05-28 14:32:48 DEBUG : Google drive root 'folder': Waiting for transfers to finish
Transferred: 0 / 12.616 TiByte, 0%, 0 Byte/s, ETA -
Transferred: 0 / 38491, 0%
Elapsed time: 8m1.7s
Transferring:
* file1: 0% /32, 0/s, -
* file2: 0% /32, 0/s, -
* file3: 0% /32, 0/s, -
* file4: 0% /32, 0/s, -^C