What is the problem you are having with rclone?
My routine backup script runs several rclone sync commands sequentially to sync multiple folders. The files don't change a lot and a lot of the times there aren't much uploading but a lot of checking. I have a music folder that has 25000 files, rclone always stuck at checking the ~17000 file and wait 300 seconds for too_many_requests. Sometimes it stucks forever and sometimes it moves on to complete the check.
The syncing part works, it's just stuck at checking.
Run the command 'rclone version' and share the full output of the command.
rclone v1.65.2
- os/version: darwin 14.0 (64 bit)
- os/kernel: 23.0.0 (arm64)
- os/type: darwin
- os/arch: arm64 (ARMv8 compatible)
- go/version: go1.21.6
- go/linking: dynamic
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
Dropbox
The command you were trying to run (eg rclone copy /tmp remote:tmp)
sync() {
echo "syncing $1 -> $2"
rclone sync "$1" "$2" \
--exclude .DS_Store \
-Pv \
--dropbox-batch-mode sync \
--human-readable
}
remote="dropbox"
sync ~/Music/Media.localized/Music/ $remote:music/
sync ~/files/img/ $remote:img/
sync ~/files/videos/ $remote:videos/
sync ~/files/.important/ $remote:porn/
sync ~/files/fonts/ $remote:fonts/
sync ~/files/film/ $remote:film/
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
[dropbox]
type = dropbox
token = XXX
client_id = XXX
client_secret = XXX
A log from the command that you were trying to run with the -vv flag
$ synccloud
syncing /Users/tga/Music/Media.localized/Music/ -> dropbox:music/
2024/02/28 18:32:37 NOTICE: too_many_requests/..: Too many requests or write operations. Trying again in 300 seconds.
2024/02/28 18:32:38 NOTICE: too_many_requests/...: Too many requests or write operations. Trying again in 300 seconds.
2024/02/28 18:32:38 NOTICE: too_many_requests/..: Too many requests or write operations. Trying again in 300 seconds.
Transferred: 0 B / 0 B, -, 0 B/s, ETA -
Checks: 17856 / 17856, 100%
Elapsed time: 12m51.8s