Reducing sleep constantly?

What is the problem you are having with rclone?

When trying to move data, the logs show only "Reducing sleep" with seemingly no commands in-between. Is this expected? I left it running for 16 hours recently and the "sleep" never transitioned to actually moving data. I have used this same command successfully before, so unclear if I'm somehow hitting an API limit perhaps. Completely reasonable if this is user error, I'd actually love that as I could hopefully resolve it!

Run the command 'rclone version' and share the full output of the command.

rclone v1.63.1

  • os/version: debian 11.7 (64 bit)
  • os/kernel: 5.15.108-1-pve (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.20.6
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone move --check-first --fast-list -vvvv --progress --log-file /baz/fizz.log xyz_remote: /foo/bar

The rclone config contents with secrets removed.

[xyz_remote]
type = drive
client_id = <id-removed>.apps.googleusercontent.com
client_secret = <secret-removed>
scope = drive
token = {"access_token":"<access-toke-removed>","token_type":"Bearer","refresh_token":"<refresh-token-removed>","expiry":"2023-08-11T10:19:36.87254489-04:00"}
team_drive =

A log from the command with the -vv flag

2023/08/11 09:25:33 DEBUG : pacer: Reducing sleep to 430.214161ms
2023/08/11 09:25:33 DEBUG : pacer: Reducing sleep to 518.082632ms
2023/08/11 09:25:33 DEBUG : pacer: Reducing sleep to 611.666529ms
2023/08/11 09:25:33 DEBUG : pacer: Reducing sleep to 687.973865ms
2023/08/11 09:25:33 DEBUG : pacer: Reducing sleep to 707.353951ms
2023/08/11 09:25:33 DEBUG : pacer: Reducing sleep to 616.441794ms
2023/08/11 09:25:34 DEBUG : pacer: Reducing sleep to 688.481µs
2023/08/11 09:25:35 DEBUG : pacer: Reducing sleep to 0s
2023/08/11 09:25:35 DEBUG : pacer: Reducing sleep to 52.759615ms
2023/08/11 09:25:35 DEBUG : pacer: Reducing sleep to 144.763211ms
2023/08/11 09:25:35 DEBUG : pacer: Reducing sleep to 203.047932ms
2023/08/11 09:25:35 DEBUG : pacer: Reducing sleep to 297.972971ms
2023/08/11 09:25:35 DEBUG : pacer: Reducing sleep to 394.662066ms
2023/08/11 09:25:35 DEBUG : pacer: Reducing sleep to 484.490552ms
2023/08/11 09:25:35 DEBUG : pacer: Reducing sleep to 577.450075ms
2023/08/11 09:25:35 DEBUG : pacer: Reducing sleep to 619.890016ms
2023/08/11 09:25:35 DEBUG : pacer: Reducing sleep to 696.807378ms
2023/08/11 09:25:35 DEBUG : pacer: Reducing sleep to 670.62943ms
2023/08/11 09:25:35 DEBUG : pacer: Reducing sleep to 616.795886ms
2023/08/11 09:25:36 DEBUG : pacer: Reducing sleep to 25.669535ms
2023/08/11 09:25:37 DEBUG : pacer: Reducing sleep to 0s
2023/08/11 09:25:37 DEBUG : pacer: Reducing sleep to 39.420043ms
2023/08/11 09:25:37 DEBUG : pacer: Reducing sleep to 134.187555ms
2023/08/11 09:25:37 DEBUG : pacer: Reducing sleep to 232.345221ms
2023/08/11 09:25:37 DEBUG : pacer: Reducing sleep to 300.942029ms
2023/08/11 09:25:37 DEBUG : pacer: Reducing sleep to 301.098153ms
2023/08/11 09:25:37 DEBUG : pacer: Reducing sleep to 365.719626ms
2023/08/11 09:25:37 DEBUG : pacer: Reducing sleep to 450.568322ms
2023/08/11 09:25:37 DEBUG : pacer: Reducing sleep to 539.725536ms
2023/08/11 09:25:37 DEBUG : pacer: Reducing sleep to 572.475048ms
2023/08/11 09:25:37 DEBUG : pacer: Reducing sleep to 622.2667ms
2023/08/11 09:25:37 DEBUG : pacer: Reducing sleep to 538.701097ms
2023/08/11 09:25:38 DEBUG : pacer: Reducing sleep to 2.368225ms
2023/08/11 09:25:38 DEBUG : pacer: Reducing sleep to 0s
2023/08/11 09:25:39 DEBUG : pacer: Reducing sleep to 18.526802ms
2023/08/11 09:25:39 DEBUG : pacer: Reducing sleep to 47.99782ms
2023/08/11 09:25:39 DEBUG : pacer: Reducing sleep to 107.061063ms
2023/08/11 09:25:39 DEBUG : pacer: Reducing sleep to 204.010628ms
2023/08/11 09:25:39 DEBUG : pacer: Reducing sleep to 283.228697ms
2023/08/11 09:25:39 DEBUG : pacer: Reducing sleep to 370.578473ms
2023/08/11 09:25:39 DEBUG : pacer: Reducing sleep to 419.404421ms
2023/08/11 09:25:39 DEBUG : pacer: Reducing sleep to 497.447409ms
2023/08/11 09:25:39 DEBUG : pacer: Reducing sleep to 548.407459ms
2023/08/11 09:25:39 DEBUG : pacer: Reducing sleep to 610.620424ms
2023/08/11 09:25:39 DEBUG : pacer: Reducing sleep to 627.969313ms
2023/08/11 09:25:39 DEBUG : pacer: Reducing sleep to 612.724118ms
2023/08/11 09:25:40 DEBUG : pacer: Reducing sleep to 92.779659ms
2023/08/11 09:25:40 DEBUG : pacer: Reducing sleep to 0s
2023/08/11 09:25:41 DEBUG : pacer: Reducing sleep to 37.824102ms
2023/08/11 09:25:41 DEBUG : pacer: Reducing sleep to 128.040608ms
2023/08/11 09:25:41 DEBUG : pacer: Reducing sleep to 210.999849ms
2023/08/11 09:25:41 DEBUG : pacer: Reducing sleep to 252.108698ms
2023/08/11 09:25:41 DEBUG : pacer: Reducing sleep to 268.706552ms
2023/08/11 09:25:41 DEBUG : pacer: Reducing sleep to 364.307323ms
2023/08/11 09:25:41 DEBUG : pacer: Reducing sleep to 445.121451ms
2023/08/11 09:25:41 DEBUG : pacer: Reducing sleep to 538.761103ms

I had this same issue with GoogleDrive, the commands I added that made this go away was one of these (not sure which):

--retries=1 --drive-pacer-min-sleep=0ms

Thank you @kylek29 I'm seeing more success now!

I also found a thread that seems to mention the same issues and suggestions here: Understanding Pacer behavior with Google Drive - #29 by phatmandrake will dig in more to understand exactly why this is working better, but I appreciate your suggestion.

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.