Rclone sync between Google Cloud and B2 hung

Help and Support
1

What is the problem you are having with rclone?

I’m running rclone sync from a GCS bucket to B2 and it stalls indefinitely after listing the source files. CPU usage remains at ~0% and no progress is made beyond the initial listing. It stays stuck making no checks.

Transferred:          0 B / 0 B, -, 0 B/s, ETA -
Checks:              0 / 0, -, Listed 115981
Elapsed time:       XXmXXs

rclone lsd and rclone ls work fine on both remotes.

Run the command 'rclone version' and share the full output of the command.

rclone v1.70.3
- os/version: darwin 15.5 (64 bit)
- os/kernel: 24.5.0 (arm64)
- os/type: darwin
- os/arch: arm64 (ARMv8 compatible)
- go/version: go1.24.4
- go/linking: dynamic
- go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

Google Cloud Storage
Backblaze B2

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync gcp:redacted.appspot.com/ b2-backup:gcp-backup/storage/ --checkers=128 --transfers=32 --gcs-service-account-file=/Users/luke/rclone/rclone-backup-sa.json --timeout=30s --low-level-retries=1 --retries=1 --fast-list --log-level=DEBUG

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[b2-backup]
type = b2
account = XXX
key = XXX

[gcp]
type = google cloud storage
project_number = XXX
service_account_file = /Users/luke/rclone/rclone-backup-sa.json
location = eu

A log from the command that you were trying to run with the -vv flag

2025/07/18 16:03:27 DEBUG : Creating backend with remote "gcp:redacted.appspot.com/"
2025/07/18 16:03:27 DEBUG : Using config file from "/Users/luke/.config/rclone/rclone.conf"
2025/07/18 16:03:27 DEBUG : gcp: detected overridden config - adding "{n-Nta}" suffix to name
2025/07/18 16:03:27 DEBUG : fs cache: renaming cache item "gcp:redacted.appspot.com/" to be canonical "gcp{n-Nta}:redactedappspot.com"
2025/07/18 16:03:27 DEBUG : Creating backend with remote "b2-backup:gcp-backup/storage/"
2025/07/18 16:03:28 DEBUG : fs cache: renaming cache item "b2-backup:gcp-backup/storage/" to be canonical "b2-backup:gcp-backup/storage"
2025/07/18 16:04:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:       1m0.0s

2025/07/18 16:05:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:       2m0.0s

2025/07/18 16:06:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      2m59.9s

2025/07/18 16:07:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      3m59.9s

2025/07/18 16:08:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:       5m0.0s

2025/07/18 16:09:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:       6m0.0s

2025/07/18 16:10:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:       7m0.0s

2025/07/18 16:11:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:       8m0.0s

2025/07/18 16:12:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:       9m0.0s

2025/07/18 16:13:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      10m0.0s

2025/07/18 16:14:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      11m0.0s

2025/07/18 16:15:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      12m0.0s

2025/07/18 16:16:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      13m0.0s

2025/07/18 16:17:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      14m0.0s

2025/07/18 16:18:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      15m0.0s

2025/07/18 16:19:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      16m0.0s

2025/07/18 16:20:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      17m0.0s

2025/07/18 16:21:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      18m0.0s

2025/07/18 16:22:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      19m0.0s

2025/07/18 16:23:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      20m0.0s

2025/07/18 16:24:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      21m0.0s

2025/07/18 16:25:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      22m0.0s

2025/07/18 16:26:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      23m0.0s

2025/07/18 16:27:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      24m0.0s

2025/07/18 16:28:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      25m0.0s

2025/07/18 16:29:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      26m0.0s

2025/07/18 16:30:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      27m0.0s

2025/07/18 16:31:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      28m0.0s

2025/07/18 16:32:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      29m0.0s

2025/07/18 16:33:28 NOTICE: 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 0 / 0, -, Listed 115981
Elapsed time:      30m0.0s
2

welcome to the forum,

i believe that issue has been reported many times in the forum recently.
i think there is a github issue about it and perhaps a beta to test

3

It seems the related to the usage of --fast-list. If I issue the same command without that option it runs in under 2 seconds. With it, it just hangs, even on a much smaller bucket.

Without --fast-list:

2025/07/19 09:15:52 DEBUG : Waiting for deletions to finish
2025/07/19 09:15:52 INFO  : There was nothing to transfer
2025/07/19 09:15:52 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:              4104 / 4104, 100%, Listed 8232
Elapsed time:         1.6s

2025/07/19 09:15:52 DEBUG : 19 go routines active

With --fast-list:

2025/07/19 09:16:04 DEBUG : Creating backend with remote "gcp-redacted:redacted-backup/firestore"
2025/07/19 09:16:04 DEBUG : Using config file from "/Users/luke/.config/rclone/rclone.conf"
2025/07/19 09:16:04 DEBUG : gcp-redacted: detected overridden config - adding "{n-Nta}" suffix to name
2025/07/19 09:16:04 DEBUG : fs cache: renaming cache item "gcp-redacted:redacted-backup/firestore" to be canonical "gcp-redacted{n-Nta}:redacted-backup/firestore"
2025/07/19 09:16:04 DEBUG : Creating backend with remote "b2-redacted-backup:redacted-gcp-backup/firestore/"
2025/07/19 09:16:05 DEBUG : fs cache: renaming cache item "b2-redacted-backup:redacted-gcp-backup/firestore/" to be canonical "b2-redacted-backup:redacted-gcp-backup/firestore"
2025/07/19 09:16:06 DEBUG : 2025-07-19T00:02:08.074Z/2025-07-19T00:02:08.074Z.overall_export_metadata: Size and modification time the same (differ by 0s, within tolerance 1ms)
2025/07/19 09:16:06 DEBUG : 2025-07-16T12:37:20.145Z/2025-07-16T12:37:20.145Z.overall_export_metadata: Size and modification time the same (differ by 0s, within tolerance 1ms)
2025/07/19 09:16:06 DEBUG : 2025-07-16T12:37:20.145Z/2025-07-16T12:37:20.145Z.overall_export_metadata: Unchanged skipping
2025/07/19 09:16:06 DEBUG : 2025-07-19T00:02:08.074Z/2025-07-19T00:02:08.074Z.overall_export_metadata: Unchanged skipping
2025/07/19 09:16:06 DEBUG : 2025-07-17T00:02:27.963Z/2025-07-17T00:02:27.963Z.overall_export_metadata: Size and modification time the same (differ by 0s, within tolerance 1ms)
2025/07/19 09:16:06 DEBUG : 2025-07-17T00:02:27.963Z/2025-07-17T00:02:27.963Z.overall_export_metadata: Unchanged skipping
2025/07/19 09:16:06 DEBUG : 2025-07-18T00:01:53.616Z/2025-07-18T00:01:53.616Z.overall_export_metadata: Size and modification time the same (differ by 0s, within tolerance 1ms)
2025/07/19 09:16:06 DEBUG : 2025-07-18T00:01:53.616Z/2025-07-18T00:01:53.616Z.overall_export_metadata: Unchanged skipping
2025/07/19 09:17:05 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 4 / 4, 100%, Listed 8208
Elapsed time:       1m0.0s

2025/07/19 09:18:05 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 4 / 4, 100%, Listed 8208
Elapsed time:       2m0.0s

2025/07/19 09:19:05 INFO  : 
Transferred:   	          0 B / 0 B, -, 0 B/s, ETA -
Checks:                 4 / 4, 100%, Listed 8208
Elapsed time:       3m0.0s
4

Dropping the docker image version to 1.69.3 from latest seems to have done the trick.

5

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.