Slow transfer: google drive (gdrive) - blackhost - dropbox with 1mb/s

Help and Support
1

What is the problem you are having with rclone?

Hi community!

I need your help to transfer my stuff from google drive to dropbox. Therefore I ordered a blackhost UNM Core (was a recommendation from the rclone community) located in Amsterdam with 1 Gbps bandwidth and get really SLOW transfer speeds :frowning:

Transferred: 95.238 GiB / 95.238 GiB, 100%, 1.036 MiB/s, ETA 0s
Transferred: 30 / 30, 100%
Elapsed time: 8h24m51.5s

Any suggestions? This speed really hurts and woud take months to transfer my stuff .... command improvements? other unmetered server suggestions? THX

Run the command 'rclone version' and share the full output of the command.

rclone v1.62.2
- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 5.15.0-58-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.20.2
- go/linking: static
- go/tags: none

Which cloud storage system are you using? (eg Google Drive)

  • google drive (gdrive / gsuite)

  • dropbox

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone sync gdrive: dropbox: --transfers 12 --order-by modtime,desc --checkers 12 --tpslimit 12  --cutoff-mode soft --dropbox-batch-mode async --fast-list --checksum --dropbox-batch-size 1000 --dropbox-batch-timeout 10s --bwlimit 50M:60M --progress --ignore-existing --bind IPSERVER --verbose

The rclone config contents with secrets removed.

[dropbox]
type = dropbox
client_id = XXX
client_secret = XXX
token = {"access_token":"XXX","expiry":"2023-06-30T06:11:36.828976018Z"}

[gdrive]
type = drive
client_id = XXX
client_secret = XXX
scope = drive
token = {"access_token":"XXX","expiry":"2023-06-30T05:49:58.092855961Z"}
team_drive =

THX for your support!

2

You are most likely throttled by either google, dropbox or both.

Post DEBUG log so we can investigate.

3

Try this

--disable-http2

This stops rclone from trying to use HTTP/2 if available.

4

thx for your support! There was a speed increase but for me still slow ... I think blackhost is slow ??? ... any suggestion for a faster unmetered server? Hetzner just provide 30TB a month ....

Transferred:       95.261 GiB / 95.261 GiB, 100%, 17.076 MiB/s, ETA 0s
Transferred:           30 / 30, 100%
Elapsed time:   1h10m45.7s
5

In my case adding --bind myserverip helped

6

the transfer speed increased a little bit, but is still slow. Which VPS did you use?

7

I had two servers, one from Hetzner and one from Netcup
If they were running at the same time I got banned by Google reaching 10TB rolling download in 24 hours.
Then I stopped Netcup and did all the migration with Hetzner, I have a dedicated / auction box at Hetzner
and a root server (RS 1000) at Netcup
With netcup I had the root server, and got 75MB/sec, which was running for a few days, then it went back down to 100KB/sec. So I stopped it. Since that I haven't tried.

Just use the --bind option, and --disable-http2

8

today I trasfered a part of my stuff via Hetzner Cloud and archived following transfer rates with this command:

rclone sync gdrive: dropbox: --transfers 12 --order-by modtime,desc --checkers 12 --tpslimit 12  --cutoff-mode soft --dropbox-batch-mode async --fast-list --checksum --dropbox-batch-size 1000 --dropbox-batch-timeout 10s --bwlimit 60M:70M --progress --ignore-existing --bind XXX --verbose --disable-http2 --log-file /logs/rclone_sync.log

Transferred:        3.932 TiB / 3.932 TiB, 100%, 17.254 MiB/s, ETA 0s
Errors:                15 (no need to retry)
Checks:                 9 / 9, 100%
Transferred:         1869 / 1869, 100%
Elapsed time:   6h25m17.7s
9

I can't recommend black.host - really bad transfer rates so far from gdrive to dropbox with the same rcloaud command:

Transferred:      540.943 GiB / 3.152 TiB, 17%, 9.514 MiB/s, ETA 3d8h18m
Transferred:          635 / 2719, 23%
Elapsed time:  14h33m28.6s
10

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.