Slow Upload to Dropbox Remote

Thunder · August 9, 2022, 4:58pm

What is the problem you are having with rclone?

Uploading to Dropbox is very slow. It starts with 40MB/s and then subsequently decreases until it is in low single digits. Sometimes it stays in the 10- 20MB Range, but typically it falls below. I tried the things described here : Dropbox, but it did not help. Also i noticed that everytime 128MB are uploaded nothing happens for about 5 Seconds.
I have a Hetzner Server with Gigabit Uplink, and I had no Problems uploading to google with about 100MB/s constant speed.
Can someone help?

Run the command 'rclone version' and share the full output of the command.

- os/version: ubuntu 22.04 (64 bit)
- os/kernel: 5.15.0-41-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.18.3
- go/linking: static
- go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Dropbox Business

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone copy /mnt/local/FILEXYZ DB-Media-crypt: -vvP --fast-list --dropbox-batch-mode sync --transfers 64  --dropbox-chunk-size 128M --buffer-size 128M  --tpslimit 16 --tpslimit-burst 16

The rclone config contents with secrets removed.

[DB-Media]
type = dropbox
client_id = XXXX
client_secret = XXX
token = XXX
[DB-Media-crypt]
type = crypt
remote = DB-Media:SB-Data
password = XYZ
password2 = XYZ

A log from the command with the `-vv` flag

rclone copy /mnt/local/Media/Movies/Movies/BLABLA/ DB-Media-crypt: -vP --fast-list --dropbox-batch-mode sync --transfers 64  --dropbox-chunk-size 128M --buffer-size 128M  -vv --tpslimit 16 --tpslimit-burst 16
2022/08/09 18:48:30 INFO  : Starting transaction limiter: max 16 transactions/s with burst 16
2022/08/09 18:48:30 DEBUG : rclone: Version "v1.59.0" starting with parameters ["rclone" "copy" "/mnt/local/Media/Movies/Movies/BLABLA/" "DB-Media-crypt:" "-vP" "--fast-list" "--dropbox-batch-mode" "sync" "--transfers" "64" "--dropbox-chunk-size" "128M" "--buffer-size" "128M" "-vv" "--tpslimit" "16" "--tpslimit-burst" "16"]
2022/08/09 18:48:30 DEBUG : Creating backend with remote "/mnt/local/Media/Movies/Movies/BLABLA/"
2022/08/09 18:48:30 DEBUG : Using config file from "/home/sbuser/.config/rclone/rclone.conf"
2022/08/09 18:48:30 DEBUG : Creating backend with remote "DB-Media-crypt:"
2022/08/09 18:48:30 DEBUG : Creating backend with remote "DB-Media:SB-Data"
2022/08/09 18:48:30 DEBUG : DB-Media: detected overridden config - adding "{GLfj_}" suffix to name
2022/08/09 18:48:30 DEBUG : fs cache: renaming cache item "DB-Media:SB-Data" to be canonical "DB-Media{GLfj_}:SB-Data"
2022-08-09 18:48:30 DEBUG : Encrypted drive 'DB-Media-crypt:': Waiting for checks to finish
2022-08-09 18:48:30 DEBUG : Encrypted drive 'DB-Media-crypt:': Waiting for transfers to finish
2022-08-09 18:48:31 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 1/51
2022-08-09 18:48:36 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 2/51
2022-08-09 18:48:44 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 3/51
2022-08-09 18:48:48 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 4/51
2022-08-09 18:48:56 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 5/51
2022-08-09 18:49:03 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 6/51
2022-08-09 18:49:10 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 7/51
2022-08-09 18:49:13 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 8/51
2022-08-09 18:49:23 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 9/51
2022-08-09 18:49:30 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 10/51
2022-08-09 18:49:37 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 11/51
2022-08-09 18:49:46 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 12/51
2022-08-09 18:49:52 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 13/51
2022-08-09 18:50:03 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 14/51
2022-08-09 18:50:17 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 15/51
2022-08-09 18:50:22 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 16/51
2022-08-09 18:50:29 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 17/51
2022-08-09 18:50:34 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 18/51
2022-08-09 18:50:43 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 19/51
2022-08-09 18:50:52 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 20/51
2022-08-09 18:50:57 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 21/51
2022-08-09 18:51:03 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 22/51
2022-08-09 18:51:10 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 23/51
2022-08-09 18:51:15 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 24/51
2022-08-09 18:51:25 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 25/51
2022-08-09 18:51:32 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 26/51
2022-08-09 18:51:42 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 27/51
2022-08-09 18:51:49 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 28/51
2022-08-09 18:51:59 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 29/51
2022-08-09 18:52:03 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 30/51
2022-08-09 18:52:13 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 31/51
2022-08-09 18:52:19 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 32/51
2022-08-09 18:52:24 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 33/51
2022-08-09 18:52:29 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 34/51
2022-08-09 18:52:38 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 35/51
2022-08-09 18:52:48 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 36/51
2022-08-09 18:52:51 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 37/51
2022-08-09 18:52:57 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 38/51
2022-08-09 18:53:09 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 39/51
2022-08-09 18:53:12 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 40/51
2022-08-09 18:53:19 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 41/51
2022-08-09 18:53:27 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 42/51
2022-08-09 18:53:35 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 43/51
2022-08-09 18:53:42 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 44/51
2022-08-09 18:53:46 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 45/51
2022-08-09 18:53:55 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 46/51
2022-08-09 18:54:06 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 47/51
2022-08-09 18:54:14 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 48/51
2022-08-09 18:54:24 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 49/51
2022-08-09 18:54:27 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 50/51
2022-08-09 18:54:34 DEBUG : n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks: Uploading chunk 51/51
2022-08-09 18:54:41 DEBUG : Dropbox root 'SB-Data': Adding "/SB-Data/n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks" to batch
2022-08-09 18:54:42 DEBUG : Dropbox root 'SB-Data': Batch idle for 500ms so committing
2022-08-09 18:54:42 DEBUG : Dropbox root 'SB-Data': Committing sync batch length 1 starting with: /SB-Data/n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks
2022-08-09 18:54:43 DEBUG : Dropbox root 'SB-Data': Committed sync batch length 1 starting with: /SB-Data/n3spijela95clj7uri6gkdtl1rkt23a0kmrqru1lgbchukjd831na9rc4r2q3h5o6cl3qpuo5ef09sb0m64thlhhgr4q24pfcerpqldv8er1mt9nbmkknk26mip99js0a9pifqe3masoojn5muupt3lqks
2022-08-09 18:54:43 DEBUG : BLABLA.mkv: dropbox = 8a367eb2877c7d9004d4419330a79af7d4a6d16198dd51c58ecbfcf018746b14 OK
2022-08-09 18:54:43 INFO  : BLABLA.mkv: Copied (new)
Transferred:        6.340 GiB / 6.340 GiB, 100%, 13.838 MiB/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:      6m13.2s
2022/08/09 18:54:43 INFO  :
Transferred:        6.340 GiB / 6.340 GiB, 100%, 13.838 MiB/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:      6m13.2s

2022/08/09 18:54:43 DEBUG : 11 go routines active
2022/08/09 18:54:43 INFO  : Dropbox root 'SB-Data': Commiting uploads - please wait...

Thunder · August 9, 2022, 6:22pm

Interesting thing I just noticed while trying to fix this:

When I ramp up --transfers to 16 it takes more files at the same time for upload and reaches full 100MB/s (fluctuating) so could it be that this is some kind of max upload speed limitation per file?

Edit: Even with this setting is the speed continously decreasing... Something very strange happens here.. It starts with almost full speed now (about 100MB/s) and then it is fluctuating and decreasing more and more... after short time it is down to 80 MB/s ..

ncw · August 9, 2022, 8:41pm

Try adding --tpslimit 12

This will help avoid Dropbox rate limiting which is sounds like has kicked in.

I'm sure @Animosity022 will be along in a moment with some better tips!

Thunder · August 9, 2022, 8:51pm

I also tried --tpslimit 12, but i could not see any changes.

Still starts with 30 -40 MB/s and after few seconds down under 20 MB/s..

Animosity022 · August 9, 2022, 9:17pm

I really never watch my Dropbox upload as it definitely does not push as well as Google Drive does.

I get around the same performance if I watch an upload as well as I have only found maxing my gigabit by multiple transfers rather than being able to ramp up a single transfer.

I usually get around 20MB/s generally for uploads.

rclone copy -P jellyfish-400-mbps-4k-uhd-hevc-10bit.mkv DB:
Transferred:   	    1.402 GiB / 1.402 GiB, 100%, 21.125 MiB/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:      1m11.1s

TPS 12 seems to be the sweet spot as well for each app registration that you have.

Thunder · August 10, 2022, 5:09am

So you would say this is normal behaviour and nothing to worry?

Is it the same with downloading or do you get better speeds when you download something from dropbox?

Do you have any recommendation of parameters for uploading?

Animosity022 · August 10, 2022, 11:15am

When I migrated my data from Google Drive to Dropbox, I used multiple transfers 8ish and maxed my gigabit for days when I was moving things and had no problems and since I never really watched my upload as my mount handles it all so it seems "normal" from my testing the today/yesterday.

I always seem to be able to max download for my gigabit majority of the time and much use case is streaming and never hit a problem with anything I need to stream anyway.

felix@gemini:/data$ rclone copy jellyfish-400-mbps-4k-uhd-hevc-10bit.mkv DB: -P
Transferred:   	    1.402 GiB / 1.402 GiB, 100%, 25.155 MiB/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:        53.7s
felix@gemini:/data$
felix@gemini:/data$
felix@gemini:/data$
felix@gemini:/data$ ls
jellyfish-400-mbps-4k-uhd-hevc-10bit.mkv  local  rsnapshot  seed  t  test
felix@gemini:/data$ rclone copyto DB:jellyfish-400-mbps-4k-uhd-hevc-10bit.mkv test.mkv -P
Transferred:   	    1.402 GiB / 1.402 GiB, 100%, 65.082 MiB/s, ETA 0s
Transferred:            1 / 1, 100%
Elapsed time:        22.1s

paulo_pera · August 21, 2022, 1:20pm

I've been strugling this speed problem with rclone/Dropbox in the last 4-6 months using CloudSync Task in TrueNAS-13.0-U1.1 with the configuration:
root@freenas:~ # rclone --version
rclone v1.59.1

os/version: freebsd 13.1-release (64 bit)
os/kernel: 13.1-release (amd64)
os/type: freebsd
os/arch: amd64
go/version: go1.18.5
go/linking: static
go/tags: none

First I was thinking it could be the Truenas version, so I updated to the latest stable version (TrueNAS-13.0-U1.1) and even tried to update the rclone binary but it didn't worked.
I'm using CloudSync (task in Truenas) with a gigabit connection and in the beginning I was uploading with all the bandwidth speed available to the Truenas server at the moment. As a I usually upload when we have no internet activity, so my Truenas was capable to use all the bandwidth available to the server at that moment.

Checking some screenshots when deploying Cloydsync in Truenas even during the "work hour" I was able to peak such as 23.576 MBytes/s and an average 8.000 Mbytes/s with 4 or more active TASKS uploads. This peak speed was from a single file with 29.602 GBytes:

The image bellow is from my biggest CloudSync task and here's the info when the task finished:
2021/10/03 06:52:59 INFO :
Transferred: 392.871G / 393.176 GBytes, 100%, 19.038 MBytes/s, ETA 16s
Checks: 40 / 40, 100%
Transferred: 39 / 40, 98%
Elapsed time: 5h52m57.9s
But even when trying multiple CloudSync task at the same moment as this specific I could peak an average 4-8 MBytes/s for each.

Now with the same setup I can only peak something like 700.000KiB/s

I tried and research a lot in the TrueNas forum and couldn't find the source of the problem. There's most people with the same problem also have a route problem with their ISP and Dropbox.
I don't think it's an ISP problem because my server and other computers are in the same network and share the same route. If I get a large file and upload it using a task in TrueNas it will peak a slow speed but if I use a browser in a windows machine even using WiFi it will upload maxed to the limit of the connection.

ps: I'm posting screenshot's because it's easily to me to display the info. TrueNas saves the credentials and config for the task in their db so only when the task is running it creates a temp file so rclone could read from it. Even running directly in the cli I could achieve full speed.

asdffdsa · August 21, 2022, 1:25pm

hello and welcome to the forum,

best to start a new topic,
answer all the questions in the help and support template.
make sure to include the redacted config file, the exact command and a rclone debug log.

paulo_pera · August 21, 2022, 2:19pm

Thank you for the suggestion. Just started a new topic Slow upload speed using CloudSync (rclone TrueNas) to upload to Dropbox

system · September 20, 2022, 2:19pm

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.