Slow upload speed using CloudSync (rclone TrueNas) to upload to Dropbox

What is the problem you are having with rclone?

I've been struggling with very slow upload speed using CloudSync (rclone) in Truenas to Dropbox in the last 4-6 months.
First I was thinking it could be the Truenas version, so I updated to the latest stable version (TrueNAS-13.0-U1.1) and even tried to update the rclone binary but it didn't worked.
I'm using CloudSync (task in Truenas) with a gigabit connection and in the beginning I was uploading with all the bandwidth speed available to the Truenas server at the moment. As a I usually upload when we have no internet activity, so my Truenas was capable to use all the bandwidth available to the server at that moment.

Checking some screenshots when deploying Cloydsync in Truenas even during the "work hour" I was able to peak such as 23.576 MBytes/s and an average 8.000 Mbytes/s with 4 or more active TASKS uploads. This peak speed was from a single file with 29.602 GBytes:
image

The image bellow is from my biggest CloudSync task and here's the info when the task finished:

2021/10/03 06:52:59 INFO :
Transferred: 392.871G / 393.176 GBytes, 100%, 19.038 MBytes/s, ETA 16s
Checks: 40 / 40, 100%
Transferred: 39 / 40, 98%
Elapsed time: 5h52m57.9s

But even when trying multiple CloudSync task at the same moment as this specific I could peak an average 4-8 MBytes/s for each.

Now with the same setup I can only peak something like 700.000KiB/s

I tried and research a lot in the TrueNas forum and couldn't find the source of the problem. There's most people with the same problem also have a route problem with their ISP and Dropbox.
I don't think it's an ISP problem because my server and other computers are in the same network and share the same route. If I get a large file and upload it using a task in TrueNas it will peak a slow speed but if I use a browser in a windows machine even using WiFi it will upload maxed to the limit of the connection.

ps: I'm posting screenshot's because it's easily to me to display the info. TrueNas saves the credentials and config for the task in their db so only when the task is running it creates a temp file so rclone could read from it. Even running directly in the cli I could achieve full speed.

Run the command 'rclone version' and share the full output of the command.

ps: TrueNAS-13.0-U1.1

root@freenas:~ # rclone --version
rclone v1.59.1
* os/version: freebsd 13.1-release (64 bit)
* os/kernel: 13.1-release (amd64)
* os/type: freebsd
* os/arch: amd64
* go/version: go1.18.5
* go/linking: static
* go/tags: none

Which cloud storage system are you using? (eg Google Drive)

```Dropbox Plus - 2TB with Extended Version History``

The command you were trying to run (eg rclone copy /tmp remote:tmp)

/usr/local/bin/rclone --config pgsql.conf -v --stats 1s --transfers 10 --exclude .zfs --exclude .zfs/** sync /mnt/main/EL/pgsql/ remote:/Apps/sync-freenas/EL/el-pgsql01

The rclone config contents with secrets removed.

[remote]
token = ********
client_id = ********
client_secret = ********
type = dropbox
folder = /Apps/sync-freenas/EL/el-pgsql01
chunk_size = 96M

A log from the command with the -vv flag:

/usr/local/bin/rclone --config pgsql.conf -vv --stats 1s --transfers 10 --exclude .zfs --exclude .zfs/** sync /mnt/main/contractor/pgsql/ remote:/Apps/sync-freenas/contractor/contractor-pgsql01
2022/08/21 10:56:02 DEBUG : rclone: Version "v1.59.1" starting with parameters ["/usr/local/bin/rclone" "--config" "pgsql.conf" "-vv" "--stats" "1s" "--transfers" "10" "--exclude" ".zfs" "--exclude" ".zfs/snapshot" "sync" "/mnt/main/contractor/pgsql/" "remote:/Apps/sync-freenas/contractor/contractor-pgsql01"]
2022/08/21 10:56:02 DEBUG : Creating backend with remote "/mnt/main/contractor/pgsql/"
2022/08/21 10:56:02 DEBUG : Using config file from "/mnt/main/paulo.pera/pgsql.conf"
2022/08/21 10:56:02 DEBUG : Creating backend with remote "remote:/Apps/sync-freenas/contractor/contractor-pgsql01"
2022/08/21 10:56:03 DEBUG : Dropbox root '': Using root namespace "175427111"
2022/08/21 10:56:03 DEBUG : fs cache: renaming cache item "remote:/Apps/sync-freenas/contractor/contractor-pgsql01" to be canonical "remote:Apps/sync-freenas/contractor/contractor-pgsql01"
2022/08/21 10:56:04 DEBUG : .ssh/authorized_keys: Size and modification time the same (differ by 162.52463ms, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : old/data83.tar.gz: Size and modification time the same (differ by 277.841ms, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : old/postgresql.conf: Size and modification time the same (differ by 238.96ms, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : old/pg_hba.conf: Size and modification time the same (differ by 51.667ms, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : old/postgresql83: Size and modification time the same (differ by -168.749ms, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/data83-old_before_migration_to_11.tar.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_db2-Saturday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_db2-Sunday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_db2-Monday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_db2-Friday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_db2-Tuesday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_test-db-Monday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_test-db-Thursday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_test-db-Saturday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_test-db-Tuesday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_test-db_old-Friday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_test-db-Friday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_test-db_old-Saturday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_test-db_old-Sunday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_db2-Wednesday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_test-db_old-Thursday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_test-db-Wednesday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_test-db_old-Monday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_test-db_old-Wednesday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_db1-Friday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_db1-Monday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_db1-Saturday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_db1-Sunday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_db1-Thursday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_test-db-Sunday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_test-db_old-Tuesday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_db1-Wednesday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_db2-Thursday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/test-db_db1-Tuesday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:04 DEBUG : 83/leia-me.txt: Size and modification time the same (differ by 460.646ms, within tolerance 1s)
2022/08/21 10:56:04 INFO  :
Transferred:              0 B / 0 B, -, 0 B/s, ETA -
Checks:                35 / 35, 100%
contractorapsed time:         1.9s

2022/08/21 10:56:05 DEBUG : 11/test-dbprh-Thursday.sql.gz: Size and modification time the same (differ by 328.652ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/roles-Monday.sql: Size and modification time the same (differ by -77.096ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/roles-Saturday.sql: Size and modification time the same (differ by -301.091ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/roles-Monday.sql.gz: Size and modification time the same (differ by 86.199ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/roles-Saturday.sql.gz: Size and modification time the same (differ by 109.511ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/roles-Sunday.sql: Size and modification time the same (differ by -317.839ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/roles-Sunday.sql.gz: Size and modification time the same (differ by 320.928ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/roles-Thursday.sql: Size and modification time the same (differ by 104.511ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/roles-Thursday.sql.gz: Size and modification time the same (differ by 5.011ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/roles-Tuesday.sql: Size and modification time the same (differ by -80.542ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/roles-Tuesday.sql.gz: Size and modification time the same (differ by -223.338ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/roles-Wednesday.sql: Size and modification time the same (differ by 249.784ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/roles-Wednesday.sql.gz: Size and modification time the same (differ by 60.28ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db7-20210414-2300.dump.tar.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db7-20210415-2300.dump.tar.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db7-20210416-2300.dump.tar.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db7-Friday.dump: Size and modification time the same (differ by -105.208ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db7-Friday.sql.gz: Size and modification time the same (differ by 119.968ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db7-Monday.dump: Size and modification time the same (differ by 61.463ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db7-Monday.sql.gz: Size and modification time the same (differ by -434.155ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db7-Saturday.dump: Size and modification time the same (differ by -25.592ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db7-Saturday.sql.gz: Sizes differ (src 8470056 vs dst 8432186)
2022/08/21 10:56:05 DEBUG : 11/db7-Sunday.dump: Size and modification time the same (differ by 10.73ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db7-Sunday.sql.gz: Size and modification time the same (differ by 170.926ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db7-Thursday.dump: Size and modification time the same (differ by -211.684ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db7-Thursday.sql.gz: Size and modification time the same (differ by -57.13ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db7-Tuesday.dump: Size and modification time the same (differ by -253.985ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db7-Tuesday.sql.gz: Size and modification time the same (differ by -429.163ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db7-Wednesday.dump: Size and modification time the same (differ by 411.606ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db7-Wednesday.sql.gz: Size and modification time the same (differ by 38.931ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db6-Friday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db6-Monday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db6-Saturday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db6-Sunday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db6-Thursday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db6-Tuesday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db6-Wednesday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/sp-avare-pm_test-db_db1-20220211-2000.dump-size-11226921646-md5-f894125c582395e34198797ca1d122ea-movimdetalhado-limpeza: Size and modification time the same (differ by 413.724ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/template0-Friday.sql.gz: Size and modification time the same (differ by 162.47ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/template0-Monday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/template0-Saturday.sql.gz: Size and modification time the same (differ by 453.961ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/template0-Sunday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/template0-Thursday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/template0-Tuesday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/template0-Wednesday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/template1-Friday.sql.gz: Size and modification time the same (differ by 14.533ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/template1-Monday.sql.gz: Size and modification time the same (differ by 437.948ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/template1-Saturday.sql.gz: Size and modification time the same (differ by 322.89ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/template1-Sunday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/template1-Thursday.sql.gz: Size and modification time the same (differ by 478.231ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/template1-Tuesday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/template1-Wednesday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/Tuesday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-20210417-2300.dump.tar.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-20210418-2300.dump.tar.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-20210419-2300.dump.tar.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-20210420-2300.dump.tar.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-20210421-2300.dump.tar.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-20210422-2300.dump.tar.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-Friday.dump: Size and modification time the same (differ by -119.696ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-Friday.sql.gz: Size and modification time the same (differ by -315.85ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-Monday.dump: Size and modification time the same (differ by -46.681ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-Monday.sql.gz: Size and modification time the same (differ by -238.726ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-Saturday.dump: Size and modification time the same (differ by -273.1ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-Saturday.sql.gz: Sizes differ (src 286062162 vs dst 286035998)
2022/08/21 10:56:05 DEBUG : 11/db5-Sunday.dump: Size and modification time the same (differ by -293.49ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-Sunday.sql.gz: Size and modification time the same (differ by -206.69ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-Thursday.dump: Size and modification time the same (differ by 134.097ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-Thursday.sql.gz: Size and modification time the same (differ by -281.358ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-Tuesday.dump: Size and modification time the same (differ by -39.78ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-Tuesday.sql.gz: Size and modification time the same (differ by -135.426ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-Wednesday.dump: Size and modification time the same (differ by 274.162ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5-Wednesday.sql.gz: Size and modification time the same (differ by 244.176ms, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5_old-Friday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5_old-Monday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5_old-Saturday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5_old-Sunday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5_old-Thursday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5_old-Tuesday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/db5_old-Wednesday.sql.gz: Size and modification time the same (differ by 0s, within tolerance 1s)
2022/08/21 10:56:05 DEBUG : 11/postgres-Saturday.sql.gz: dropbox = b6ab37fb936587f3c77364f9000d881a32d3f55c32a6158ca05ff89d565341b4 (Local file system at /mnt/main/contractor/pgsql/)
2022/08/21 10:56:05 DEBUG : 11/postgres-Saturday.sql.gz: dropbox = 09c949c6f13a6e3321767fe79ebc6f084bb54d12cc8ccb801631501f191b1402 (Dropbox root 'Apps/sync-freenas/contractor/contractor-pgsql01')
2022/08/21 10:56:05 DEBUG : 11/postgres-Saturday.sql.gz: dropbox differ
2022/08/21 10:56:05 DEBUG : 11/test-db-Saturday.sql.gz: Uploading chunk 1/2
2022/08/21 10:56:05 INFO  :
Transferred:           60 KiB / 27.894 GiB, 0%, 0 B/s, ETA -
Checks:               371 / 372, 100%
Transferred:            0 / 8, 0%
contractorapsed time:         2.9s
Checking:
* 11/db3-Saturday.sql.gz: checking
Transferring:
*                11/test-db-Saturday.sql.gz:  0% /119.019Mi, 0/s, -
*                11/test-dbpsg-Saturday.sql.gz:  0% /51.798Mi, 0/s, -
*                11/test-dbprh-Saturday.sql.gz:  0% /301.890Mi, 0/s, -
*                11/test-db_db1-Friday.sql.gz:  0% /13.547Gi, 0/s, -
*              11/test-db_db1-Saturday.sql.gz:  0% /13.564Gi, 0/s, -
*            11/db7-Saturday.sql.gz:  0% /8.078Mi, 0/s, -
*                    11/db5-Saturday.sql.gz:  0% /272.810Mi, 0/s, -
*                   11/postgres-Saturday.sql.gz:  0% /47.365Mi, 0/s, -

2022/08/21 10:56:05 DEBUG : 11/test-db_db1-Friday.sql.gz: Uploading chunk 1/145
2022/08/21 10:56:05 DEBUG : 11/db5-Saturday.sql.gz: Uploading chunk 1/3
2022/08/21 10:56:06 DEBUG : 11/test-dbprh-Saturday.sql.gz: Uploading chunk 1/4
2022/08/21 10:56:06 DEBUG : 11/test-db_db1-Saturday.sql.gz: Uploading chunk 1/145
2022/08/21 10:56:06 DEBUG : 11/test-dbpsg-Saturday.sql.gz: Uploading chunk 1/1
2022/08/21 10:56:06 DEBUG : 11/postgres-Saturday.sql.gz: Uploading chunk 1/1
2022/08/21 10:56:06 DEBUG : 11/db7-Saturday.sql.gz: Uploading chunk 1/1
2022/08/21 10:56:06 DEBUG : 11/db3_db4-Saturday.sql.gz: dropbox = c38c474a235261dd7714cb184b11e2c1b6d89f0d52281311ebdbdadbe79ca602 (Local file system at /mnt/main/contractor/pgsql/)
2022/08/21 10:56:06 DEBUG : 11/db3_db4-Saturday.sql.gz: dropbox = d541f6959386fa321226e9f4bcd5e1d06de539a4d77017def5b1bca9bc460416 (Dropbox root 'Apps/sync-freenas/contractor/contractor-pgsql01')
2022/08/21 10:56:06 DEBUG : 11/db3_db4-Saturday.sql.gz: dropbox differ
2022/08/21 10:56:06 DEBUG : Dropbox root 'Apps/sync-freenas/contractor/contractor-pgsql01': Waiting for transfers to finish
2022/08/21 10:56:13 INFO  :
Transferred:        8.402 MiB / 28.161 GiB, 0%, 955.480 KiB/s, ETA 8h34m56s
Checks:               372 / 372, 100%
Transferred:            0 / 9, 0%
contractorapsed time:        10.9s
Transferring:
*                11/test-db-Saturday.sql.gz:  1% /119.019Mi, 139.496Ki/s, 14m24s
*                11/test-dbpsg-Saturday.sql.gz:  1% /51.798Mi, 103.499Ki/s, 8m24s
*                11/test-dbprh-Saturday.sql.gz:  0% /301.890Mi, 119.499Ki/s, 42m58s
*                11/test-db_db1-Friday.sql.gz:  0% /13.547Gi, 75.497Ki/s, 52h15m50s
*              11/test-db_db1-Saturday.sql.gz:  0% /13.564Gi, 131.499Ki/s, 30h2m30s
*            11/db7-Saturday.sql.gz:  9% /8.078Mi, 91.499Ki/s, 1m22s
*                    11/db5-Saturday.sql.gz:  0% /272.810Mi, 119.502Ki/s, 38m48s
*                   11/postgres-Saturday.sql.gz:  1% /47.365Mi, 87.502Ki/s, 9m5s
* 11/db3-Saturday.sql.gz:  0% /274.100Mi, 113.697Ki/s, 41m1s

^C2022/08/21 10:56:14 INFO  : Signal received: interrupt
2022/08/21 10:56:14 INFO  : Dropbox root 'Apps/sync-freenas/contractor/contractor-pgsql01': Commiting uploads - please wait...
2022/08/21 10:56:14 INFO  : Exiting...

hi,

is that a dropbox specific flag?
folder =

might try these flags from

# Set the tpslimit
--tpslimit 12
# Set the tpslimit-burst
--tpslimit-burst 12
# Disable HTTP2
--disable-http2

About the Dropbox flag: I think the TrueNas CloudSync (rclone) uses it to specify the remote folder which the Dropbox APP (API) has access.

Using the flags as suggested:

Can I suppress some Transferring info and post only the "INFO"?
I did read all the info in the -vv and it was like the same as the original post differing only the bellow info.

2022/08/21 11:47:33 INFO  :
Transferred:       57.996 MiB / 28.161 GiB, 0%, 1.022 MiB/s, ETA 7h49m29s
Checks:               372 / 372, 100%
Transferred:            0 / 9, 0%
Elapsed time:       1m1.9s

have you tested another backend, such as gdrive or s3?

need to always post the exact command for each log.

Using the flags as suggested:

/usr/local/bin/rclone --config pgsql.conf -vv --stats 1s --transfers 4 --exclude .zfs --tpslimit 12 --tpslimit-burst 12 --disable-http2 --exclude .zfs/** sync /mnt/main/pgsql/ remote:/Apps/sync-freenas/pgsql01

The output:
As the Body is limited to 32000 characters and I entered 122085. I will upload a log file
rclone-vvv.txt (121.4 KB)

I didn't tested another backend because the fastest (no pun intended) so far was Dropbox and I've One year file version history on my plan (which doesn't exist anymore).
If I use Dropbox I can upload the same file 365x and I will have 365 versions of the file.
I will try to run a test with another backend.

I don't know what happened but today I was going to look at this issue again and then just checking the task at TrueNas it started uploading at full speed (available to the server) again. The top speed I could see was 186.12M Bits/sec.
I did nothing to my config or setup.
I saw something another day that could be a DNS cache problem but I double checked and the server try to reach the same IP as the browser to upload.
I'll keep an eye on it from now and close the topic.

Thanks for the help!

The problem is back again. I'll try to investigate further and post here all the info I can get.

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.