What is the problem you are having with rclone?
Rclone upload actual bandwidth usage nearly double bwlimit
What is your rclone version (output from rclone version)
root@Highlander:~# rclone version
rclone v1.55.1
- os/type: linux
- os/arch: amd64
- go/version: go1.16.3
- go/linking: static
- go/tags: none
Which OS you are using and how many bits (eg Windows 7, 64 bit)
UnRaid 6.92
Which cloud storage system are you using? (eg Google Drive)
GD
The command you were trying to run (eg rclone copy /tmp remote:tmp)
I use a script to control a lot of the variables - for speed I've only entered the upload ones
rclone $LocalFilesLocation $RcloneUploadRemoteName:$BackupRemoteLocation $ServiceAccount \
--user-agent="$RcloneUploadRemoteName" \
-vv \
--buffer-size 512M \
--drive-chunk-size 512M \
--tpslimit 8 \
--checkers 8 \
--transfers 4 \
--order-by modtime,$ModSort \
--min-age $MinimumAge \
--exclude *fuse_hidden* \
--exclude *_HIDDEN \
--exclude .recycle** \
--exclude .Recycle.Bin/** \
--exclude *.backup~* \
--exclude *.partial~* \
--drive-stop-on-upload-limit \
--bwlimit 6M \
--bind=192.168.1.78 $DeleteEmpty
The rclone config contents with secrets removed.
[tdrive]
type = drive
scope = drive
service_account_file = /mnt/user/appdata/other/rclone/service_accounts/sa_tdrive_new.json
team_drive = xxxxxxxxxxxxxxxxx
server_side_across_configs = true
[tdrive_vfs]
type = crypt
remote = tdrive:crypt
filename_encryption = standard
directory_name_encryption = true
password = xxxxxxxxxxxxx
password2 = xxxxxxxxxxxxxxxxx
A log from the command with the -vv flag
2021/06/16 08:12:59 INFO :
Transferred: 118.307G / 12.229 TBytes, 1%, 4.269 MBytes/s, ETA 4w6d10h28m2s
Checks: 168 / 172, 98%
Deleted: 84 (files), 0 (dirs)
Renamed: 84
Transferred: 84 / 3937, 2%
Elapsed time: 7h53m0.7s
Checking:
Transferring:
* unfiled/movies/lists/T…] xxxxxxxx.mkv: 94% /6.058G, 1.295M/s, 4m22s
* unfiled/movies/lists/T…xxxxxxxxxxxmkv: 12% /17.816G, 1.115M/s, 3h58m3s
* unfiled/movies/lists/L… xxxxxxxxxx.mkv: 57% /3.430G, 1.073M/s, 23m14s
* unfiled/movies/lists/T…] xxxxxxxxxxx.mkv: 53% /3.547G, 1.070M/s, 26m19s
In my logs, I can see rclone upload adhering to my bwlimt schedule e.g. as I post the limit is "6M" and the upload is staying roughly within this. However, when I check my router, this particular instance (192.168.1.78) is using between 95-105Mbps or 11-13MB/s, which is almost my whole upload speed. This is causing issues for the rest of my network traffic.
I'm pretty sure this is a recent thing as when I last checked my router, rclone uploads bwlimit applied to not just the upload component but the "overhead" as well.
Has something changed, or is there a way for the bwlimit to apply to the whole connection, not just the bwlimit? I can do this at my router end and put a hard cap on, but I'd rather do it within rclone as it's more flexible/easier to do.
Thanks in advance