Rclone upload actual bandwidth usage nearly double bwlimit
root@Highlander:~# rclone version
- os/type: linux
- os/arch: amd64
- go/version: go1.16.3
- go/linking: static
- go/tags: none
I use a script to control a lot of the variables - for speed I've only entered the upload ones
rclone $LocalFilesLocation $RcloneUploadRemoteName:$BackupRemoteLocation $ServiceAccount \ --user-agent="$RcloneUploadRemoteName" \ -vv \ --buffer-size 512M \ --drive-chunk-size 512M \ --tpslimit 8 \ --checkers 8 \ --transfers 4 \ --order-by modtime,$ModSort \ --min-age $MinimumAge \ --exclude *fuse_hidden* \ --exclude *_HIDDEN \ --exclude .recycle** \ --exclude .Recycle.Bin/** \ --exclude *.backup~* \ --exclude *.partial~* \ --drive-stop-on-upload-limit \ --bwlimit 6M \ --bind=192.168.1.78 $DeleteEmpty
[tdrive] type = drive scope = drive service_account_file = /mnt/user/appdata/other/rclone/service_accounts/sa_tdrive_new.json team_drive = xxxxxxxxxxxxxxxxx server_side_across_configs = true [tdrive_vfs] type = crypt remote = tdrive:crypt filename_encryption = standard directory_name_encryption = true password = xxxxxxxxxxxxx password2 = xxxxxxxxxxxxxxxxx
2021/06/16 08:12:59 INFO : Transferred: 118.307G / 12.229 TBytes, 1%, 4.269 MBytes/s, ETA 4w6d10h28m2s Checks: 168 / 172, 98% Deleted: 84 (files), 0 (dirs) Renamed: 84 Transferred: 84 / 3937, 2% Elapsed time: 7h53m0.7s Checking: Transferring: * unfiled/movies/lists/T…] xxxxxxxx.mkv: 94% /6.058G, 1.295M/s, 4m22s * unfiled/movies/lists/T…xxxxxxxxxxxmkv: 12% /17.816G, 1.115M/s, 3h58m3s * unfiled/movies/lists/L… xxxxxxxxxx.mkv: 57% /3.430G, 1.073M/s, 23m14s * unfiled/movies/lists/T…] xxxxxxxxxxx.mkv: 53% /3.547G, 1.070M/s, 26m19s
In my logs, I can see rclone upload adhering to my bwlimt schedule e.g. as I post the limit is "6M" and the upload is staying roughly within this. However, when I check my router, this particular instance (192.168.1.78) is using between 95-105Mbps or 11-13MB/s, which is almost my whole upload speed. This is causing issues for the rest of my network traffic.
I'm pretty sure this is a recent thing as when I last checked my router, rclone uploads bwlimit applied to not just the upload component but the "overhead" as well.
Has something changed, or is there a way for the bwlimit to apply to the whole connection, not just the bwlimit? I can do this at my router end and put a hard cap on, but I'd rather do it within rclone as it's more flexible/easier to do.
Thanks in advance