[Solved] Monitoring rclone bandwidth usage

samad909 · April 26, 2020, 10:26am

What is the problem you are having with rclone?

I am not having a problem with rclone but with tracking the bandwidth rclone is using. We can monitor all bandwidth for a specific user with these iptables rules,
iptables -I OUTPUT -m owner --uid-owner username -j CONNMARK --set-mark 10
iptables -I INPUT -m connmark --mark 10

The above iptables rules monitor all in/out bandwidth (packets/bytes) for that user. However, when rclone is run under that same user the bandwidth is not tracked in the iptables packet/byte counters. I am not sure why this happens so I thought of asking for some ideas here.

What is your rclone version (output from `rclone version`)

rclone v1.51.0

os/arch: linux/amd64
go version: go1.13.7

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Debian 10 x64

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone copy /local/path remote:/path

Animosity022 · April 26, 2020, 1:08pm

You could use something like this:

github.com

idef1x/test/blob/master/process_network_usage.sh

#!/bin/bash

# measures bandwidth usage of a named process
process="$1"
host=`hostname`

if [ "$process" == "" ]
  then
    echo "usage: $@ <process name>"
    exit 1
fi

# if this script was killed and restarted, iptables rules already exists, so set counters correctly
if iptables -nvL $process-in >/dev/null 2>&1
  then bytes_in_last=`iptables -nvL $process-in -x |tail -1 | awk '{ print $2}'`
  else bytes_in_last="0"
fi

if iptables -nvL $process-out >/dev/null 2>&1
  then bytes_out_last=`iptables -nvL $process-out -x |tail -1 | awk '{ print $2}'`

This file has been truncated. show original

calisro · April 26, 2020, 1:54pm

Is rclone going out ipv6?

samad909 · April 26, 2020, 2:23pm

@calisro Thank you, totally forgot about IPv6!

ncw · April 27, 2020, 9:13am

If you want to disable rclone using IPv6 then adding --bind 0.0.0.0 should do it I think...

samad909 · April 27, 2020, 10:22am

@ncw Thanks for listing that. In my case I just disabled IPv6 (since I have no real use for it) by adding this to /etc/sysctl.conf and running "sysctl -p"

net.ipv6.conf.all.disable_ipv6 = 1
net.ipv6.conf.default.disable_ipv6 = 1
net.ipv6.conf.lo.disable_ipv6 = 1

Hopefully it helps someone with the same issue.

system · April 30, 2020, 10:22am

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.