High latency fast wan link

What is the problem you are having with rclone?

I am trying to transfer files from one Ubuntu Server to another one. Even tho there is a 1G link between them, the latency is 64-70 ms. The thoughtput is really slow and after making the calculations here: Network Throughput Calculator - WintelGuy.com it looks like, even with bigger window size wouldn't fix it. I get around 1-3 MegaBytes per second transfer speed.

I tried with NFS or SMB mount. Both had similar speeds. These filesystems are mounted via /etc/fstab.

Run the command 'rclone version' and share the full output of the command.

rclone v1.67.0

  • os/version: ubuntu 24.04 (64 bit)
  • os/kernel: 6.8.0-41-generic (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.22.4
  • go/linking: static
  • go/tags: none

I have root access to both servers, so I could for an example create another Service on the host or use VFS MOUNT on the client instead of using OS mount.

I also tried to switch to UDP for NFS but didn't manage to do that and I'm not sure if it is bad for file integrity.

Edit: I tried now with creating a remote called "local" on the server side and serving webdav like this:
screen rclone serve webdav local:/zfs --addr :8080
On the client i created a webdav remote to this server and tried to copy with this commmand:

rclone copy webdavremote:/folder/ /tmp --progress --log-level DEBUG --multi-thread-streams 15 --transfers 1

/tmp is a ramdisk. I get around 30 MegaBytes which is atleast more, but still not close to 100MegaBytes. Lowering --multi-thread-streams lowers throughput and highering doesn't make it faster.

When i have --transfers 2 the share the Throughput. Where could be the next bottleneck?

hi, what other copy tools have you tested, rsync, or what?

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.