Rclone saturates bandwidth but still buffers horribly

What is the problem you are having with rclone?

I am having an issue with buffering while trying to use Rclone, Jellyfin and RealDebrid, the issue seems isolated to movies while most episodes of TV shows work fine.
I have played around with caching using VFS, different buffer sizes and the like without resolving the buffering issue.
I am on a 500/500 connection and direct playing the media, I can see rclone is saturating my bandwidth but still buffering horribly.
By the time the movie finishes playing there is 4-10x the size of the movie used in bandwidth!

Run the command 'rclone version' and share the full output of the command.

rclone v1.67.0

  • os/version: alpine 3.20.0 (64 bit)
  • os/kernel: 5.10.0-32-amd64 (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.22.4
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

RealDebrid

"mount zurg: /data --allow-non-empty --buffer-size 1G --allow-other --log-level INFO --log-file /var/log/rclone.log --timeout 1h --vfs-read-chunk-size 64M --vfs-cache-mode full --vfs-read-chunk-size-limit off --transfers 32 --rc --rc-web-gui --rc-addr :5572 --rc-no-auth --cache-dir=/cache --umask 000"

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

/data # rclone config redacted
[zurg]
type = webdav
url = http://zurg:9999/dav
vendor = other
pacer_min_sleep = 0

[zurghttp]
type = http
url = http://zurg:9999/http
no_head = false
no_slash = false

A log from the command that you were trying to run with the -vv flag

Logging set to INFO, I can increase the level but it spits out a whole lot.

Paste  log here2024/09/07 07:54:53 NOTICE: Web GUI exists. Update skipped.
2024/09/07 07:54:53 NOTICE: It is recommended to use web gui with auth.
2024/09/07 07:54:53 NOTICE: Serving Web GUI
2024/09/07 07:54:53 NOTICE: Serving remote control on http://[::]:5572/
2024/09/07 07:54:53 ERROR : Failed to open Web GUI in browser: exec: "xdg-open": executable file not found in $PATH. Manually access it at: http://[::]:5572/
2024/09/07 07:54:53 INFO  : webdav root '': poll-interval is not supported by this remote
2024/09/07 07:54:53 INFO  : vfs cache: cleaned: objects 17 (was 17) in use 0, to upload 0, uploading 0, total size 2.655Gi (was 2.655Gi)
2024/09/07 07:55:53 INFO  : vfs cache: cleaned: objects 17 (was 17) in use 1, to upload 0, uploading 0, total size 2.898Gi (was 2.898Gi)
2024/09/07 07:56:53 INFO  : vfs cache: cleaned: objects 17 (was 17) in use 1, to upload 0, uploading 0, total size 5.011Gi (was 5.011Gi)
2024/09/07 07:57:53 INFO  : vfs cache: cleaned: objects 17 (was 17) in use 1, to upload 0, uploading 0, total size 7.470Gi (was 7.470Gi)
2024/09/07 07:58:53 INFO  : vfs cache: cleaned: objects 17 (was 17) in use 1, to upload 0, uploading 0, total size 10.040Gi (was 10.040Gi)
2024/09/07 07:59:53 INFO  : vfs cache: cleaned: objects 17 (was 17) in use 1, to upload 0, uploading 0, total size 12.632Gi (was 12.632Gi)
2024/09/07 08:00:53 INFO  : vfs cache: cleaned: objects 17 (was 17) in use 1, to upload 0, uploading 0, total size 15.283Gi (was 15.283Gi)
2024/09/07 08:01:53 INFO  : vfs cache: cleaned: objects 17 (was 17) in use 1, to upload 0, uploading 0, total size 17.766Gi (was 17.766Gi)
2024/09/07 08:02:53 INFO  : vfs cache: cleaned: objects 18 (was 18) in use 2, to upload 0, uploading 0, total size 20.241Gi (was 20.241Gi)
2024/09/07 08:03:53 INFO  : vfs cache: cleaned: objects 18 (was 18) in use 2, to upload 0, uploading 0, total size 22.872Gi (was 22.872Gi)
2024/09/07 08:04:53 INFO  : vfs cache: cleaned: objects 18 (was 18) in use 2, to upload 0, uploading 0, total size 25.376Gi (was 25.376Gi)
2024/09/07 08:05:53 INFO  : vfs cache: cleaned: objects 18 (was 18) in use 2, to upload 0, uploading 0, total size 27.983Gi (was 27.983Gi)
2024/09/07 08:06:53 INFO  : vfs cache: cleaned: objects 18 (was 18) in use 2, to upload 0, uploading 0, total size 29.781Gi (was 29.781Gi)

welcome to the forum,

best to test with default values, simplest command without adding additional flags.
so, i would remove --buffer-size 1G --vfs-read-chunk-size-limit off --transfers 32 --vfs-read-chunk-size 64M

need to use DEBUG
when buffering happens, mark the time, and check the rclone debug log.

Removing the flags has solved the problem, it was down to a whole lot of flags and a whole lot of not reading the documentation to understand what the flags were doing...

Primarily it was the chunk size being uncapped and scaling too large that was causing the buffering problems.

Thank you!

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.