Degraded performance streaming media with rclone

Help and Support
1

What is the problem you are having with rclone?

Recently I started to experience degraded performance downloading/streaming media from S3 buckets.

I've been running this setup successfully for +18 months, streaming audio and video files from Idrive E2 buckets with rclone. rclone is mounting an encrypted S3 bucket on my linux server. The mounted folder is then accessed by a player.

Since around two weeks, I am unable to stream any file regardless of size. What I checked so far:

  • Local network connection and speed, which is ok
  • Remote connection to rule out S3 is downgraded (I can access and play the files without any problems on my mobile using a different client)

I upgraded to rclone v1.67.0 recently, not saying there is a correlation to this behavior, but it was the only recent change on my system after streaming issues started and files are stuck in buffering states.

Are there any known issues with rclone or changes to the config that may impact the performance with the latest updates? I do not see any errors in the debug logs.

Run the command 'rclone version' and share the full output of the command.

rclone v1.67.0

  • os/version: ubuntu 22.04 (64 bit)
  • os/kernel: 6.5.0-45-generic (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.22.4
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Idrive E2 S3 storage

   /usr/bin/rclone mount \
  --config=/home/florian/.config/rclone/rclone.conf \
  --log-level=DEBUG \
  --log-file=/opt/rclone/logs/rclone-mount.log \
  --user-agent=idrive \
  --umask=002 \
  --gid=1002 \
  --uid=1000 \
  --allow-other \
  --timeout=1h \
  --poll-interval=15s \
  --dir-cache-time=12h \
  --cache-dir=/opt/rclone/cache/imedia \
  --vfs-cache-mode=full \
  --vfs-cache-max-size=4G \
  --vfs-cache-max-age=12h \
  idrivee2-crypt: /mnt/idrivee2-cloud

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[idrivee2]
type = s3
provider = IDrive
access_key_id = XXX
secret_access_key = XXX
endpoint = k8o7.fra3.idrivee2-59.com
server_side_encryption = aws:kms

[idrivee2-crypt]
type = crypt
remote = idrivee2:media
password = XXX
password2 = XXX
directory_name_encryption = true
2

It would be probably beneficial to downgrade rclone version (to the last all worked fine for you) to test. it would clearly indicate where the issue is - with rclone or with iDrive.

3

I just downgraded to 1.56 and streaming seems to work again.

4

I have experienced the same as you and I believe Idrive are having some performance or capacity issues.

I have been streaming from them for many months now, but about 10 days ago my download speed dropped and I couldn't stream anything as it was only downloading at a few Mb/s.

I had an online chat with their support team and we did a few speed tests before he raised a ticket to the "Backend team". I heard nothing from them, and I tried to chase it every day, but the first-line support always just said I would be updated by email (I wasn't). After 2 days, upload speed returned but download speed got even slower, just Kb/s.

Finally, after 3 days, download speed improved and I could mostly stream ok, but I have had a few instances where speed has dropped a bit. I only received an email a few days saying the issue was fixed, but I re-opened it as I don't think it has been.

This looks to me like idrive have capacity issues and there may not be a quick fix. All we can do is wait.

BTW, where is your bucket located? Mine is Frankfurt but I was tempted to try creating a new one in a different location to see if that helps. I just tried downgrading to 1.56 but it made it even slower for me.

5

hi,

so now, everything is working?
if you run latest does streaming fail again?

so that would imply the mount is working, correct?

can you tell us a bit more about your setup?
the mount and the player are on the same machine or what?
what is the player, vlc, plex or what?

s3 providers do not support polling, a.k.a ChangeNotify

rclone backend features idrive: | grep "ChangeNotify"
                "ChangeNotify": false,
6

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.