Rclone 1.40 Cache - Running out of memory

Suspected Bug
1

Hello guys,

I have been testing the new release the last couple of hours and ended up running into an “out of memory” error.

It appeared during the playback of one file. At that point rclone was consuming more than 1GB of RAM. Here a snippet of the log:

https://1drv.ms/t/s!AoPn9ceb766mgYskzen4acQwCkglCg

I was using the the following beta version…

rclone v1.39-155-g62e72801β
os/arch: linux/amd64
go version: go1.9.3

…and using the following mount command:

rclone_beta mount -vv --allow-non-empty --allow-other --buffer-size 32M --dir-cache-time 8760h --poll-interval 24h --vfs-cache-mode writes --vfs-cache-max-age 0m gdrive: /media/cry

For the 1.40 I used this command:

rclone_1.40 mount --log-level DEBUG --log-file /tmp/log.txt --allow-non-empty --allow-other crypt_gdrive: /media/cry

It is wrapped as follows: gdrive -> cache_gdrive -> crypt_gdrive

I hope that snippet helps, in case it doesn’t please let me know I’ll try to reproduce the error and post a proper logfile.

2

Are you seeing a lot of error logs for Plex? I noticed you’re running with -vv.

3

Seems like it’s not related to cache: https://github.com/ncw/rclone/issues/2157

4

I can confirm it is not cache related. It also happens with the…

rclone v1.39-155-g62e72801β

  • os/arch: linux/amd64
  • go version: go1.9.3

… and the latest 1.40 stable using the following mount command:

rclone_1.40 mount --log-level DEBUG --log-file /tmp/log.txt --allow-non-empty --allow-other --buffer-size 32M --dir-cache-time 8760h --poll-interval 24h --vfs-cache-mode writes --attr-timeout 1s --vfs-cache-max-age 0m upload: /media/cry

I have a log but it doesn’t show much. While streaming a file it ran out of memory (similar to the log in my first post).

Is it possible to limit the memory usage of rclone in any way?

1 Like