Rclone mount filling up ram on unraid

Help and Support
1

What is the problem you are having with rclone?

My rclone mount setup fills my ram to 100% when uploading. I have 9 of 32 gigs available for rclone. I tried using --vfs-cache-mode writes as well as varying file sizes Can I get help please?

Run the command 'rclone version' and share the full output of the command.

rclone v1.59.0-beta.6080.03715f6c6

  • os/version: slackware 15.0 (64 bit)
  • os/kernel: 5.15.30-Unraid (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.18.1
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

mega and gdrive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone mount -vv --vfs-cache-mode full --buffer-size 256M --vfs-read-ahead 1G --allow-other M1171_mega: /mnt/disks/cloud/M1171_mega

The rclone config contents with secrets removed.

[M1171_mega]
type = mega
user = email
pass = pass

A log from the command with the -vv flag

root@M1171-NAS:/mnt/disks# rclone mount -vv --vfs-cache-mode full --buffer-size 256M --vfs-read-ahead 1G --allow-other M1171_mega: /mnt/disks/cloud/M1171_mega
2022/04/30 03:58:52 DEBUG : rclone: Version "v1.59.0-beta.6080.03715f6c6" starting with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone/.rclone.conf" "mount" "-vv" "--vfs-cache-mode" "full" "--buffer-size" "256M" "--vfs-read-ahead" "1G" "--allow-other" "M1171_mega:" "/mnt/disks/cloud/M1171_mega"]
2022/04/30 03:58:52 DEBUG : Creating backend with remote "M1171_mega:"
2022/04/30 03:58:52 DEBUG : Using config file from "/boot/config/plugins/rclone/.rclone.conf"
2022/04/30 03:58:56 INFO  : mega root '': poll-interval is not supported by this remote
2022/04/30 03:58:56 DEBUG : vfs cache: root is "/root/.cache/rclone"
2022/04/30 03:58:56 DEBUG : vfs cache: data root is "/root/.cache/rclone/vfs/M1171_mega"
2022/04/30 03:58:56 DEBUG : vfs cache: metadata root is "/root/.cache/rclone/vfsMeta/M1171_mega"
2022/04/30 03:58:56 DEBUG : Creating backend with remote "/root/.cache/rclone/vfs/M1171_mega/"
2022/04/30 03:58:56 DEBUG : Creating backend with remote "/root/.cache/rclone/vfsMeta/M1171_mega/"
2022/04/30 03:58:56 DEBUG : mega root '': Mounting on "/mnt/disks/cloud/M1171_mega"
2022/04/30 03:58:56 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/04/30 03:58:56 DEBUG : : Root:
2022/04/30 03:58:56 DEBUG : : >Root: node=/, err=<nil>
2022/04/30 03:58:58 DEBUG : /: Attr:
2022/04/30 03:58:58 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 03:59:03 DEBUG : /: Attr:
2022/04/30 03:59:03 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 03:59:08 DEBUG : /: Attr:
2022/04/30 03:59:08 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 03:59:14 DEBUG : /: Attr:
2022/04/30 03:59:14 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 03:59:19 DEBUG : /: Attr:
2022/04/30 03:59:19 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 03:59:24 DEBUG : /: Attr:
2022/04/30 03:59:24 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 03:59:30 DEBUG : /: Attr:
2022/04/30 03:59:30 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 03:59:35 DEBUG : /: Attr:
2022/04/30 03:59:35 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 03:59:40 DEBUG : /: Attr:
2022/04/30 03:59:40 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 03:59:46 DEBUG : /: Attr:
2022/04/30 03:59:46 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 03:59:51 DEBUG : /: Attr:
2022/04/30 03:59:51 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 03:59:56 DEBUG : /: Attr:
2022/04/30 03:59:56 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 03:59:56 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/04/30 04:00:01 DEBUG : /: Attr:
2022/04/30 04:00:01 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:07 DEBUG : /: Attr:
2022/04/30 04:00:07 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:12 DEBUG : /: Attr:
2022/04/30 04:00:12 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:17 DEBUG : /: Attr:
2022/04/30 04:00:17 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:23 DEBUG : /: Attr:
2022/04/30 04:00:23 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:28 DEBUG : /: Attr:
2022/04/30 04:00:28 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:33 DEBUG : /: Attr:
2022/04/30 04:00:33 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:39 DEBUG : /: Attr:
2022/04/30 04:00:39 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:44 DEBUG : /: Attr:
2022/04/30 04:00:44 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:49 DEBUG : /: Attr:
2022/04/30 04:00:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:55 DEBUG : /: Attr:
2022/04/30 04:00:55 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:56 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/04/30 04:01:00 DEBUG : /: Attr:
2022/04/30 04:01:00 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:12 DEBUG : /: Attr:
2022/04/30 04:00:12 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:17 DEBUG : /: Attr:
2022/04/30 04:00:17 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:23 DEBUG : /: Attr:
2022/04/30 04:00:23 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:28 DEBUG : /: Attr:
2022/04/30 04:00:28 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:33 DEBUG : /: Attr:
2022/04/30 04:00:33 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:39 DEBUG : /: Attr:
2022/04/30 04:00:39 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:44 DEBUG : /: Attr:
2022/04/30 04:00:44 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:49 DEBUG : /: Attr:
2022/04/30 04:00:49 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:55 DEBUG : /: Attr:
2022/04/30 04:00:55 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:00:56 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/04/30 04:01:00 DEBUG : /: Attr:
2022/04/30 04:01:00 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:01:05 DEBUG : /: Attr:
2022/04/30 04:01:05 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:01:11 DEBUG : /: Attr:
2022/04/30 04:01:11 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:01:16 DEBUG : /: Attr:
2022/04/30 04:01:16 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:01:21 DEBUG : /: Attr:
2022/04/30 04:01:21 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:01:27 DEBUG : /: Attr:
2022/04/30 04:01:27 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:01:32 DEBUG : /: Attr:
2022/04/30 04:01:32 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:01:37 DEBUG : /: Attr:
2022/04/30 04:01:37 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:01:43 DEBUG : /: Attr:
2022/04/30 04:01:43 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
rclone mount --vfs-cache-mode full --buffer-size 256M --vfs-read-ahead 1G --allow-other M1171_mega: /mnt/disks/cloud/M1171_mega
2022/04/30 04:01:48 DEBUG : /: Attr:
2022/04/30 04:01:48 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:01:53 DEBUG : /: Attr:
2022/04/30 04:01:53 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:01:56 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/04/30 04:01:59 DEBUG : /: Attr:
2022/04/30 04:01:59 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:02:04 DEBUG : /: Attr:
2022/04/30 04:02:04 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:02:09 DEBUG : /: Attr:
2022/04/30 04:02:09 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:02:15 DEBUG : /: Attr:
2022/04/30 04:02:15 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:02:20 DEBUG : /: Attr:
2022/04/30 04:02:20 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:02:25 DEBUG : /: Attr:
2022/04/30 04:02:25 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:02:30 DEBUG : /: Attr:
2022/04/30 04:02:30 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:02:36 DEBUG : /: Attr:
2022/04/30 04:02:36 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:02:41 DEBUG : /: Attr:
2022/04/30 04:02:41 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:02:46 DEBUG : /: Attr:
2022/04/30 04:02:46 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:02:52 DEBUG : /: Attr:
2022/04/30 04:02:52 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:02:56 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/04/30 04:02:57 DEBUG : /: Attr:
2022/04/30 04:02:57 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:03:02 DEBUG : /: Attr:
2022/04/30 04:03:02 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:03:08 DEBUG : /: Attr:
2022/04/30 04:03:08 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:03:13 DEBUG : /: Attr:
2022/04/30 04:03:13 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:03:18 DEBUG : /: Attr:
2022/04/30 04:03:18 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:03:24 DEBUG : /: Attr:
2022/04/30 04:03:24 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:03:29 DEBUG : /: Attr:
2022/04/30 04:03:29 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:03:34 DEBUG : /: Attr:
2022/04/30 04:03:34 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:03:40 DEBUG : /: Attr:
2022/04/30 04:03:40 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:03:45 DEBUG : /: Attr:
2022/04/30 04:03:45 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:03:50 DEBUG : /: Attr:
2022/04/30 04:03:50 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:03:55 DEBUG : /: Attr:
2022/04/30 04:03:55 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/04/30 04:03:56 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
^C2022/04/30 04:04:00 INFO  : Signal received: interrupt
2022/04/30 04:04:00 DEBUG : vfs cache: cleaner exiting
2022/04/30 04:04:00 ERROR : /mnt/disks/cloud/M1171_mega: Unmounted rclone mount
2022/04/30 04:04:00 INFO  : Exiting...
2

You are using 256M per file opened. Albeit, your log has nothing opened that you shared.

You should remove flags / not use flags unless you know why you are changing them.

I'd use the latest stable and not a beta.

I'd remove

as well as it does nothing with the other flags you have setup.

3

Thank you. Appreciate the help

4

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.