What is the problem you are having with rclone?
I have a NAS with two large capacity sata drives and a nvme as a boot drive. I've setup rclone to mount a union of the two sata drives while using --vfs-cache-mode full with a cache folder on the nvme. My goal is to use the cache primarily and sync the remote once a week. To do this I have two docker compose files: the main compose file uses --vfs-write-back 9999d and once a week rclone is restarted with a second compose file that uses --vfs-write-back 5s.
Overall this works great except for one issue: when a new file is added to the mount, if the folder for the file doesn't exist then the sata drive is spun up to create an empty folder. The folder will then stay empty on the sata drive until the cache is synced later in the week.
Is it possible to forgo creating the empty folder on the remote until vfs-write-back is triggered? Any help is greatly appreciated!
Run the command 'rclone version' and share the full output of the command.
rclone v1.67.0
- os/version: alpine 3.20.0 (64 bit)
- os/kernel: 6.8.0-40-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.22.4
- go/linking: static
- go/tags: none
Which cloud storage system are you using? (eg Google Drive)
Local
The command you were trying to run (eg rclone copy /tmp remote:tmp)
Main compose file:
mount "union:" "/mnt/docker/media/rclone/plex-media-internal" --uid 1000 --gid 1000 --umask 002 --default-permissions --allow-non-empty --allow-other --vfs-cache-mode full --vfs-fast-fingerprint --cache-dir "/cache/" --dir-cache-time 9999d --poll-interval 0 --vfs-cache-max-age 9999d --vfs-cache-max-size 500G --vfs-cache-poll-interval 1m --vfs-write-back 9999d --buffer-size 16M --vfs-read-ahead 20G --log-level INFO --stats 15m --local-no-check-updated --local-no-preallocate --attr-timeout 9999d --vfs-refresh
Compose file run once a week to sync:
mount "union:" "/mnt/docker/media/rclone/plex-media-internal" --uid 1000 --gid 1000 --umask 002 --default-permissions --allow-non-empty --allow-other --vfs-cache-mode full --vfs-fast-fingerprint --cache-dir "/cache/" --dir-cache-time 9999d --poll-interval 0 --vfs-cache-max-age 9999d --vfs-cache-max-size 500G --vfs-cache-poll-interval 1m --vfs-write-back 5s --buffer-size 16M --vfs-read-ahead 20G --log-level INFO --stats 15m --local-no-check-updated --local-no-preallocate --attr-timeout 9999d
Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.
[union]
type = union
upstreams = /mnt/data1 /mnt/data2
action_policy = lus
create_policy = lus
search_policy = ff
min_free_space = 100Gi
A log from the command that you were trying to run with the -vv flag
Skipped since command is working as typically intended