Docker plugin vfs cache behaviour

Help and Support
1

What is the problem you are having with rclone?

Not a problem, rather a question

If I’ve installed rclone plugin with this parameters:

docker plugin install rclone/docker-volume-rclone:amd64 args="--allow-other --fast-list --links --read-only --low-level-retries 100 --retries 100 --retries-sleep 100ms --buffer-size 32Mi --checkers 16 --transfers 8 --human-readable --log-level NOTICE --dir-cache-time 5m --poll-interval 0 --vfs-cache-mode full --vfs-cache-max-age 1y --vfs-cache-max-size 20g --vfs-cache-poll-interval 1m --vfs-write-back 5s --vfs-fast-fingerprint --vfs-read-ahead 256Mi --vfs-read-chunk-size 32M --vfs-read-chunk-streams 4" --alias rclone --grant-all-permissions

Especially --vfs-cache-max-size 20g and I’ve created 3 volumes with docker compose:

volumes:
  rclone1:
    driver: rclone
    driver_opts:
      remote: azure1-crypt:Folder
  rclone2:
    driver: rclone
    driver_opts:
      remote: azure2-crypt:Folder1
  rclone3:
    driver: rclone
    driver_opts:
      remote: azure2-crypt:Folder2

Is the given 20 GB of max cache size refers to

  • each of 3 volumes separately
  • each of 2 unique remotes
  • all volumes at once, combined

Run the command 'rclone version' and share the full output of the command.

rclone v1.71.1

  • os/version: ubuntu 24.04 (64 bit)
  • os/kernel: 6.11.0-1018-azure (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.25.1
  • go/linking: static
  • go/tags: none

Which cloud storage system are you using? (eg Google Drive)

azureblob

2

does nothing on rclone mount, the related global flag --checkers has no effect on the VFS

change --vfs-cache-max-size 20g to a small value, use a debug log and see what happens.

just curious, why use three individual remotes versus a single combine remote?
in the case, just a single volume.

[AllVolumes]
type = combine
upstreams = "rclone1=azure1-crypt:Folder:" "rclone2=azure2-crypt:Folder1:" "rclone3=azure2-crypt:Folder2:" 

volumes:
  rclone:
    driver: rclone
    driver_opts:
      remote: AllVolumes
3

Thank you for all advices, especially combine remote idea

4

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.