Rclone docker volume present but no contents within

[simonm]

I have created a compose.yml which contains:

   volumes:
      - /etc/localtime:/etc/localtime:ro
      - ./config:/root/config
      - configdata:/data:ro
      - ./metadata:/metadata
      - ./cache:/cache
      - ./blobs:/blobs
      - ./generated:/generated

volumes:
  configdata:
    driver: rclone
    driver_opts:
      remote: 'dellboy_local_encrypted_folder:'
      allow_other: 'true'
      vfs_cache_mode: full
      poll_interval: 0

but whilst the folder mounts the contents do not appear in the docker container via the app, nor when doing a docker exec -it containername /bin/sh

rclone.conf contains:

[dellboy_local_encrypted_folder]
type = crypt
remote = dellboy_local_alias:
password = redacted
password2 = redacted

[dellboy_local_alias]
type = alias
remote = hashing_local:/mnt/Four_TB_Array/encrypted

[hashing_local]
type = hasher
remote = localdrive:
hashes = sha1

[localdrive]
type = local

rclone works locally with

/usr/bin/rclone mount dellboy_local_encrypted_folder: /home/simon/dellboy

rclone.conf copied to /var/lib/docker-plugins/rclone/config/rclone.conf

/etc/fuse.conf has user_allow_other set
TIA

[simonm]

Have any others got docker rclone working and can provide a working example please ?

[asdffdsa (jojothehumanmonkey)]

there is a working examples in the docs and the forum.

[simonm]

Yes. I based my config on that.

[simonm]

I based my config on:

How to use rclone with nextcloud docker

Introduction Nextcloud supports external storage. We will be adding to its external storage via this path: Docker volume plugin --> rclone plugin --> rclone config with remote --> docker-compose.yaml volume section --> docker-compose.yaml services volume mounting section --> nextcloud webUI. Steps Create config with whatever backend you want rclone config sudo mkdir -p /var/lib/docker-plugins/rclone/config and sudo mkdir -p /var/lib/docker-plugins/rclone/cache Copy that conf file into t…

and

Docker Volume Plugin

[simonm]

This is driving me batty. I have verified the config.

From within the container mount shows:
dellboy_local_encrypted_folder: on /data type fuse.rclone (rw,nosuid,nodev,relatime,user_id=0,group_id=0,allow_other)

but the folder is just empty. I simplified and checked the config to

[dellboy_local_encrypted_folder]
type = crypt
remote = localdrive:/mnt/Four_TB_Array/encrypted
password = redacted
password2 = redacted

[localdrive]
type = local

and proved it worked as root with

rclone --config /var/lib/docker-plugins/rclone/config/rclone.conf lsf -vv dellboy_local_encrypted_folder:

I checked the endpoint with curl

curl -H Content-Type:application/json -XPOST -d {} --unix-socket /run/docker/plugins/4f530f6e28d214d90dbe03afa31b7d18b0f970077f4e293b268be8c8a34a7dc7/rclone.sock http://localhost/Plugin.Activate
{"Implements":["VolumeDriver"]}

I tried
docker plugin install rclone/docker-volume-rclone:amd64 args="-vv --vfs-cache-mode=off" --alias rclone --grant-all-permissions

and
docker plugin set rclone RCLONE_VERBOSE=2

but journalctl shows no errors at all.

The folder appears, it is just empty.

[simonm]

This appears to be the same issue as mine, or at least very similar

SSH_FX_FAILURE when moving file between folders in the same mount

Here is a video trying to explain the issue. On the left terminal is the VFS-Server on the right is the VFS-Client. The client is mounting the directory /vfs. [Testing RClone serve and RClone mount in docker containers] The test is simple. Both movies and downloads directory appear in the host SFTP server, but they are not present in the mount. Even if I create a new directory inside the container it does not show up.

[simonm]

I am happy to make a $10 dollar donation to rclone (or whatever paypal account is requested) if anyone provides a solution to my issue which doesn't require massive workarounds, or different images (i.e. a long term fix).

[simonm]

Apr 11 21:53:47 dellboy dockerd[17281]: time="2025-04-11T21:53:47+01:00" level=error msg="2025/04/11 20:53:47 DEBUG : Mount volume \"stash_data_dir\" for id \"9778d686171c666634faac26db29cae92ebef6effc0420312d9ed908065ec375\" at path /mnt/stash_data_dir (count 0)>
Apr 11 21:53:47 dellboy dockerd[17281]: time="2025-04-11T21:53:47+01:00" level=error msg="2025/04/11 20:53:47 DEBUG : Encrypted drive 'dellboy_local_encrypted_folder:': Mounting on \"/mnt/stash_data_dir\"" plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c>
Apr 11 21:53:47 dellboy dockerd[17281]: time="2025-04-11T21:53:47+01:00" level=error msg="2025/04/11 20:53:47 DEBUG : Save state [stash_data_dir] to /data/cache/docker-plugin.state" plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d
Apr 11 21:53:47 dellboy dockerd[17281]: time="2025-04-11T21:53:47+01:00" level=error msg="2025/04/11 20:53:47 DEBUG : : Root: " plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d
Apr 11 21:53:47 dellboy dockerd[17281]: time="2025-04-11T21:53:47+01:00" level=error msg="2025/04/11 20:53:47 DEBUG : : >Root: node=/, err=<nil>" plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d
Apr 11 21:53:47 dellboy dockerd[17281]: time="2025-04-11T21:53:47+01:00" level=error msg="2025/04/11 20:53:47 DEBUG : Clear all caches" plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d
Apr 11 21:53:47 dellboy dockerd[17281]: time="2025-04-11T21:53:47+01:00" level=error msg="2025/04/11 20:53:47 DEBUG : : forgetting directory cache" plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d
Apr 11 21:53:47 dellboy dockerd[17281]: time="2025-04-11T21:53:47+01:00" level=error msg="2025/04/11 20:53:47 DEBUG : Monitoring 1 volumes" plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d
Apr 11 21:53:48 dellboy dockerd[17281]: time="2025-04-11T21:53:48+01:00" level=error msg="2025/04/11 20:53:48 DEBUG : /: Attr: " plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d
Apr 11 21:53:48 dellboy dockerd[17281]: time="2025-04-11T21:53:48+01:00" level=error msg="2025/04/11 20:53:48 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>" plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d
Apr 11 21:53:58 dellboy dockerd[17281]: time="2025-04-11T21:53:58+01:00" level=error msg="2025/04/11 20:53:58 DEBUG : /: Attr: " plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d
Apr 11 21:53:58 dellboy dockerd[17281]: time="2025-04-11T21:53:58+01:00" level=error msg="2025/04/11 20:53:58 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>" plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d
Apr 11 21:54:00 dellboy dockerd[17281]: time="2025-04-11T21:54:00+01:00" level=error msg="2025/04/11 20:54:00 DEBUG : /: Lookup: name=\"MAILPATH\"" plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d
Apr 11 21:54:00 dellboy dockerd[17281]: time="2025-04-11T21:54:00+01:00" level=error msg="2025/04/11 20:54:00 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory" plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d
Apr 11 21:54:00 dellboy dockerd[17281]: time="2025-04-11T21:54:00+01:00" level=error msg="2025/04/11 20:54:00 DEBUG : /: Attr: " plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d
Apr 11 21:54:00 dellboy dockerd[17281]: time="2025-04-11T21:54:00+01:00" level=error msg="2025/04/11 20:54:00 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxr-xr-x, err=<nil>" plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d
Apr 11 21:54:00 dellboy dockerd[17281]: time="2025-04-11T21:54:00+01:00" level=error msg="2025/04/11 20:54:00 DEBUG : /: ReadDirAll: " plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d
Apr 11 21:54:00 dellboy dockerd[17281]: time="2025-04-11T21:54:00+01:00" level=error msg="2025/04/11 20:54:00 DEBUG : /: >ReadDirAll: item=2, err=<nil>" plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d
Apr 11 21:54:00 dellboy dockerd[17281]: time="2025-04-11T21:54:00+01:00" level=error msg="2025/04/11 20:54:00 DEBUG : /: Lookup: name=\"MAILPATH\"" plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d
Apr 11 21:54:00 dellboy dockerd[17281]: time="2025-04-11T21:54:00+01:00" level=error msg="2025/04/11 20:54:00 DEBUG : /: >Lookup: node=<nil>, err=no such file or directory" plugin=ad40decc54bcf70103d42ae0c39da8688b0b5bed6bcff95b7c4d76d3518cfe6d

[simonm]

Interesting development. It works from my laptop, over sshfs.

But doesn't work on the server. So next things to investigate are if I don't use 'type=local' and try sshfs instead.

Or it could be due to using it in an unsupported way by having /mnt being used in a container and the container it references, not that this option makes much sense to me.

[simonm]

so using sshfs worked. It appears as if it didn't like using local paths via localdrive:/mnt/ or by using /mnt/Four_TB_Array/encrypted

I guess it could be a permissions related issue but i could mount /mnt/Four_TB_Array/encrypted inside the container happily enough.

Weird, but fixed.