Rclone mount not mounting gdrive

mouzzampk2014 · October 29, 2022, 1:49pm

What is the problem you are having with rclone?

I have rclone working on machine 1 but I am trying to run exactly same mount on machine 2 but its not mounting.

Run the command 'rclone version' and share the full output of the command.

ezio@ezio:~$ docker exec rclone rclone version
2022/10/29 13:46:54 DEBUG : Setting --dir-cache-time "5m0s" from environment variable RCLONE_DIR_CACHE_TIME="5m0s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-mode "full" from environment variable RCLONE_VFS_CACHE_MODE="full"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-max-age "1h0m0s" from environment variable RCLONE_VFS_CACHE_MAX_AGE="1h0m0s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-max-size "750Gi" from environment variable RCLONE_VFS_CACHE_MAX_SIZE="750G"
2022/10/29 13:46:54 DEBUG : Setting --vfs-write-back "5s" from environment variable RCLONE_VFS_WRITE_BACK="5s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-read-ahead "1Gi" from environment variable RCLONE_VFS_READ_AHEAD="1G"
2022/10/29 13:46:54 DEBUG : Setting --umask "2" from environment variable RCLONE_UMASK="002"
2022/10/29 13:46:54 DEBUG : Setting --uid "1000" from environment variable RCLONE_UID="1000"
2022/10/29 13:46:54 DEBUG : Setting --gid "1000" from environment variable RCLONE_GID="1000"
2022/10/29 13:46:54 DEBUG : Setting --dir-cache-time "5m0s" from environment variable RCLONE_DIR_CACHE_TIME="5m0s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-mode "full" from environment variable RCLONE_VFS_CACHE_MODE="full"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-max-age "1h0m0s" from environment variable RCLONE_VFS_CACHE_MAX_AGE="1h0m0s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-max-size "750Gi" from environment variable RCLONE_VFS_CACHE_MAX_SIZE="750G"
2022/10/29 13:46:54 DEBUG : Setting --vfs-write-back "5s" from environment variable RCLONE_VFS_WRITE_BACK="5s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-read-ahead "1Gi" from environment variable RCLONE_VFS_READ_AHEAD="1G"
2022/10/29 13:46:54 DEBUG : Setting --umask "2" from environment variable RCLONE_UMASK="002"
2022/10/29 13:46:54 DEBUG : Setting --uid "1000" from environment variable RCLONE_UID="1000"
2022/10/29 13:46:54 DEBUG : Setting --gid "1000" from environment variable RCLONE_GID="1000"
2022/10/29 13:46:54 DEBUG : Setting --dir-cache-time "5m0s" from environment variable RCLONE_DIR_CACHE_TIME="5m0s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-mode "full" from environment variable RCLONE_VFS_CACHE_MODE="full"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-max-age "1h0m0s" from environment variable RCLONE_VFS_CACHE_MAX_AGE="1h0m0s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-max-size "750Gi" from environment variable RCLONE_VFS_CACHE_MAX_SIZE="750G"
2022/10/29 13:46:54 DEBUG : Setting --vfs-write-back "5s" from environment variable RCLONE_VFS_WRITE_BACK="5s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-read-ahead "1Gi" from environment variable RCLONE_VFS_READ_AHEAD="1G"
2022/10/29 13:46:54 DEBUG : Setting --umask "2" from environment variable RCLONE_UMASK="002"
2022/10/29 13:46:54 DEBUG : Setting --uid "1000" from environment variable RCLONE_UID="1000"
2022/10/29 13:46:54 DEBUG : Setting --gid "1000" from environment variable RCLONE_GID="1000"
2022/10/29 13:46:54 DEBUG : Setting --dir-cache-time "5m0s" from environment variable RCLONE_DIR_CACHE_TIME="5m0s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-mode "full" from environment variable RCLONE_VFS_CACHE_MODE="full"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-max-age "1h0m0s" from environment variable RCLONE_VFS_CACHE_MAX_AGE="1h0m0s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-max-size "750Gi" from environment variable RCLONE_VFS_CACHE_MAX_SIZE="750G"
2022/10/29 13:46:54 DEBUG : Setting --vfs-write-back "5s" from environment variable RCLONE_VFS_WRITE_BACK="5s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-read-ahead "1Gi" from environment variable RCLONE_VFS_READ_AHEAD="1G"
2022/10/29 13:46:54 DEBUG : Setting --umask "2" from environment variable RCLONE_UMASK="002"
2022/10/29 13:46:54 DEBUG : Setting --uid "1000" from environment variable RCLONE_UID="1000"
2022/10/29 13:46:54 DEBUG : Setting --gid "1000" from environment variable RCLONE_GID="1000"
2022/10/29 13:46:54 DEBUG : Setting --dir-cache-time "5m0s" from environment variable RCLONE_DIR_CACHE_TIME="5m0s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-mode "full" from environment variable RCLONE_VFS_CACHE_MODE="full"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-max-age "1h0m0s" from environment variable RCLONE_VFS_CACHE_MAX_AGE="1h0m0s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-max-size "750Gi" from environment variable RCLONE_VFS_CACHE_MAX_SIZE="750G"
2022/10/29 13:46:54 DEBUG : Setting --vfs-write-back "5s" from environment variable RCLONE_VFS_WRITE_BACK="5s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-read-ahead "1Gi" from environment variable RCLONE_VFS_READ_AHEAD="1G"
2022/10/29 13:46:54 DEBUG : Setting --umask "2" from environment variable RCLONE_UMASK="002"
2022/10/29 13:46:54 DEBUG : Setting --uid "1000" from environment variable RCLONE_UID="1000"
2022/10/29 13:46:54 DEBUG : Setting --gid "1000" from environment variable RCLONE_GID="1000"
2022/10/29 13:46:54 DEBUG : Setting --dir-cache-time "5m0s" from environment variable RCLONE_DIR_CACHE_TIME="5m0s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-mode "full" from environment variable RCLONE_VFS_CACHE_MODE="full"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-max-age "1h0m0s" from environment variable RCLONE_VFS_CACHE_MAX_AGE="1h0m0s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-cache-max-size "750Gi" from environment variable RCLONE_VFS_CACHE_MAX_SIZE="750G"
2022/10/29 13:46:54 DEBUG : Setting --vfs-write-back "5s" from environment variable RCLONE_VFS_WRITE_BACK="5s"
2022/10/29 13:46:54 DEBUG : Setting --vfs-read-ahead "1Gi" from environment variable RCLONE_VFS_READ_AHEAD="1G"
2022/10/29 13:46:54 DEBUG : Setting --umask "2" from environment variable RCLONE_UMASK="002"
2022/10/29 13:46:54 DEBUG : Setting --uid "1000" from environment variable RCLONE_UID="1000"
2022/10/29 13:46:54 DEBUG : Setting --gid "1000" from environment variable RCLONE_GID="1000"
2022/10/29 13:46:54 DEBUG : Setting --config "/config/rclone.conf" from environment variable RCLONE_CONFIG="/config/rclone.conf"
2022/10/29 13:46:54 DEBUG : Setting --cache-dir "" from environment variable RCLONE_CACHE_DIR=""
2022/10/29 13:46:54 DEBUG : Setting --timeout "10m0s" from environment variable RCLONE_TIMEOUT="10m"
2022/10/29 13:46:54 DEBUG : Setting --tpslimit "10" from environment variable RCLONE_TPSLIMIT="10"
2022/10/29 13:46:54 DEBUG : Setting --tpslimit-burst "10" from environment variable RCLONE_TPSLIMIT_BURST="10"
2022/10/29 13:46:54 DEBUG : Setting --log-level "DEBUG" from environment variable RCLONE_LOG_LEVEL="DEBUG"
2022/10/29 13:46:54 DEBUG : Setting --log-file "/config/rclone.log" from environment variable RCLONE_LOG_FILE="/config/rclone.log"
rclone v1.60.0
- os/version: alpine 3.16.2 (64 bit)
- os/kernel: 4.15.0-194-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.19.2
- go/linking: static
- go/tags: none

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

  rclone:
    image: rclone/rclone:latest
    hostname: ${DOCKERHOSTNAME}
    container_name: rclone
    environment:
      - RCLONE_CONFIG=/config/rclone.conf
      - RCLONE_DIR_CACHE_TIME=5m0s
      - RCLONE_GID=1000
      - RCLONE_TIMEOUT=10m
      - RCLONE_UID=1000
      - RCLONE_UMASK=002
      - RCLONE_LOG_LEVEL=DEBUG
      - RCLONE_CACHE_DIR=
      - RCLONE_VFS_CACHE_MODE=full
      - RCLONE_VFS_CACHE_MAX_SIZE=750G
      - RCLONE_VFS_WRITE_BACK=5s
      - RCLONE_VFS_CACHE_MAX_AGE=1h0m0s
      - RCLONE_VFS_READ_AHEAD=1G
      - RCLONE_TPSLIMIT=10
      - RCLONE_TPSLIMIT_BURST=10
    security_opt:
      - apparmor:unconfined
    cap_add:
      - SYS_ADMIN
    devices:
      - /dev/fuse
    restart: unless-stopped
    volumes:
      - ${DOCKERCONFDIR}/rclone:/config
      - ${DOCKERSTORAGEDIR}:/storage:shared
    command: mount "gdrive:" "/storage/gdrive" --allow-other --allow-non-empty

A log from the command with the `-vv` flag

2022/10/29 13:42:18 INFO  : Starting transaction limiter: max 10 transactions/s with burst 10
2022/10/29 13:42:18 DEBUG : rclone: Version "v1.60.0" starting with parameters ["rclone" "mount" "gdrive:" "/storage/gdrive" "--allow-other" "--allow-non-empty"]
2022/10/29 13:42:18 DEBUG : Creating backend with remote "gdrive:"
2022/10/29 13:42:18 DEBUG : Using config file from "/config/rclone.conf"
2022/10/29 13:42:18 DEBUG : vfs cache: root is "/data"
2022/10/29 13:42:18 DEBUG : vfs cache: data root is "/data/vfs/gdrive"
2022/10/29 13:42:18 DEBUG : vfs cache: metadata root is "/data/vfsMeta/gdrive"
2022/10/29 13:42:18 DEBUG : Creating backend with remote "/data/vfs/gdrive/"
2022/10/29 13:42:18 DEBUG : Creating backend with remote "/data/vfsMeta/gdrive/"
2022/10/29 13:42:18 DEBUG : Google drive root '': Mounting on "/storage/gdrive"
2022/10/29 13:42:18 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)
2022/10/29 13:42:18 DEBUG : : Root: 
2022/10/29 13:42:18 DEBUG : : >Root: node=/, err=<nil>
2022/10/29 13:43:18 DEBUG : Google drive root '': Checking for changes on remote
2022/10/29 13:43:18 INFO  : vfs cache: cleaned: objects 0 (was 0) in use 0, to upload 0, uploading 0, total size 0 (was 0)

mouzzampk2014 · October 29, 2022, 1:57pm

I tried different version and beta as well but same issue when I do df -h I cannot see gdrive: there as well no folders are mounted inside /storage/gdrive/.

Also I cannot see any errors in the log file.

mouzzampk2014 · October 29, 2022, 6:27pm

I have tried on another machine and it's not working so seem like I am doing something wrong

Ole · October 29, 2022, 8:01pm

Hi Hassan,

Please post the redacted output from:

rclone version
rclone config show gdrive

and tells us if you see the expected content when doing:

rclone lsf gdrive:

mouzzampk2014 · October 29, 2022, 8:20pm

Hi Ole,

I hope that helps

2022/10/29 20:17:27 INFO  : Starting transaction limiter: max 10 transactions/s with burst 10
rclone v1.60.0
- os/version: alpine 3.16.2 (64 bit)
- os/kernel: 4.15.0-194-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.19.2
- go/linking: static
- go/tags: none

docker exec rclone rclone config show gdrive
[gdrive]
type = drive
client_id = 744fdsfdsfsfdssm6fbup1opfrc1.apps.googleusercontent.com
client_secret = 4TfdsfdsfdfsfYN3ut3EUFCz
scope = drive
token = {"access_token":"ya29.a0Aa4xrXfsfdsfsdwqOjH-lR6PEGXRgloJ","expiry":"2022-10-29T20:44:38.567016309Z"}
root_folder_id = 0ALdsfdfssdfA

docker exec rclone rclone lsf gdrive:
2022/10/29 20:19:46 INFO  : Starting transaction limiter: max 10 transactions/s with burst 10
movies/
tv/

mouzzampk2014 · October 30, 2022, 7:11am

I thought it's to do with "expiry":"2022-10-29T20:44:38.567016309Z" in the config but thats not the issue
Just cannot figure it out why suddenly not working.

Ole · October 30, 2022, 7:43am

Agree, rclone and the setup of gdrive: seems to be fine.

I suspect an issue/mistake with your docker export of the mount point:

which is outside my area of expertise

I guess you already read this:
https://rclone.org/install/#docker
and checked the value of ${DOCKERSTORAGEDIR}

so let us hope somebody with docker and mount experience drops by soon.

mouzzampk2014 · October 30, 2022, 10:00am

Hi Ole, thanks again for your reply. Yes I read that and ${DOCKERSTORAGEDIR} is set to /mnt and gdrive is in /mnt/gdrive.

Lets see if others have more info.

Thanks for your help

Ole · October 30, 2022, 4:03pm

Hi again, trying to share some (naïve) ideas, that may help you locate the issue while waiting for better help:

You could add RCLONE_LOG_FILE=/some/folder/mylogfile.txt to your command, to get the log in a file. Not sure, but perhaps you can place it in the config folder to see it from outside the container.

Is it intentional that you write "RCLONE_CACHE_DIR=" that is without any value, how do you expect it to behave? (I would remove it if I wanted default behavior)

You could remove all tuning options from you command to reduce complexity while troubleshooting, examples are: RCLONE_DIR_CACHE_TIME=5m0s, RCLONE_VFS_WRITE_BACK=5s, RCLONE_VFS_READ_AHEAD=1G, RCLONE_TPSLIMIT=10, RCLONE_TPSLIMIT_BURST=10

You could also try SSH into the docker container and then check the behavior of the mounted folder (/storage/gdrive) with ordinary ls and touch.

system · November 29, 2022, 4:04pm

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.