Mount Command:
rclone mount --uid 99 --gid 100 --umask 000 --allow-other --buffer-size 256M --dir-cache-time 720h --attr-timeout 720h --drive-chunk-size 512M -vv --poll-interval 10s --cache-dir /mnt/user/cache_tmp/rclone/google_drive_encrypted_vfs_2 --drive-pacer-min-sleep 10ms --drive-pacer-burst 1000 --vfs-cache-mode full --vfs-cache-max-size 50G --vfs-cache-max-age 336h --vfs-read-ahead 1G google_drive_encrypted_vfs_2: /mnt/user/data/remote_storage_2
Mount Logs:
2022/10/14 09:18:39 DEBUG : rclone: Version "v1.59.2" starting with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone/.rclone.conf" "mount" "--uid" "99" "--gid" "100" "--umask" "000" "--allow-other" "--buffer-size" "256M" "--dir-cache-time" "720h" "--attr-timeout" "720h" "--drive-chunk-size" "512M" "-vv" "--poll-interval" "10s" "--cache-dir" "/mnt/user/cache_tmp/rclone/google_drive_encrypted_vfs_2" "--drive-pacer-min-sleep" "10ms" "--drive-pacer-burst" "1000" "--vfs-cache-mode" "full" "--vfs-cache-max-size" "50G" "--vfs-cache-max-age" "336h" "--vfs-read-ahead" "1G" "google_drive_encrypted_vfs_2:" "/mnt/user/data/remote_storage_2"]
2022/10/14 09:18:39 DEBUG : Creating backend with remote "google_drive_encrypted_vfs_2:"
2022/10/14 09:18:39 DEBUG : Using config file from "/boot/config/plugins/rclone/.rclone.conf"
2022/10/14 09:18:39 DEBUG : Creating backend with remote "google_drive:encrypted-data-sym-1"
2022/10/14 09:18:39 DEBUG : google_drive: detected overridden config - adding "{GvAJ9}" suffix to name
2022/10/14 09:18:39 DEBUG : fs cache: renaming cache item "google_drive:encrypted-data-sym-1" to be canonical "google_drive{GvAJ9}:encrypted-data-sym-1"
2022/10/14 09:18:39 DEBUG : vfs cache: root is "/mnt/user/cache_tmp/rclone/google_drive_encrypted_vfs_2"
2022/10/14 09:18:39 DEBUG : vfs cache: data root is "/mnt/user/cache_tmp/rclone/google_drive_encrypted_vfs_2/vfs/google_drive_encrypted_vfs_2"
2022/10/14 09:18:39 DEBUG : vfs cache: metadata root is "/mnt/user/cache_tmp/rclone/google_drive_encrypted_vfs_2/vfsMeta/google_drive_encrypted_vfs_2"
2022/10/14 09:18:39 DEBUG : Creating backend with remote "/mnt/user/cache_tmp/rclone/google_drive_encrypted_vfs_2/vfs/google_drive_encrypted_vfs_2/"
2022/10/14 09:18:39 DEBUG : Creating backend with remote "/mnt/user/cache_tmp/rclone/google_drive_encrypted_vfs_2/vfsMeta/google_drive_encrypted_vfs_2/"
2022/10/14 09:18:39 DEBUG : Encrypted drive 'google_drive_encrypted_vfs_2:': Mounting on "/mnt/user/data/remote_storage_2"
2022/10/14 09:18:40 DEBUG : : Root:
2022/10/14 09:18:40 DEBUG : : >Root: node=/, err=<nil>
2022/10/14 09:18:49 DEBUG : Google drive root 'encrypted-data-sym-1': Checking for changes on remote
2022/10/14 09:18:59 DEBUG : Google drive root 'encrypted-data-sym-1': Checking for changes on remote
2022/10/14 09:19:09 DEBUG : Google drive root 'encrypted-data-sym-1': Checking for changes on remote
2022/10/14 09:19:19 DEBUG : Google drive root 'encrypted-data-sym-1': Checking for changes on remote
2022/10/14 09:19:28 DEBUG : /: Attr:
2022/10/14 09:19:28 DEBUG : /: >Attr: attr=valid=720h0m0s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/10/14 09:19:29 DEBUG : Google drive root 'encrypted-data-sym-1': Checking for changes on remote
2022/10/14 09:19:37 DEBUG : /: ReadDirAll:
2022/10/14 09:19:37 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/10/14 09:19:37 DEBUG : /: Attr:
2022/10/14 09:19:37 DEBUG : /: >Attr: attr=valid=720h0m0s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/10/14 09:19:37 DEBUG : /: Lookup: name="MyFiles"
2022/10/14 09:19:37 DEBUG : /: >Lookup: node=MyFiles/, err=<nil>
2022/10/14 09:19:37 DEBUG : MyFiles/: Attr:
2022/10/14 09:19:37 DEBUG : MyFiles/: >Attr: attr=valid=720h0m0s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/10/14 09:19:37 DEBUG : /: Lookup: name="mountcheck"
2022/10/14 09:19:37 DEBUG : /: >Lookup: node=mountcheck, err=<nil>
2022/10/14 09:19:37 DEBUG : mountcheck: Attr:
2022/10/14 09:19:37 DEBUG : mountcheck: >Attr: a=valid=720h0m0s ino=0 size=0 mode=-rw-rw-rw-, err=<nil>
2022/10/14 09:19:37 DEBUG : /: Lookup: name="test_5.txt"
2022/10/14 09:19:37 DEBUG : /: >Lookup: node=test_5.txt, err=<nil>
2022/10/14 09:19:37 DEBUG : test_5.txt: Attr:
2022/10/14 09:19:37 DEBUG : test_5.txt: >Attr: a=valid=720h0m0s ino=0 size=0 mode=-rw-rw-rw-, err=<nil>
2022/10/14 09:19:37 DEBUG : /: Attr:
2022/10/14 09:19:37 DEBUG : /: >Attr: attr=valid=720h0m0s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/10/14 09:19:39 DEBUG : Google drive root 'encrypted-data-sym-1': Checking for changes on remote
2022/10/14 09:19:40 DEBUG : vfs cache RemoveNotInUse (maxAge=1209600000000000, emptyOnly=false): item MyFiles/test.mp4 not removed, freed 0 bytes
2022/10/14 09:19:40 DEBUG : vfs cache RemoveNotInUse (maxAge=1209600000000000, emptyOnly=false): item MyFiles/test2.mp4 not removed, freed 0 bytes
2022/10/14 09:19:40 DEBUG : vfs cache RemoveNotInUse (maxAge=1209600000000000, emptyOnly=false): item MyFiles/test3.mp4 not removed, freed 0 bytes
2022/10/14 09:19:40 DEBUG : vfs cache RemoveNotInUse (maxAge=1209600000000000, emptyOnly=false): item MyFiles/test4.mp4 not removed, freed 0 bytes
2022/10/14 09:19:40 DEBUG : vfs cache RemoveNotInUse (maxAge=1209600000000000, emptyOnly=false): item MyFiles/test5.mp4 not removed, freed 0 bytes
2022/10/14 09:19:40 INFO : vfs cache: cleaned: objects 5 (was 5) in use 0, to upload 0, uploading 0, total size 2.041Gi (was 2.041Gi)
2022/10/14 09:19:49 DEBUG : Google drive root 'encrypted-data-sym-1': Checking for changes on remote
2022/10/14 09:19:59 DEBUG : Google drive root 'encrypted-data-sym-1': Checking for changes on remote
2022/10/14 09:20:03 DEBUG : /: ReadDirAll:
2022/10/14 09:20:03 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/10/14 09:20:03 DEBUG : /: Attr:
2022/10/14 09:20:03 DEBUG : /: >Attr: attr=valid=720h0m0s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/10/14 09:20:03 DEBUG : /: Attr:
2022/10/14 09:20:03 DEBUG : /: >Attr: attr=valid=720h0m0s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/10/14 09:20:08 DEBUG : /: ReadDirAll:
2022/10/14 09:20:08 DEBUG : /: >ReadDirAll: item=5, err=<nil>
2022/10/14 09:20:08 DEBUG : /: Attr:
2022/10/14 09:20:08 DEBUG : /: >Attr: attr=valid=720h0m0s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/10/14 09:20:08 DEBUG : /: Attr:
2022/10/14 09:20:08 DEBUG : /: >Attr: attr=valid=720h0m0s ino=0 size=0 mode=drwxrwxrwx, err=<nil>
2022/10/14 09:20:09 DEBUG : Google drive root 'encrypted-data-sym-1': Checking for changes on remote
2022/10/14 09:20:19 DEBUG : Google drive root 'encrypted-data-sym-1': Checking for changes on remote
rclone move command
rclone --config /boot/config/plugins/rclone/.rclone.conf move /mnt/user/data/staged_storage_2 google_drive_encrypted_vfs_2: --drive-service-account-file=/mnt/user/appdata/other/rclone/service_accounts/sa-account-9.json --user-agent=google_drive_encrypted_vfs_2 -vv --buffer-size 512M --drive-chunk-size 512M --tpslimit 8 --checkers 8 --transfers 4 --order-by modtime,ascending --exclude downloads/** --exclude tmp/** --exclude *fuse_hidden* --exclude *_HIDDEN --exclude .recycle** --exclude .Recycle.Bin/** --exclude *.backup~* --exclude *.partial~* --drive-stop-on-upload-limit --delete-empty-src-dirs
rclone move logs
2022/10/14 09:18:47 INFO : Starting transaction limiter: max 8 transactions/s with burst 1
2022/10/14 09:18:47 DEBUG : rclone: Version "v1.59.2" starting with parameters ["rcloneorig" "--config" "/boot/config/plugins/rclone/.rclone.conf" "--config" "/boot/config/plugins/rclone/.rclone.conf" "move" "/mnt/user/data/staged_storage_2" "google_drive_encrypted_vfs_2:" "--drive-service-account-file=/mnt/user/appdata/other/rclone/service_accounts/sa-account-9.json" "--user-agent=google_drive_encrypted_vfs_2" "-vv" "--buffer-size" "512M" "--drive-chunk-size" "512M" "--tpslimit" "8" "--checkers" "8" "--transfers" "4" "--order-by" "modtime,ascending" "--exclude" "downloads/**" "--exclude" "tmp/**" "--exclude" "*fuse_hidden*" "--exclude" "*_HIDDEN" "--exclude" ".recycle**" "--exclude" ".Recycle.Bin/**" "--exclude" "*.backup~*" "--exclude" "*.partial~*" "--drive-stop-on-upload-limit" "--delete-empty-src-dirs"]
2022/10/14 09:18:47 DEBUG : Creating backend with remote "/mnt/user/data/staged_storage_2"
2022/10/14 09:18:47 DEBUG : Using config file from "/boot/config/plugins/rclone/.rclone.conf"
2022/10/14 09:18:47 DEBUG : Creating backend with remote "google_drive_encrypted_vfs_2:"
2022/10/14 09:18:47 DEBUG : Creating backend with remote "google_drive:encrypted-data-sym-1"
2022/10/14 09:18:47 DEBUG : google_drive: detected overridden config - adding "{xZ0x2}" suffix to name
2022/10/14 09:18:48 DEBUG : fs cache: renaming cache item "google_drive:encrypted-data-sym-1" to be canonical "google_drive{xZ0x2}:encrypted-data-sym-1"
2022/10/14 09:18:48 DEBUG : Encrypted drive 'google_drive_encrypted_vfs_2:': Waiting for checks to finish
2022/10/14 09:18:48 DEBUG : Encrypted drive 'google_drive_encrypted_vfs_2:': Waiting for transfers to finish
2022/10/14 09:18:51 DEBUG : test_5.txt: md5 = 644594527b4647799e3ca44c457588a5 OK
2022/10/14 09:18:51 INFO : test_5.txt: Copied (new)
2022/10/14 09:18:51 INFO : test_5.txt: Deleted
2022/10/14 09:18:51 INFO :
Transferred: 32 B / 32 B, 100%, 15 B/s, ETA 0s
Checks: 2 / 2, 100%
Deleted: 1 (files), 0 (dirs)
Renamed: 1
Transferred: 1 / 1, 100%
Elapsed time: 3.7s
2022/10/14 09:18:51 DEBUG : 8 go routines active
The workflow is as follows
- Files are placed in /mnt/user/data/staged_storage_2
- On a timer (and if not already uploading) files are rclone moved from /mnt/user/data/staged_storage_2 to google_drive_encrypted_vfs_2:
- These files are supposed to appear in /mnt/user/data/remote_storage_2 but instead they dissappear.
- The files can be seen on Google Drive (and encrypted) after the rclone move, however, I have to either remount or kill -SIGHUP for them to show up in /mnt/user/data/remote_storage_2
Please let me know if you require any additional information