What is the problem you are having with rclone?
TL;DR My error looks a lot like: the topic on this forum with the topic Rclone Union issue with crypt (I can't include a link to it)
I want to crypt only part of my google drive, so I want to make a UNION between the unencrypted part of the drive and the encrypted part and mount on one mount point. I did the first set up on my Ubuntu server and it was working ok. I could create directories/files (encrypted when in the crypt part of the union, unencrypted when in the non-crypt part)
I then wanted to replicate that same setup on a second computer (MacOS on macbook pro) so I just copied the .rclone.conf from the Ubuntu server to the macbook. That's when the issues started.
After I mounted on the macbook everything stopped working essentially. I can no longer create directories or files in the mounted union on either the Ubuntu server or macbook. However, mounting either part of the union by themselves works fine.
What is your rclone version (output from rclone version)
Ubuntu server:
- rclone v1.53.1
MacOS server:
- rclone v1.53.1-DEV
Which OS you are using and how many bits (eg Windows 7, 64 bit)
Ubuntu 18.04.3 LTS x86_64
MacOS 10.15.7 64bit
Which cloud storage system are you using? (eg Google Drive)
Google Drive
The command you were trying to run (eg rclone copy /tmp remote:tmp)
rclone mount --rc --allow-other --use-mmap --dir-cache-time 168h --timeout 1h --umask 002 --poll-interval=1m --vfs-cache-mode writes --vfs-read-chunk-size 64M --vfs-read-chunk-size-limit 2048M --tpslimit 10 un:/ /rclone-mnt
However, I originally did run this with --allow-non-empty on both the Ubuntu server and macbook. In trying to google the issue have, it seems like that's a bad option to use, so I slightly suspect that could have caused some issues.
The rclone config contents with secrets removed.
[gdrive]
type = drive
client_id = REDACTED
client_secret = REDACTED
scope = drive
token = {"access_token":"REDACTED","token_type":"Bearer","refresh_token":"REDACTED","expiry":"2020-10-09T17:41:44.355799453Z"}
root_folder_id = 1-CXUQvforTZHo6hlvDd0wUyL_AV6hxYf
[crypt]
type = crypt
remote = zp:crypt_me
filename_encryption = standard
directory_name_encryption = true
password = REDACTED
password2 = REDACTED
[un]
type = union
upstreams = gdrive: crypt:
[zp]
type = drive
client_id = REDACTED
client_secret = REDACTED
scope = drive
root_folder_id = 1pM6TPaWkZ2YA1jrGpcOTRReuVtnd68Qj
token = {"access_token":"REDACTED","token_type":"Bearer","refresh_token":"REDACTED","expiry":"2020-10-09T17:41:43.705424937Z"}
A log from the command with the -vv flag
2020/10/09 17:17:55 NOTICE: Serving remote control on http://127.0.0.1:5572/
2020/10/09 17:17:55 DEBUG : Creating backend with remote "un:/"
2020/10/09 17:17:55 DEBUG : Using config file from "/.rclone.conf"
2020/10/09 17:17:55 INFO : Starting HTTP transaction limiter: max 10 transactions/s with burst 1
2020/10/09 17:17:55 DEBUG : Creating backend with remote "crypt:"
2020/10/09 17:17:55 DEBUG : Creating backend with remote "gdrive:"
2020/10/09 17:17:55 DEBUG : Creating backend with remote "zp:crypt_me"
2020/10/09 17:17:56 DEBUG : vfs cache: root is "/.cache/rclone/vfs/un"
2020/10/09 17:17:56 DEBUG : vfs cache: metadata root is "/.cache/rclone/vfs/un"
2020/10/09 17:17:56 DEBUG : Creating backend with remote "/.cache/rclone/vfs/un"
2020/10/09 17:17:56 DEBUG : in_crypt/test.txt: vfs cache: truncate to size=0
2020/10/09 17:17:56 DEBUG : in_crypt/test.txt: vfs cache: setting modification time to 2020-10-09 16:42:07.553710358 +0000 UTC
2020/10/09 17:17:56 INFO : in_crypt/test.txt: vfs cache: queuing for upload in 5s
2020/10/09 17:17:57 DEBUG : in_crypt: Added virtual directory entry vAdd: "test.txt"
2020/10/09 17:17:57 DEBUG : zp/thing.ttt: vfs cache: truncate to size=0
2020/10/09 17:17:57 DEBUG : zp/thing.ttt: vfs cache: setting modification time to 2020-10-09 15:30:37.956995131 +0000 UTC
2020/10/09 17:17:57 INFO : zp/thing.ttt: vfs cache: queuing for upload in 5s
2020/10/09 17:17:57 ERROR : zp/thing.ttt: vfs cache: failed to reload item: reload: failed to add virtual dir entry: file does not exist
2020/10/09 17:17:57 DEBUG : union root '/': Mounting on "/rclone-mnt"
2020/10/09 17:17:57 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item zp/thing.ttt not removed, freed 0 bytes
2020/10/09 17:17:57 DEBUG : vfs cache RemoveNotInUse (maxAge=3600000000000, emptyOnly=false): item in_crypt/test.txt not removed, freed 0 bytes
2020/10/09 17:17:57 INFO : vfs cache: cleaned: objects 2 (was 2) in use 2, to upload 2, uploading 0, total size 0 (was 0)
2020/10/09 17:17:57 DEBUG : : Root:
2020/10/09 17:17:57 DEBUG : : >Root: node=/, err=<nil>
2020/10/09 17:18:01 DEBUG : in_crypt/test.txt: vfs cache: starting upload
2020/10/09 17:18:02 DEBUG : zp/thing.ttt: vfs cache: starting upload
2020/10/09 17:18:03 ERROR : in_crypt/test.txt: Failed to copy: object not found
2020/10/09 17:18:03 ERROR : in_crypt/test.txt: vfs cache: failed to upload try #1, will retry in 10s: vfs cache: failed to transfer file from cache to remote: object not found
2020/10/09 17:18:04 ERROR : zp/thing.ttt: Failed to copy: object not found
2020/10/09 17:18:04 ERROR : zp/thing.ttt: vfs cache: failed to upload try #1, will retry in 10s: vfs cache: failed to transfer file from cache to remote: object not found
2020/10/09 17:18:13 DEBUG : in_crypt/test.txt: vfs cache: starting upload
2020/10/09 17:18:14 DEBUG : zp/thing.ttt: vfs cache: starting upload
2020/10/09 17:18:15 ERROR : in_crypt/test.txt: Failed to copy: object not found
2020/10/09 17:18:15 ERROR : in_crypt/test.txt: vfs cache: failed to upload try #2, will retry in 20s: vfs cache: failed to transfer file from cache to remote: object not found
2020/10/09 17:18:15 ERROR : zp/thing.ttt: Failed to copy: object not found
2020/10/09 17:18:15 ERROR : zp/thing.ttt: vfs cache: failed to upload try #2, will retry in 20s: vfs cache: failed to transfer file from cache to remote: object not found
2020/10/09 17:18:22 DEBUG : /: Attr:
2020/10/09 17:18:22 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2020/10/09 17:18:22 DEBUG : /: ReadDirAll:
2020/10/09 17:18:22 DEBUG : /: >ReadDirAll: item=2, err=<nil>
2020/10/09 17:18:23 DEBUG : /: Attr:
2020/10/09 17:18:23 DEBUG : /: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2020/10/09 17:18:23 DEBUG : /: ReadDirAll:
2020/10/09 17:18:23 DEBUG : /: >ReadDirAll: item=2, err=<nil>
2020/10/09 17:18:26 DEBUG : /: Lookup: name="media"
2020/10/09 17:18:26 DEBUG : /: >Lookup: node=media/, err=<nil>
2020/10/09 17:18:26 DEBUG : media/: Attr:
2020/10/09 17:18:26 DEBUG : media/: >Attr: attr=valid=1s ino=0 size=0 mode=drwxrwxr-x, err=<nil>
2020/10/09 17:18:28 DEBUG : media/: Lookup: name="test"
2020/10/09 17:18:29 DEBUG : media/: >Lookup: node=<nil>, err=no such file or directory
2020/10/09 17:18:29 DEBUG : media/: Mkdir: name="test"
2020/10/09 17:18:30 ERROR : media/: Dir.Mkdir failed to create directory: object not found
2020/10/09 17:18:30 DEBUG : media/: >Mkdir: node=<nil>, err=no such file or directory
^C2020/10/09 17:18:33 INFO : Signal received: interrupt
2020/10/09 17:18:33 DEBUG : vfs cache: cleaner exiting
2020/10/09 17:18:33 INFO : Exiting...
In the log above the in_crypt/test.txt, zp/thing.ttt were things I tried to make a while ago, and those error come up again when I run the mount command. while that command was running, I tried to make the directory test inside media/ (which is in my gdrive remote) and got the error you see.
I've also tried
rclone rc vfs/forget and rclone rc vfs/refresh recursive=true with no luck thinking that there was an issue with the cache needing cleaned/refreshed.