Rclone mount crypt (amazon drive) filed destroyed on edit/save

Suspected Bug
1

OS: Ubuntu 16.04 64Bit LTS
Version: rclone v1.35

Mount params:
rclone mount --allow-non-empty --allow-other -v --dump-headers --log-file=/var/log/cryptmount.log acdcrypt: /storage/acdcrypt/

Editing files directly on drive will cause errors and the file will be 0 size, so not only that you cant edit, it will destroy whatever file you open/edit and save.

Preformed test
nano /storage/acdcrypt/mountcrypttestfile.txt + adding one more line into the file.

LOG

2017/01/06 12:33:45 >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/01/06 12:33:45 HTTP REQUEST (req 0xc4201fc0f0)
2017/01/06 12:33:45 PUT /cdproxy/nodes/****/content HTTP/1.1
Host: content-eu.drive.amazonaws.com
User-Agent: rclone/v1.35
Transfer-Encoding: chunked
Authorization: XXXX
Content-Type: multipart/form-data; boundary=*****
Accept-Encoding: gzip

2017/01/06 12:33:45 >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/01/06 12:33:45 .mountcrypttestfile.txt.swp: WriteFileHandle.Write OK (1024 bytes written)
2017/01/06 12:33:45 .mountcrypttestfile.txt.swp: WriteFileHandle.Flush
2017/01/06 12:33:45 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2017/01/06 12:33:45 HTTP RESPONSE (req 0xc4201fc0f0)
2017/01/06 12:33:45 HTTP/1.1 429 Too Many Requests
Content-Length: 85
Connection: keep-alive
Content-Type: application/vnd.error+json
Date: Fri, 06 Jan 2017 11:33:45 GMT
Server: Amazon-Cloud-Drive
X-Amzn-Requestid: *****

2017/01/06 12:33:45 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2017/01/06 12:33:45 .mountcrypttestfile.txt.swp: Error detected after finished upload - waiting to see if object was uploaded correctly: HTTP code 429: "429 Too Many Requests": response body: "{"logref":"","message":"Rate exceeded","code":""}" ("429 Too Many Requests")*
2017/01/06 12:33:45 >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/01/06 12:33:45 HTTP REQUEST (req 0xc4205223c0)
2017/01/06 12:33:45 GET /drive/v1/nodes?filters=parents%3A%22aNCTv7LvSCaAAU9y-KXnOQ%22+AND+name%3A%22rstkdthr56q42f7ake5hpe1ibgmbn4avkeu8e9nvef7nvrup7hc0%22 HTTP/1.1
Host: cdws.eu-west-1.amazonaws.com
User-Agent: rclone/v1.35
Authorization: XXXX
Accept-Encoding: gzip

2017/01/06 12:33:45 >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/01/06 12:33:45 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2017/01/06 12:33:45 HTTP RESPONSE (req 0xc4205223c0)
2017/01/06 12:33:45 HTTP/1.1 200 OK
Cache-Control: no-store
Connection: keep-alive
Content-Type: application/json
Date: Fri, 06 Jan 2017 11:33:45 GMT
Pragma: no-cache
Server: Server
Vary: User-Agent
X-Amzn-Requestid: ***

2017/01/06 12:33:45 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2017/01/06 12:33:45 .mountcrypttestfile.txt.swp: Object not found - waiting (1/1)
> 2017/01/06 12:33:48 mountcrypttestfile.txt: Giving up waiting for object - returning original error: HTTP code 429: "429 Too Many Requests": response body: "{"logref":"","message":"Rate exceeded","code":""}" ("429 Too Many Requests")*
2017/01/06 12:33:48 pacer: Rate limited, sleeping for 884.491574ms (1 consecutive low level retries)
2017/01/06 12:33:48 pacer: low level retry 1/1 (error HTTP code 429: "429 Too Many Requests": response body: "{"logref":"","message":"Rate exceeded","code":""}")
2017/01/06 12:33:48 mountcrypttestfile.txt: WriteFileHandle.Release error: HTTP code 429: "429 Too Many Requests": response body: "{"logref":"","message":"Rate exceeded","code":""}"
2017/01/06 12:33:50 .mountcrypttestfile.txt.swp: Giving up waiting for object - returning original error: HTTP code 429: "429 Too Many Requests": response body: "{"logref":"","message":"Rate exceeded","code":""}" ("429 Too Many Requests")
2017/01/06 12:33:50 pacer: Rate limited, sleeping for 1.414458836s (2 consecutive low level retries)
2017/01/06 12:33:50 pacer: low level retry 1/1 (error HTTP code 429: "429 Too Many Requests": response body: "{"logref":"","message":"Rate exceeded","code":""}")
2017/01/06 12:33:50 .mountcrypttestfile.txt.swp: WriteFileHandle.Flush error: HTTP code 429: "429 Too Many Requests": response body: "{"logref":"***","message":"Rate exceeded","code":""}"
2017/01/06 12:33:50 .mountcrypttestfile.txt.swp: WriteFileHandle.Release nothing to do
2017/01/06 12:34:06 mountcrypttestfile.txt: File.Open
2017/01/06 12:34:06 >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/01/06 12:34:06 HTTP REQUEST (req 0xc4201fc690)
2017/01/06 12:34:06 GET /drive/v1/nodes?filters=parents%3A%22aNCTv7LvSCaAAU9y-KXnOQ%22+AND+name%3A%22sactesjb8961verpkq5691d9lp8uj4fqepode691ibj0tmg7vchg%22 HTTP/1.1
Host: cdws.eu-west-1.amazonaws.com
User-Agent: rclone/v1.35
Authorization: XXXX
Accept-Encoding: gzip

2017/01/06 12:34:06 mountcrypttestfile.txt: File.Attr
2017/01/06 12:34:06 >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/01/06 12:34:06 mountcrypttestfile.txt: WriteFileHandle.Write len=39
2017/01/06 12:34:07 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2017/01/06 12:34:07 HTTP RESPONSE (req 0xc4201fc690)
2017/01/06 12:34:07 HTTP/1.1 200 OK
Cache-Control: no-store
Connection: keep-alive
Content-Type: application/json
Date: Fri, 06 Jan 2017 11:34:07 GMT
Pragma: no-cache
Server: Server
Vary: User-Agent
X-Amzn-Requestid: ***

2017/01/06 12:34:07 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2017/01/06 12:34:07 pacer: Resetting sleep to minimum 20ms on success
2017/01/06 12:34:08 >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/01/06 12:34:08 HTTP REQUEST (req 0xc4200ded20)
2017/01/06 12:34:08 PUT /cdproxy/nodes/z4ceu1t3TF68t5hVcKJ0gA/content HTTP/1.1
Host: content-eu.drive.amazonaws.com
User-Agent: rclone/v1.35
Transfer-Encoding: chunked
Authorization: XXXX
Content-Type: multipart/form-data; boundary=***
Accept-Encoding: gzip

2017/01/06 12:34:08 >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/01/06 12:34:08 mountcrypttestfile.txt: WriteFileHandle.Write OK (39 bytes written)
2017/01/06 12:34:08 mountcrypttestfile.txt: WriteFileHandle.Flush
2017/01/06 12:34:08 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2017/01/06 12:34:08 HTTP RESPONSE (req 0xc4200ded20)
2017/01/06 12:34:08 HTTP/1.1 200 OK
Content-Length: 642
Connection: keep-alive
Content-Type: application/json
Date: Fri, 06 Jan 2017 11:34:08 GMT
Server: Amazon-Cloud-Drive
X-Amzn-Requestid: ***

2017/01/06 12:34:08 <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2017/01/06 12:34:08 mountcrypttestfile.txt: WriteFileHandle.Flush OK
2017/01/06 12:34:08 mountcrypttestfile.txt: WriteFileHandle.Release nothing to do
2017/01/06 12:34:08 : Dir.Attr
2017/01/06 12:34:08 mountcrypttestfile.txt: File.Attr
2017/01/06 12:34:08 .mountcrypttestfile.txt.swp: Dir.Remove
2017/01/06 12:34:08 .mountcrypttestfile.txt.swp: Dir.Remove error: no such file or directory
2017/01/06 12:34:16 : Dir.ReadDirAll

It would be great if editing could be fixed, but at least file destruction should be prevented.

p.s. Copying, Moving, Renaming, Overwriting files works.

2

I have the same issue with this setup:

https://forum.rclone.org/t/dirclean-delete-oldest-files-until-dir-size-is-less-than-threshold/635/6

3

Hopefully someone skilled can look into it, I assume acd_cli do it as it works there.
There are lots of people setting up direct upload (nzb, torrents) to mounted drive using acd_cli atm.

4

Same here. I get it when creating an encrypted cryfs mount.

# cryfs enc/ dec/
CryFS Version 0.9.6

[2017-01-10 00:04:40.420] [Log] [error] Could not delete tempfile.
Error: Error accessing base directory.

rclone mount:

tempfile: WriteFileHandle.Release error: HTTP code 429: "429 Too Many Requests": response body: "{"logref":"xxxxxxxx-xxxx-xxxx-xxxx-xxxxexxxxxxx","message":"Rate exceeded","code":""}"
tempfile: Dir.Remove error: no such file or directory

5

I’m seeing this as well just in moving and renaming files.