I was just checking on my new plex server ( after almost 7 days I manage to transfer 40TB from acdDE to acdUK )
rclone v1.35-92-g18c75a8β ( note you need to set -vv flag to see debug in logs )
Rclone mount options:
rclone mount \ --read-only \ --allow-other \ --acd-templink-threshold 0 \ -vv \ --debug-fuse \ --dump-headers \ --log-file=/home/plex/logs/mountacdcrypt.log \ acdcrypt: /mnt/acdcrypt &
Unionfs mount options:
unionfs-fuse
-o cow,allow_other,auto_cache
/storage/local=RW:/mnt/acdcrypt=RO
/mnt/unionfs
I did full Library scan 2700+ movies and 13K+ episodes, and bellow are different type of errors in log
2017/02/13 22:53:59 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/02/13 22:54:01 DEBUG : fuse: <- Lookup [ID=0x148 Node=0x1 Uid=1000 Gid=1000 Pid=2696] “crypt-check”
2017/02/13 22:54:01 DEBUG : crypt-check: Dir.Lookup
2017/02/13 22:54:01 DEBUG : crypt-check: Dir.Lookup OK
2017/02/13 22:54:01 DEBUG : crypt-check: File.Attr
2017/02/13 22:54:01 DEBUG : fuse: -> [ID=0x148] Lookup 0x3 gen=0 valid=1m0s attr={valid=1m0s ino=1551189674461498721 size=26 mode=-rw-r–r--}
2017/02/13 22:54:01 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2017/02/13 22:54:01 DEBUG : HTTP RESPONSE (req 0xc42011e3c0)
2017/02/13 22:54:01 DEBUG : HTTP/1.1 500 Internal Server Error
Content-Length: 30
Connection: keep-alive
Content-Type: application/vnd.error+json
Date: Mon, 13 Feb 2017 21:54:01 GMT
Server: Amazon-Cloud-Drive
X-Amzn-Requestid: 6ed04bb2-9ae3-4a94-a14a-f71faacc5fd1
2017/02/13 22:54:01 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2017/02/13 22:54:01 DEBUG : pacer: Rate limited, sleeping for 204.764712ms (1 consecutive low level retries)
2017/02/13 22:54:01 DEBUG : pacer: low level retry 1/10 (error )
2017/02/13 22:54:01 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/02/13 22:54:01 DEBUG : HTTP REQUEST (req 0xc42022a870)
2017/02/13 22:54:01 DEBUG : GET /cdproxy/templink/8twGWQWZa_H-qLmq1zoTN3uUnfkxJqTP0xyo23vhXNI38XJVg HTTP/1.1
Host: content-eu.drive.amazonaws.com
User-Agent: rclone/v1.35-92-g18c75a8β
Range: bytes=3985561632-
2017/02/13 22:54:01 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/02/13 22:57:26 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2017/02/13 22:57:26 DEBUG : pacer: Rate limited, sleeping for 967.209084ms (2 consecutive low level retries)
2017/02/13 22:57:26 DEBUG : pacer: low level retry 1/10 (error )
2017/02/13 22:57:26 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/02/13 22:57:26 DEBUG : HTTP REQUEST (req 0xc420c042d0)
2017/02/13 22:57:26 DEBUG : GET /cdproxy/templink/3b1md-tWMFm6eXlkcVn6Y1B0zN-1Q4LkI19lVe0i9ks38XJVg HTTP/1.1
Host: content-eu.drive.amazonaws.com
User-Agent: rclone/v1.35-92-g18c75a8β
Range: bytes=3804965872-
2017/02/13 22:57:31 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2017/02/13 22:57:31 DEBUG : movies/Babe (1995)/Babe (1995).mkv: ReadFileHandle.Read OK
2017/02/13 22:57:31 DEBUG : fuse: -> [ID=0x9ad] Read 126976
2017/02/13 22:57:31 DEBUG : movies/Babe (1995)/Babe (1995).mkv: ReadFileHandle.Read size 4096 offset 4434046976
2017/02/13 22:57:31 DEBUG : movies/Babe (1995)/Babe (1995).mkv: ReadFileHandle.seek from 4434178048 to 4434046976 (io.Seeker)
2017/02/13 22:57:31 DEBUG : hm2ka8or5qp1pefhtc1e62jn50/nt3r0na3fq7sro4pvmq2hru334/jbhqa01i3eoqaak77n8dcfev8s: Dowloading large object via tempLink
2017/02/13 22:57:31 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/02/13 22:57:31 DEBUG : HTTP REQUEST (req 0xc420544960)
2017/02/13 22:57:31 DEBUG : GET /cdproxy/templink/obC0oKRk8ChbcikRCNgzQ_IuwtZh0K8Y2bIIBrPiUgs38XJVg HTTP/1.1
Host: content-eu.drive.amazonaws.com
User-Agent: rclone/v1.35-92-g18c75a8β
Range: bytes=4435117248-
2017/02/13 22:57:31 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2017/02/13 22:57:34 DEBUG : fuse: <- Lookup [ID=0x9af Node=0x1 Uid=1000 Gid=1000 Pid=1754] “.unionfs-fuse”
2017/02/13 22:57:34 DEBUG : .unionfs-fuse: Dir.Lookup
2017/02/13 22:57:34 DEBUG : fuse: -> [ID=0x9af] Lookup error=ENOENT
2017/02/13 22:57:34 DEBUG : fuse: <- Open [ID=0x9b0 Node=0x2 Uid=1000 Gid=1000 Pid=1754] dir=true fl=OpenReadOnly+OpenDirectory+OpenNonblock
2017/02/13 22:57:34 DEBUG : fuse: -> [ID=0x9b0] Open 0x2 fl=0
2017/02/13 22:57:34 DEBUG : fuse: <- Read [ID=0x9b1 Node=0x2 Uid=1000 Gid=1000 Pid=1754] 0x2 4096 @0x0 dir=true fl=0 lock=0 ffl=OpenReadOnly+OpenDirectory+OpenNonblock
2017/02/13 22:57:34 DEBUG : movies: Dir.ReadDirAll
2017/02/13 22:57:34 DEBUG : movies: Dir.ReadDirAll OK with 2770 entries
Most of the errors in log are fuse one:
2017/02/13 23:03:24 DEBUG : fuse: -> [ID=0x192e3] Lookup 0x20c7 gen=20 valid=1m0s attr={valid=1m0s ino=12813857630482816394 size=7033188210 mode=-rw-r–r--}
2017/02/13 23:03:24 DEBUG : fuse: <- Lookup [ID=0x192e4 Node=0x1 Uid=1000 Gid=1000 Pid=1754] “.unionfs-fuse”
2017/02/13 23:03:24 DEBUG : .unionfs-fuse: Dir.Lookup
2017/02/13 23:03:24 DEBUG : fuse: -> [ID=0x192e4] Lookup error=ENOENT
Those are really constantly spaming in log file, like every second …
@ncw any idea what are those
Those are more then likely corrupted files, I dont have any those errors in my log.