Copy files through cache crypt mount

Suspected Bug
1

Hello,

my mount: ( GD > cache > crypt)
rclone mount GD: /mount --allow-non-empty --allow-other --buffer-size 256M --cache-db-purge --cache-info-age=6h --cache-workers=10 --cache-chunk-size=8M --cache-total-chunk-size=10G

as you can see the cache-info-age is 6h. To update cache immediately I would copy files through the cache.
I have tried it with cp and rsync. In both I got errors.

cp:
cp /jd/265_DEXT_1/ /mount/tv/Test/S01 -r
cp: error writing ‘/mount/tv/Test/S01/265Testfile.s01e04.1080p-4.mkv’: Input/output error
cp: failed to close ‘/mount/tv/Test/S01/265Testfile.s01e04.1080p-4.mkv’: Input/output error

rsync
rsync /jd/265_DEXT_1/ /mount/tv/Test/S01 -r --progress
sending incremental file list
265Testfile.s01e01.1080p-1.mkv
1,171,123,034 100% 30.66MB/s 0:00:36 (xfr#1, to-chk=11/13)
265Testfile.s01e02.1080p-2.mkv
1,240,992,657 100% 25.11MB/s 0:00:47 (xfr#2, to-chk=10/13)
265Testfile.s01e03.1080p-3.mkv
1,349,462,772 100% 19.35MB/s 0:01:06 (xfr#3, to-chk=9/13)
265Testfile.s01e04.1080p-4.mkv
1,299,117,367 100% 25.11MB/s 0:00:49 (xfr#4, to-chk=8/13)
265Testfile.s01e05.1080p-5.mkv
1,336,443,530 100% 25.79MB/s 0:00:49 (xfr#5, to-chk=7/13)
265Testfile.s01e06.1080p-6.mkv
1,189,044,824 100% 26.50MB/s 0:00:42 (xfr#6, to-chk=6/13)
265Testfile.s01e07.1080p-7.mkv
1,231,632,079 100% 22.95MB/s 0:00:51 (xfr#7, to-chk=5/13)
265Testfile.s01e08.1080p-8.mkv
1,282,127,808 100% 48.22MB/s 0:00:25 (xfr#8, to-chk=4/13)
265Testfile.s01e09.1080p-9.mkv
1,265,477,724 100% 88.94MB/s 0:00:13 (xfr#9, to-chk=3/13)
265Testfile.s01e10.1080p-10.mkv
1,762,229,027 100% 93.95MB/s 0:00:17 (xfr#10, to-chk=2/13)
265Testfile.s01e11.1080p-11.mkv
1,342,641,869 100% 90.36MB/s 0:00:14 (xfr#11, to-chk=1/13)
265Testfile.s01e12.1080p-12.mkv
1,526,365,796 100% 97.32MB/s 0:00:14 (xfr#12, to-chk=0/13)
rsync: write failed on “/mount/tv/Test/S01/265Testfile.s01e08.1080p-8.mkv”: Illegal seek (29)
rsync error: error in file IO (code 11) at receiver.c(393) [receiver=3.1.2]

rclone log:

2018/03/15 16:53:09 ERROR : tv/Test/S01/265Testfile.s01e04.1080p-4.mkv: WriteFileHandle.New Rcat failed: googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded
2018/03/15 16:53:09 ERROR : tv/Test/S01/265Testfile.s01e04.1080p-4.mkv: WriteFileHandle.Write error: io: read/write on closed pipe
2018/03/15 16:53:09 ERROR : tv/Test/S01/265Testfile.s01e04.1080p-4.mkv: WriteFileHandle.Flush error: googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded
2018/03/15 17:00:48 ERROR : tv/Test/S01/.265Testfile.s01e08.1080p-8.mkv.236xwP: error saving in cache: googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded
2018/03/15 17:00:48 ERROR : tv/Test/S01/.265Testfile.s01e08.1080p-8.mkv.236xwP: WriteFileHandle.New Rcat failed: googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded
2018/03/15 17:00:48 ERROR : tv/Test/S01/.265Testfile.s01e08.1080p-8.mkv.236xwP: WriteFileHandle.Write error: io: read/write on closed pipe
2018/03/15 17:00:48 ERROR : tv/Test/S01/.265Testfile.s01e08.1080p-8.mkv.236xwP: WriteFileHandle.Write: can’t seek in file without --vfs-cache-mode >= writes
2018/03/15 17:00:48 ERROR : tv/Test/S01/.265Testfile.s01e08.1080p-8.mkv.236xwP: WriteFileHandle.Write: can’t seek in file without --vfs-cache-mode >= writes
2018/03/15 17:00:48 ERROR : tv/Test/S01/.265Testfile.s01e08.1080p-8.mkv.236xwP: WriteFileHandle.Flush error: googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded

2

I’m also experiencing similar errors when trying to rsync a file from local storage to cache crypt mount (GD > cache > crypt). Sometimes it works, sometimes it fails while outputting various errors. I also noticed some of the “successfully” uploaded files had a bunch of corruption/visual glitches during playback.

Here are some of the errors I’m seeing (using either rsync or cp):

2018/04/04 11:59:10 ERROR : sbl67boqq50rsiq43h962stnq0/nla4uevhuiollvvl0c0jrv7a4s/0b6l9m07ve10k3sea39sh24flsiq0m202a5lsd7bdslf25s9rc8uvbr3iglm8hs5102kssbkg7rh5ufqfek9e3icos636m70kq0efro/mslnhkpm1o6ojhmrdnrqrr38mk/dh2q6fu0llhrt7v6vvj8ekctir0m71bvngv0lqqrvs5i0fkopjg6d66vl231f5uql21rh1q05kemm4tdfmpruivus1lfutbgeq351cbi257m4fgmsajtis9ffgun6km7pmuvmhijrc0muj0m94su3j78pu4jrpkspr8cild7tfdrqqbsmghqghb1h06219vp9afl1rln0dthd7ubs78b9mlund62qijgkrdicf0: corrupted on transfer
2018/04/04 11:59:10 ERROR : sbl67boqq50rsiq43h962stnq0/nla4uevhuiollvvl0c0jrv7a4s/0b6l9m07ve10k3sea39sh24flsiq0m202a5lsd7bdslf25s9rc8uvbr3iglm8hs5102kssbkg7rh5ufqfek9e3icos636m70kq0efro/mslnhkpm1o6ojhmrdnrqrr38mk/dh2q6fu0llhrt7v6vvj8ekctir0m71bvngv0lqqrvs5i0fkopjg6d66vl231f5uql21rh1q05kemm4tdfmpruivus1lfutbgeq351cbi257m4fgmsajtis9ffgun6km7pmuvmhijrc0muj0m94su3j78pu4jrpkspr8cild7tfdrqqbsmghqghb1h06219vp9afl1rln0dthd7ubs78b9mlund62qijgkrdicf0: WriteFileHandle.New Rcat failed: corrupted on transfer
2018/04/04 11:59:10 ERROR : sbl67boqq50rsiq43h962stnq0/nla4uevhuiollvvl0c0jrv7a4s/0b6l9m07ve10k3sea39sh24flsiq0m202a5lsd7bdslf25s9rc8uvbr3iglm8hs5102kssbkg7rh5ufqfek9e3icos636m70kq0efro/mslnhkpm1o6ojhmrdnrqrr38mk/dh2q6fu0llhrt7v6vvj8ekctir0m71bvngv0lqqrvs5i0fkopjg6d66vl231f5uql21rh1q05kemm4tdfmpruivus1lfutbgeq351cbi257m4fgmsajtis9ffgun6km7pmuvmhijrc0muj0m94su3j78pu4jrpkspr8cild7tfdrqqbsmghqghb1h06219vp9afl1rln0dthd7ubs78b9mlund62qijgkrdicf0: WriteFileHandle.Flush error: corrupted on transfer
2018/04/04 11:59:10 NOTICE: sbl67boqq50rsiq43h962stnq0/nla4uevhuiollvvl0c0jrv7a4s/0b6l9m07ve10k3sea39sh24flsiq0m202a5lsd7bdslf25s9rc8uvbr3iglm8hs5102kssbkg7rh5ufqfek9e3icos636m70kq0efro/mslnhkpm1o6ojhmrdnrqrr38mk/dh2q6fu0llhrt7v6vvj8ekctir0m71bvngv0lqqrvs5i0fkopjg6d66vl231f5uql21rh1q05kemm4tdfmpruivus1lfutbgeq351cbi257m4fgmsajtis9ffgun6km7pmuvmhijrc0muj0m94su3j78pu4jrpkspr8cild7tfdrqqbsmghqghb1h06219vp9afl1rln0dthd7ubs78b9mlund62qijgkrdicf0: Removing partially written file on error: close /mnt/remote-cache/sbl67boqq50rsiq43h962stnq0/nla4uevhuiollvvl0c0jrv7a4s/0b6l9m07ve10k3sea39sh24flsiq0m202a5lsd7bdslf25s9rc8uvbr3iglm8hs5102kssbkg7rh5ufqfek9e3icos636m70kq0efro/mslnhkpm1o6ojhmrdnrqrr38mk/dh2q6fu0llhrt7v6vvj8ekctir0m71bvngv0lqqrvs5i0fkopjg6d66vl231f5uql21rh1q05kemm4tdfmpruivus1lfutbgeq351cbi257m4fgmsajtis9ffgun6km7pmuvmhijrc0muj0m94su3j78pu4jrpkspr8cild7tfdrqqbsmghqghb1h06219vp9afl1rln0dthd7ubs78b9mlund62qijgkrdicf0: input/output error
2018/04/04 11:59:14 ERROR : videos/series/My Next Guest Needs No Introduction With David Letterman/Season 1/My Next Guest Needs No Introduction With David Letterman - S01E01 - It's a Whole New Ball Game Now (WEBDL-1080p x264 AC3 NTb).mkv: WriteFileHandle.New Rcat failed: close /mnt/remote-cache/sbl67boqq50rsiq43h962stnq0/nla4uevhuiollvvl0c0jrv7a4s/0b6l9m07ve10k3sea39sh24flsiq0m202a5lsd7bdslf25s9rc8uvbr3iglm8hs5102kssbkg7rh5ufqfek9e3icos636m70kq0efro/mslnhkpm1o6ojhmrdnrqrr38mk/dh2q6fu0llhrt7v6vvj8ekctir0m71bvngv0lqqrvs5i0fkopjg6d66vl231f5uql21rh1q05kemm4tdfmpruivus1lfutbgeq351cbi257m4fgmsajtis9ffgun6km7pmuvmhijrc0muj0m94su3j78pu4jrpkspr8cild7tfdrqqbsmghqghb1h06219vp9afl1rln0dthd7ubs78b9mlund62qijgkrdicf0: input/output error
2018/04/04 11:59:14 ERROR : videos/series/My Next Guest Needs No Introduction With David Letterman/Season 1/My Next Guest Needs No Introduction With David Letterman - S01E01 - It's a Whole New Ball Game Now (WEBDL-1080p x264 AC3 NTb).mkv: WriteFileHandle.Flush error: close /mnt/remote-cache/sbl67boqq50rsiq43h962stnq0/nla4uevhuiollvvl0c0jrv7a4s/0b6l9m07ve10k3sea39sh24flsiq0m202a5lsd7bdslf25s9rc8uvbr3iglm8hs5102kssbkg7rh5ufqfek9e3icos636m70kq0efro/mslnhkpm1o6ojhmrdnrqrr38mk/dh2q6fu0llhrt7v6vvj8ekctir0m71bvngv0lqqrvs5i0fkopjg6d66vl231f5uql21rh1q05kemm4tdfmpruivus1lfutbgeq351cbi257m4fgmsajtis9ffgun6km7pmuvmhijrc0muj0m94su3j78pu4jrpkspr8cild7tfdrqqbsmghqghb1h06219vp9afl1rln0dthd7ubs78b9mlund62qijgkrdicf0: input/output error

My rclone mount parameters:
--buffer-size 0M --allow-other --uid 115 --gid 1001 --cache-chunk-path=/mnt/storage/Temporary/Rclone-Temp/Chunks/ --cache-tmp-upload-path=/mnt/storage/Temporary/Rclone-Temp/Upload/ --cache-chunk-size=10M --cache-total-chunk-size=100G --cache-info-age=168h

My rsync command:
rsync -v -azh --stats --inplace --ignore-existing /mnt/storage/Media/videos/ /mnt/remote/videos/

3

For the first one, I’m guessing your workers might be too high? You are getting rate limited as you might be copying too many files at the same time? I’m not sure if rsync does it serially or does some parallel processing, but with 10 workers, you’d spawn 10 threads per file you try to copy and if it did more than 1 at a time, you’d hammer the API hits.

I’m using Sonarr/Radarr to move files and haven’t see any rate limit errors and have been dropping files in the cache routinely over the last week.

I’d personally do rclone copy or syncs or moves if I was trying to bulk move stuff and the cache will get updates via the polling.