Errors with cached and encrypted google drive

Help and Support
1

First the config Left out the password stuff obviously. Im mounting google>gcache>gcrypt

i used rcopy to copy my archive to media:movies/archive. I went to play a movie in plex and it would take 45 sec to start and then stop. so I went to bash and tried a cp from cach to a tmp local dir. And am getting weird errors. Debug log is attached. it looks like it stops seeking and gets eof and wont move to next chunk in file. then it hangs and retries forever. Any hints appreciated

[gcache]
type = cache
remote = google:media
chunk_total_size = 32G
plex_url = http://localhost:32400
chunk_size = 10M

[gcrypt]
type = crypt
remote = gcache:
filename_encryption = standard
directory_name_encryption = true

mount cmd

rclone mount gcrypt: /mnt/disks/media --allow-other --dir-cache-time=12h --cache-info-age=12h --cache-chunk-path=/mnt/user/rc_chunks --cache-db-path=/mnt/user/rc_db --cache-workers=5 --cache-tmp-upload-path=/mnt/user/rclone_upload --cache-tmp-wait-time 60m --buffer-size 0M --attr-timeout=1s --rc --log-level INFO --log-file=/mnt/user/data/rclog/rclonecache.log &

example debug output

=<nil>
2018/04/11 20:14:10 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: cache reader closed 32
2018/04/11 20:14:11 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: moving offset set from 0 to 5113088
2018/04/11 20:14:11 ERROR : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: unexpected conditions during reading. current position: 5242880, current chunk position: 0, current chunk size: 5242880, offset: 5242880, chunk size: 10485760, file size: 14080545571
2018/04/11 20:14:11 ERROR : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: (5242880/14080545571) error (unexpected EOF) response
2018/04/11 20:14:11 ERROR : movies/archive/Avatar (2009)/Avatar [2009, PG-13, 7.2].mkv: ReadFileHandle.Read error: low level retry 3/10: unexpected EOF
2018/04/11 20:14:11 DEBUG : movies/archive/Avatar (2009)/Avatar [2009, PG-13, 7.2].mkv: ReadFileHandle.seek from 5111808 to 5111808
2018/04/11 20:14:12 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: cache reader closed 5242880
2018/04/11 20:14:12 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: moving offset set from 0 to 0
2018/04/11 20:14:13 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: cache reader closed 32
2018/04/11 20:14:13 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: moving offset set from 0 to 5113088
2018/04/11 20:14:13 ERROR : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: unexpected conditions during reading. current position: 5242880, current chunk position: 0, current chunk size: 5242880, offset: 5242880, chunk size: 10485760, file size: 14080545571
2018/04/11 20:14:13 ERROR : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: (5242880/14080545571) error (unexpected EOF) response
2018/04/11 20:14:13 ERROR : movies/archive/Avatar (2009)/Avatar [2009, PG-13, 7.2].mkv: ReadFileHandle.Read error: low level retry 4/10: unexpected EOF
2018/04/11 20:14:13 DEBUG : movies/archive/Avatar (2009)/Avatar [2009, PG-13, 7.2].mkv: ReadFileHandle.seek from 5111808 to 5111808
2018/04/11 20:14:14 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: cache reader closed 5242880
2018/04/11 20:14:14 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: moving offset set from 0 to 0
2018/04/11 20:14:15 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: cache reader closed 32
2018/04/11 20:14:16 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: moving offset set from 0 to 5113088
2018/04/11 20:14:16 ERROR : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: unexpected conditions during reading. current position: 5242880, current chunk position: 0, current chunk size: 5242880, offset: 5242880, chunk size: 10485760, file size: 14080545571
2018/04/11 20:14:16 ERROR : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: (5242880/14080545571) error (unexpected EOF) response
2018/04/11 20:14:16 ERROR : movies/archive/Avatar (2009)/Avatar [2009, PG-13, 7.2].mkv: ReadFileHandle.Read error: low level retry 5/10: unexpected EOF
2018/04/11 20:14:16 DEBUG : movies/archive/Avatar (2009)/Avatar [2009, PG-13, 7.2].mkv: ReadFileHandle.seek from 5111808 to 5111808
2018/04/11 20:14:17 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: cache reader closed 5242880
2018/04/11 20:14:17 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: moving offset set from 0 to 0
2018/04/11 20:14:18 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: cache reader closed 32
2018/04/11 20:14:18 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: moving offset set from 0 to 5113088
2018/04/11 20:14:18 ERROR : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: unexpected conditions during reading. current position: 5242880, current chunk position: 0, current chunk size: 5242880, offset: 5242880, chunk size: 10485760, file size: 14080545571
2018/04/11 20:14:18 ERROR : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: (5242880/14080545571) error (unexpected EOF) response
2018/04/11 20:14:18 ERROR : movies/archive/Avatar (2009)/Avatar [2009, PG-13, 7.2].mkv: ReadFileHandle.Read error: low level retry 6/10: unexpected EOF
2018/04/11 20:14:18 DEBUG : movies/archive/Avatar (2009)/Avatar [2009, PG-13, 7.2].mkv: ReadFileHandle.seek from 5111808 to 5111808
2018/04/11 20:14:19 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: cache reader closed 5242880
2018/04/11 20:14:20 DEBUG : : Statfs:
2018/04/11 20:14:20 DEBUG : : >Statfs: stat={Blocks:274877906944 Bfree:274877906944 Bavail:274877906944 Files:1000000000 Ffree:1000000000 Bsize:4096 Namelen:255 Frsize:4096}, err=<nil>
2018/04/11 20:14:20 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: moving offset set from 0 to 0
2018/04/11 20:14:21 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: cache reader closed 32
2018/04/11 20:14:21 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: moving offset set from 0 to 5113088
2018/04/11 20:14:21 ERROR : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: unexpected conditions during reading. current position: 5242880, current chunk position: 0, current chunk size: 5242880, offset: 5242880, chunk size: 10485760, file size: 14080545571
2018/04/11 20:14:21 ERROR : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: (5242880/14080545571) error (unexpected EOF) response
2018/04/11 20:14:21 ERROR : movies/archive/Avatar (2009)/Avatar [2009, PG-13, 7.2].mkv: ReadFileHandle.Read error: low level retry 7/10: unexpected EOF
2018/04/11 20:14:21 DEBUG : movies/archive/Avatar (2009)/Avatar [2009, PG-13, 7.2].mkv: ReadFileHandle.seek from 5111808 to 5111808
2018/04/11 20:14:22 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: cache reader closed 5242880
2018/04/11 20:14:22 DEBUG : jsne1to61hhnfe60c3l6migfs8/m0jfdgpi9uphi8jfflfk0kvj18/4k27nadlo1b0e61cjknno5f9i0/57r2il505tkraduoko4foajakvfa8skpnikanqa8f4m21qs3htb0: moving offset set from 0 to 0
2

This looks like the root cause of the problem…

@remus.bunduc thoughts?

3

did you change the chunk_size? if so, you need to purge your cache DB afterwards

4

i did, thanks, will see if that helps.

5

Perfect. works well now thanks.

6

Nice one! It should probably say this in the docs - fancy sending a pull request (on docs/content/cache.md)?

7

In theory, I added my first pull request ever.

1 Like