Guide to replaceing plexdrive/unionfs with rclone cache

On my testing, having a bigger chunk size made everything way worse. Anything bigger than 20M kills playback for me:

EOF) response
Mar 30 19:29:46 gemini rclone[5040]: Movies/Chasing.Coral.(2017)/Chasing.Coral.(2017).WEBDL-2160p.mkv: ReadFileHandle.Read error: low level retry 10/10: EOF
Mar 30 19:29:47 gemini rclone[5040]: tnvepu36qiohcun8v84ddhsam0/ocfjsdro2hpv2va8orcnt636akmdmij4ap2cpk0ta68qb6it8lq0/uiu48qtqignho6r7u0d3poqhubdsciftmv0dpjfpu50u7jf3nnv2537mbo98ngai6810crnq0kge8: unexpected conditions during reading. cur
rent position: 10553904, current chunk position: 0, current chunk size: 10485760, offset: 10553904, chunk size: 26214400, file size: 30240846944
Mar 30 19:29:47 gemini rclone[5040]: tnvepu36qiohcun8v84ddhsam0/ocfjsdro2hpv2va8orcnt636akmdmij4ap2cpk0ta68qb6it8lq0/uiu48qtqignho6r7u0d3poqhubdsciftmv0dpjfpu50u7jf3nnv2537mbo98ngai6810crnq0kge8: (10553904/30240846944) error (unexpected
EOF) response
Mar 30 19:29:48 gemini rclone[5040]: Movies/Chasing.Coral.(2017)/Chasing.Coral.(2017).WEBDL-2160p.mkv: ReadFileHandle.Read error: EOF

If I run the same movie with just the default 5M chunk size, it plays back fine. That’s a huge bitrate 4K movie too:

[felix@gemini Chasing.Coral.(2017)]$ mediainfo Chasing.Coral.\(2017\).WEBDL-2160p.mkv
General
Unique ID                                : 231123133806480839100760379104910904449 (0xADE0B248D5643308B56427AFFC480C81)
Complete name                            : Chasing.Coral.(2017).WEBDL-2160p.mkv
Format                                   : Matroska
Format version                           : Version 4 / Version 2
File size                                : 28.2 GiB
Duration                                 : 1 h 29 min
Overall bit rate                         : 45.1 Mb/s
Encoded date                             : UTC 2017-08-27 05:04:49
Writing application                      : mkvmerge v12.0.0 ('Trust / Lust') 64bit
Writing library                          : libebml v1.3.4 + libmatroska v1.4.5

Video
ID                                       : 27
Format                                   : AVC
Format/Info                              : Advanced Video Codec
Format profile                           : High@L5.1
Format settings                          : CABAC / 5 Ref Frames
Format settings, CABAC                   : Yes
Format settings, ReFrames                : 5 frames
Codec ID                                 : V_MPEG4/ISO/AVC
Duration                                 : 1 h 28 min
Bit rate                                 : 45.1 Mb/s

I also tried a copy of Blade Runner I have that’s a 45GB file with a 55Mb/s bit rate and that works fine with the default chunk size as well.

So I’ve been testing the last 24 hours with:

felix 31418 1 4 Mar30 ? 00:29:31 /usr/bin/rclone mount gmedia: /gmedia --allow-other --dir-cache-time=160h --cache-chunk-size=5M --cache-info-age=168h --cache-workers=8 --buffer-size 0M --attr-timeout=1s --syslog --umask 002 --rc --cache-tmp-upload-path /data/rclone_upload --cache-tmp-wait-time 60m --log-level INFO

and haven’t hit any issues and memory use is much better (as expected).

1 Like