Unexpected conditions during reading

dannymichel · August 15, 2019, 1:32pm

What is the problem you are having with rclone?

unexpected conditions during reading

drive.service

[Unit]
Description=gdrive
Wants=plexmediaserver.service
After=plexmediaserver.service

[Service]
User=user
Group=user
Type=notify
Environment=RCLONE_CONFIG=/opt/rclone/rclone.conf

ExecStart=/usr/bin/rclone mount cache: /mnt/gdrive --allow-other --log-level INFO --log-file /opt/rclone/logs/rclone.log --timeout 1h --umask 002 --user-agent rclone --rc
ExecStop=/bin/fusermount -uz /mnt/gdrive
Restart=on-failure

[Install]
WantedBy=multi-user.target

unionfs.service

[Unit]
Description=unionfs
AssertPathIsDirectory=/mnt/gdrive
Wants=drive.service
After=drive.service

[Service]
Type=simple
User=user
Group=user
ExecStart=/usr/bin/unionfs-fuse -o cow,allow_other,nonempty /home/user=RW:/mnt/gdrive=RO /mnt/drive
ExecStop=/bin/umount /mnt/drive
TimeoutStopSec=20
KillMode=process
RemainAfterExit=yes

[Install]
WantedBy=multi-user.target

rclone.conf

[drive]
type = drive
client_id = xxx
client_secret = xxx
scope = drive
token = xxx

[cache]
type = cache
remote = drive:
plex_url = http://127.0.0.1:32400
plex_username = xxx
plex_password = xxx
plex_token = xxx
chunk_size = 16M
info_age = 8760h
chunk_total_size = 50G
db_path = /opt/rclone/rclone-cache
chunk_path = /opt/rclone/rclone-cache
chunk_clean_interval = 5m
workers = 4

am i getting unexpected conditions during reading because my chunk size is 16M?

2019/08/15 07:25:35 ERROR : media/movies/Aquaman (2018)/Aquaman.mp4: (16777216/2475328876) error (chunk not found 16777216) response
2019/08/15 07:31:19 ERROR : media/tv/3%/Season 1/3% - S01E04 - Chapter 04- Gateway.mkv: unexpected conditions during reading. current position: 2797600768, current chunk position: 2785017856, current chunk size: 2703360, offset: 12582912, chunk size: 16M, file size: 2797604612
2019/08/15 07:31:19 ERROR : media/tv/3%/Season 1/3% - S01E04 - Chapter 04- Gateway.mkv: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 07:33:10 ERROR : media/movies/Boi (2019)/Boi (2019).mp4: (18870272/1951180515) error (chunk not found 16777216) response
2019/08/15 07:34:02 ERROR : media/movies/A Brighter Summer Day (1991)/A Brighter Summer Day.mkv: unexpected conditions during reading. current position: 16438382592, current chunk position: 16424894464, current chunk size: 114688, offset: 13488128, chunk size: 16M, file size: 16438387606
2019/08/15 07:34:02 ERROR : media/movies/A Brighter Summer Day (1991)/A Brighter Summer Day.mkv: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 07:34:22 INFO  : media/tv/The Gifted (2017)/Season 1/S01E12-E13.eXtraction.&.X-roads.mkv: confirmed reading by external reader
2019/08/15 07:34:25 INFO  : media/tv/The Gifted (2017)/Season 1/S01E12-E13.eXtraction.&.X-roads.mkv: confirmed reading by external reader
2019/08/15 07:34:25 INFO  : media/tv/The Gifted (2017)/Season 1/S01E12-E13.eXtraction.&.X-roads.mkv: confirmed reading by external reader
2019/08/15 07:34:27 INFO  : media/tv/The Gifted (2017)/Season 1/S01E12-E13.eXtraction.&.X-roads.mkv: confirmed reading by external reader
2019/08/15 07:34:27 INFO  : media/tv/The Gifted (2017)/Season 1/S01E12-E13.eXtraction.&.X-roads.mkv: confirmed reading by external reader
2019/08/15 07:34:46 INFO  : media/tv/The Gifted (2017)/Season 1/S01E12-E13.eXtraction.&.X-roads.mkv: confirmed reading by external reader
2019/08/15 07:34:48 INFO  : media/tv/The Gifted (2017)/Season 1/S01E12-E13.eXtraction.&.X-roads.mkv: confirmed reading by external reader
2019/08/15 07:35:18 INFO  : media/tv/Younger/Season 6/Younger - S06E09 - Millennial's Next Top Model.mkv: received cache expiry notification
2019/08/15 07:35:46 INFO  : media/tv/The Gifted (2017)/Season 1/S01E12-E13.eXtraction.&.X-roads.mkv: confirmed reading by external reader
2019/08/15 07:35:48 INFO  : media/tv/The Gifted (2017)/Season 1/S01E12-E13.eXtraction.&.X-roads.mkv: confirmed reading by external reader
2019/08/15 07:44:36 ERROR : media/movies/Dogtooth (2009)/Dogtooth (2009).avi: unexpected conditions during reading. current position: 2478043136, current chunk position: 2466250752, current chunk size: 9920512, offset: 11792384, chunk size: 16M, file size: 2480281600
2019/08/15 07:44:36 ERROR : media/movies/Dogtooth (2009)/Dogtooth (2009).avi: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 07:51:35 ERROR : media/movies/Framing John DeLorean (2019)/Framing John DeLorean (2019).mkv: unexpected conditions during reading. current position: 6078197760, current chunk position: 6073352192, current chunk size: 3665920, offset: 4845568, chunk size: 16M, file size: 6078199323
2019/08/15 07:51:35 ERROR : media/movies/Framing John DeLorean (2019)/Framing John DeLorean (2019).mkv: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 07:52:52 ERROR : media/movies/Gervaise (1956)/Gervaise (1956).mkv: unexpected conditions during reading. current position: 5799124992, current chunk position: 5788139520, current chunk size: 10715136, offset: 10985472, chunk size: 16M, file size: 5799130755
2019/08/15 07:52:52 ERROR : media/movies/Gervaise (1956)/Gervaise (1956).mkv: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 07:53:12 ERROR : media/movies/The Gift (2015)/The Gift (2015).mp4: unexpected conditions during reading. current position: 1781878784, current chunk position: 1778384896, current chunk size: 3018752, offset: 3493888, chunk size: 16M, file size: 1781879537
2019/08/15 07:53:12 ERROR : media/movies/The Gift (2015)/The Gift (2015).mp4: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 07:53:48 ERROR : media/tv/Adventure Time (2010)/Season 9/9x04 - Elements, Part 3 Winter Light.mkv: unexpected conditions during reading. current position: 515928064, current chunk position: 503316480, current chunk size: 8605696, offset: 12611584, chunk size: 16M, file size: 515930747
2019/08/15 07:53:48 ERROR : media/tv/Adventure Time (2010)/Season 9/9x04 - Elements, Part 3 Winter Light.mkv: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 07:55:22 ERROR : media/tv/Adventure Time (2010)/Season 10/10x09 - Blenanas.mkv: unexpected conditions during reading. current position: 173850624, current chunk position: 167772160, current chunk size: 5029888, offset: 6078464, chunk size: 16M, file size: 173854479
2019/08/15 07:55:22 ERROR : media/tv/Adventure Time (2010)/Season 10/10x09 - Blenanas.mkv: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 07:55:36 ERROR : media/movies/Gravity (2013)/Gravity.mp4: unexpected conditions during reading. current position: 1337827328, current chunk position: 1325400064, current chunk size: 2330624, offset: 12427264, chunk size: 16M, file size: 1337830745
2019/08/15 07:55:36 ERROR : media/movies/Gravity (2013)/Gravity.mp4: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 07:57:46 ERROR : media/movies/Harry Potter and the Philosopher's Stone (2001)/Harry Potter and the Philosopher's Stone.mp4: unexpected conditions during reading. current position: 1251008512, current chunk position: 1241513984, current chunk size: 4542464, offset: 9494528, chunk size: 16M, file size: 1251012044
2019/08/15 07:57:46 ERROR : media/movies/Harry Potter and the Philosopher's Stone (2001)/Harry Potter and the Philosopher's Stone.mp4: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 08:03:03 ERROR : media/tv/American Horror Story (2011)/Season 6/6x10 - Chapter 10.mkv: unexpected conditions during reading. current position: 1726439424, current chunk position: 1711276032, current chunk size: 10387456, offset: 15163392, chunk size: 16M, file size: 1726440104
2019/08/15 08:03:03 ERROR : media/tv/American Horror Story (2011)/Season 6/6x10 - Chapter 10.mkv: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 08:10:09 ERROR : media/tv/Angel (1999)/Season 1/1x04 - I Fall to Pieces.mkv: unexpected conditions during reading. current position: 250650624, current chunk position: 234881024, current chunk size: 815104, offset: 15769600, chunk size: 16M, file size: 250653713
2019/08/15 08:10:09 ERROR : media/tv/Angel (1999)/Season 1/1x04 - I Fall to Pieces.mkv: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 08:10:18 INFO  : media/tv/Tokyo Ghoul (2015)/Season 04/EXTRA/[Moozzi2] Tokyo Ghoul Re S2 [SP09] Event Digest (BD 1920x1080 x.264 Flac).mkv: received cache expiry notification
2019/08/15 08:13:12 ERROR : media/tv/Angel (1999)/Season 2/2x12 - Blood Money.mkv: unexpected conditions during reading. current position: 233820160, current chunk position: 218103808, current chunk size: 4751360, offset: 15716352, chunk size: 16M, file size: 233821566
2019/08/15 08:13:12 ERROR : media/tv/Angel (1999)/Season 2/2x12 - Blood Money.mkv: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 08:15:18 INFO  : media/tv/Younger/Season 6/Younger - S06E09 - Millennial's Next Top Model.mkv: received cache expiry notification
2019/08/15 08:16:26 ERROR : media/movies/Midnight Cowboy (1969)/Midnight Cowboy (1969).mkv: unexpected conditions during reading. current position: 12908187648, current chunk position: 12901679104, current chunk size: 4255744, offset: 6508544, chunk size: 16M, file size: 12908190295
2019/08/15 08:16:26 ERROR : media/movies/Midnight Cowboy (1969)/Midnight Cowboy (1969).mkv: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 08:20:36 INFO  : cache-cleanup: chunks 236, est. size: 3.390G
2019/08/15 08:25:39 INFO  : cache-cleanup: chunks 276, est. size: 3.797G
2019/08/15 08:30:46 INFO  : cache-cleanup: chunks 358, est. size: 4.798G
2019/08/15 08:35:48 INFO  : cache-cleanup: chunks 289, est. size: 4.312G
2019/08/15 08:40:18 INFO  : apps/discord/backups/bots.tar.bz2: received cache expiry notification
2019/08/15 08:40:21 ERROR : media/tv/Arrow (2012)/Season 7/7x19 - Spartan.mkv: unexpected conditions during reading. current position: 4191432704, current chunk position: 4177526784, current chunk size: 4321280, offset: 13905920, chunk size: 16M, file size: 4191434413
2019/08/15 08:40:21 ERROR : media/tv/Arrow (2012)/Season 7/7x19 - Spartan.mkv: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 08:40:52 INFO  : cache-cleanup: chunks 360, est. size: 5.035G
2019/08/15 08:45:55 INFO  : cache-cleanup: chunks 385, est. size: 5.417G
2019/08/15 08:50:56 INFO  : cache-cleanup: chunks 344, est. size: 4.630G
2019/08/15 08:51:51 ERROR : media/movies/X2 (2003)/X2.mp4: unexpected conditions during reading. current position: 1606586368, current chunk position: 1593835520, current chunk size: 258048, offset: 12750848, chunk size: 16M, file size: 1606589060
2019/08/15 08:51:51 ERROR : media/movies/X2 (2003)/X2.mp4: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 08:55:58 INFO  : cache-cleanup: chunks 271, est. size: 3.669G
2019/08/15 09:00:59 INFO  : cache-cleanup: chunks 230, est. size: 3.193G
2019/08/15 09:06:04 INFO  : cache-cleanup: chunks 177, est. size: 2.417G
2019/08/15 09:08:07 ERROR : media/tv/The Big Bang Theory (2007)/Season 2/2x21 - The Vegas Renormalization.mkv: unexpected conditions during reading. current position: 1257725952, current chunk position: 1241513984, current chunk size: 4780032, offset: 16211968, chunk size: 16M, file size: 1257728965
2019/08/15 09:08:07 ERROR : media/tv/The Big Bang Theory (2007)/Season 2/2x21 - The Vegas Renormalization.mkv: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 09:11:07 INFO  : cache-cleanup: chunks 145, est. size: 1.984G
2019/08/15 09:16:10 INFO  : cache-cleanup: chunks 152, est. size: 2.075G
2019/08/15 09:19:53 ERROR : media/tv/The Big Bang Theory (2007)/Season 8/8x24 - The Commitment Determination.mkv: unexpected conditions during reading. current position: 815472640, current chunk position: 805306368, current chunk size: 3735552, offset: 10166272, chunk size: 16M, file size: 815474083
2019/08/15 09:19:53 ERROR : media/tv/The Big Bang Theory (2007)/Season 8/8x24 - The Commitment Determination.mkv: ReadFileHandle.Read error: low level retry 1/10: EOF
2019/08/15 09:21:13 INFO  : cache-cleanup: chunks 150, est. size: 2.126G
2019/08/15 09:23:28 INFO  : media/tv/The Big Bang Theory (2007)/Season 10/10x24 - The Long Distance Dissonance.mkv: confirmed reading by external reader

What is your rclone version (output from `rclone version`)

rclone v1.48.0-160-gcd7ca2a3-beta

Which OS you are using and how many bits (eg Windows 7, 64 bit)

ubuntu 18

Which cloud storage system are you using? (eg Google Drive)

google drive

The command you were trying to run (eg `rclone copy /tmp remote:tmp`)

rclone mount

A log from the command with the `-vv` flag (eg output from `rclone -vv copy /tmp remote:tmp`)

Animosity022 · August 15, 2019, 2:53pm

Is a tough one to use as that allows to over mount and mask things. I would not recommend using that.

If you can change the log level from INFO to DEBUG, that would help as without it, it's not possible to tell what caused those errors of if they are just transient.

dannymichel · August 15, 2019, 3:19pm

after this plex scan i'll remove nonempty and remount using DEBUG

ncw · August 16, 2019, 7:35am

Those errors are from the cache backend and they are to do with reads being bigger than a chunk.

I'm not sure exactly what is causing them, but chunk_size is probably something to do with it.

current position: 2478043136, current chunk position: 2466250752, current chunk size: 9920512, offset: 11792384, chunk size: 16M, file size: 2480281600

That looks like it is trying to read beyond the end of the chunk

dannymichel · August 19, 2019, 11:03pm

is this because i dont specify a chunk size in my mount command but do in my rclone.conf?

ncw · August 20, 2019, 3:10pm

Specify all the parameters in the config file is the best place then you will always be consistent.

If you've used a different chunk size elsewhere then that could explain the problems you are seeing.

system · November 18, 2019, 3:21pm

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.