Rclone with GDrive / Plex issues


#1

rclone v1.43-027-gdeda0936-beta

  • os/arch: windows/amd64
  • go version: go1.11

Hey there,

i really hope that someone out there could help me fixing the recent issues we are having with our streaming experience and - most important - bring back WAF back to an acceptable level.

I am using rclone in combination with GDrive (cache -> crypt) for a couple of months now with more or less good results. However, during the last weeks some issues came up and i tried to investigate and fix them for about two weeks now but without success.

So, here are some details:

[rclone.conf]
[gdrive]
type = drive
client_id =
client_secret =
token = XXX
team_drive =

[gdrive_crypt]
type = crypt
remote = gdrive_cache:Video/
filename_encryption = standard
password = xxx
password2 = xxx

[gdrive_cache]
type = cache
remote = gdrive:/
plex_url = http://127.0.0.1:32400
plex_username = xxx
plex_password = xxx
chunk_size = 10M
info_age = 30m
chunk_total_size = 20G
plex_token = xxx

[mount command]
rclone mount gdrive_crypt: q:
–log-level INFO
–allow-non-empty
–allow-other
–checksum
–tpslimit 10
–tpslimit-burst 10
–attr-timeout=1s
–dir-cache-time 72h
–drive-chunk-size=32768
–cache-chunk-total-size 2G
–buffer-size=128M
–cache-db-purge
–vfs-read-chunk-size 32M
–vfs-cache-mode minimal
–vfs-cache-max-age 48h
–config “c:\tools\rclone\rclone.conf”

To be honest, the command line is the result of what i gathered from various topics discussing best results and i don’t really know what each of the flags actually does.

Plex Media Server is running on a Win10 box where the remote is mounted as a network drive. The mount runs as a service.

The error log is full with stuff i don’t really understand:

2018-09-27 19:52:39.701: 2018/09/27 21:52:39 ERROR : Video/7gi0jm5f7ul6akfhih8esadn2k/sgokk696qraffd1ug11j4ko618/dp4p4dokc4dv4jvf2f4bo7ni1o/775otcb53pjlje3tl7hsvgidkdafva0ce7c6p36ghb21namlci50: (4138691104/4138719724) error (chunk not found 4131389440) response

And also:

2018-09-27 19:49:29.876: 2018/09/27 21:49:29 ERROR : Movies/Movie (2018)/Movie (2018).mkv: ReadFileHandle.Read error: low level retry 1/10: unexpected EOF

I have no idea why items are referenced in both ways, with and without encryption.

Also, the read performance from GDrive seems to be very low:

2018/09/27 23:00:08 INFO :
Transferred: 308.996M / 3.141 GBytes, 10%, 2.519 MBytes/s, ETA 19m14s
Errors: 0
Checks: 0 / 0, -
Transferred: 0 / 1, 0%
Elapsed time: 2m2.6s
Transferring:

  •                      TVSHOW - S01E01.mkv:  9% /3.141G, 1.340M/s, 36m9s
    

Any help would be highly appreciated.


403 error messages with cached remote
#2

I am interested in this also, I’m getting the same errors, chunk not found and the unexpected EOF. My read performance to Gdrive seems to be okay, I can max out my 100/10 connection.


#3

It might be worth trying this flag

  --drive-v2-download-min-size SizeSuffix    If Object's are greater, use drive v2 API to download. (default off)

Eg --drive-v2-download-min-size 0 and see if that helps. There seems to be weird stuff going on with the v3 API right now:


#4

I’ve added the flag to my mount command and it seems to boost the read performance instantaneously…Let’s see if it is a successor in the long run.


#5

Thanks for testing. Another data point for you @B4dM4n …


#6

Thanks for taking care of each and everyone here! Since i’ve added the flag to the mount, it runs like a charm without fuss.


#7

Same here. Thanks for the help!


#8

I’m on the current release version and when I attempted to add --drive-v2-download-min-size 0 to my mount command it tells me that the command is not an option. Is this only for the cache mount?

Edit: NVM I see its in the beta so I need to load that one :slight_smile: