Plex buffers when uploading

dantheman61 · April 1, 2019, 2:25pm

When there is an upload to google drive with rclone mount plex buffers. Plex is also mounted to google drive. The upload is from finished download with Sonarr or Radarr that gets uploaded to google drive. What can I do to fix plex buffering? I am using DirectPlay with plex. If nothing is uploading plex does not buffer. The VPS is with contabo.com ( VPS L SSD )and has a 600mb/s upload. Rclone mount commanded rclone mount -vvv --allow-other --allow-non-empty gdrive: /mnt/shared/gdrive

thanks

Animosity022 · April 1, 2019, 2:32pm

rclone version shows what?
Did you make your own API/Client ID?

Can you share your rclone.conf without passwords as well.
Can you share a debug log when the issue happens?

dantheman61 · April 1, 2019, 2:58pm

rclone v1.46 on Ubuntu 18.10
yes i made API/Client ID

[gdrive]
type = drive
client_id = XXXXXXXXXXXXXXXXXXXXXXXXXXX
client_secret = XXXXXXXXXXXXXXXXX
scope = drive
token = {“access_token”:“XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX-Q”,“token_type”:“Bearer”,“refresh_token”:“1/XXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXXX”,“expiry”:“2019-04-01T17:23:15.212406376+02:00”}

How do i do a log?

Animosity022 · April 1, 2019, 3:08pm

Run with -vv and you can use --log-file /some/location/file.log

How are you uploading ?

dantheman61 · April 1, 2019, 3:47pm

uploading is when Sonarr or Radarr moves file to google drive.

here is log when uploading and plex buffers. https://drive.google.com/file/d/1sw3DYuRIAlGmZQhjFfX16cvJyiJZCjCc/view?usp=sharing

dantheman61 · April 1, 2019, 3:49pm

also Skyscraper is what was plying with plex and Modern Family is what was being uploaded.

Animosity022 · April 1, 2019, 3:54pm

That log is a bit confusing.

It was playing, than the file closed out and the process stopped.

2019/04/01 17:27:34 DEBUG : My Drive/Downloads/Movies/Skyscraper (2018)/: >Lookup: node=My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv, err=<nil>
2019/04/01 17:27:34 DEBUG : My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv: Attr:
2019/04/01 17:27:34 DEBUG : My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv: >Attr: a=valid=1s ino=0 size=28640028593 mode=-rw-r--r--, err=<nil>
2019/04/01 17:27:34 DEBUG : My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv: Open: flags=OpenReadOnly
2019/04/01 17:27:34 DEBUG : My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv: Open: flags=O_RDONLY
2019/04/01 17:27:34 DEBUG : My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv: >Open: fd=My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r), err=<nil>
2019/04/01 17:27:34 DEBUG : My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv: >Open: fh=&{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}, err=<nil>
2019/04/01 17:27:34 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: Flush:
2019/04/01 17:27:34 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: >Flush: err=<nil>
2019/04/01 17:27:34 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: Release:
2019/04/01 17:27:34 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: >Release: err=<nil>
2019/04/01 17:27:35 DEBUG : rclone: Version "v1.46" finishing with parameters ["rclone" "mount" "-vvv" "--log-file" "/home/log.log" "--allow-other" "--allow-non-empty" "gdrive:" "/mnt/shared/gdrive"]
2019/04/01 17:27:43 DEBUG : /: Lookup: name="My Drive"

The process restarted 4 times in that log:

2019/04/01 17:13:31 DEBUG : rclone: Version "v1.46" finishing with parameters ["rclone" "mount" "-vv" "--log-file" "/home/log.log" "--allow-other" "--allow-non-empty" "gdrive:" "/mnt/shared/gdrive"]
2019/04/01 17:14:19 DEBUG : rclone: Version "v1.46" finishing with parameters ["rclone" "mount" "-vvv" "--log-file" "/home/log.log" "--allow-other" "--allow-non-empty" "gdrive:" "/mnt/shared/gdrive"]
2019/04/01 17:17:11 DEBUG : rclone: Version "v1.46" finishing with parameters ["rclone" "mount" "-vvv" "--log-file" "/home/log.log" "--allow-other" "--allow-non-empty" "gdrive:" "/mnt/shared/gdrive"]
2019/04/01 17:27:35 DEBUG : rclone: Version "v1.46" finishing with parameters ["rclone" "mount" "-vvv" "--log-file" "/home/log.log" "--allow-other" "--allow-non-empty" "gdrive:" "/mnt/shared/gdrive"]

Any idea what’s causing it to restart? That seems to kill your playback and not the upload.

dantheman61 · April 1, 2019, 4:30pm

it may have been me i was a bit confused when i ran “screen rclone mount -vvv --log-file /home/log.log --allow-other --allow-non-empty gdrive: /mnt/shared/gdrive” i did not see anything. so i stopped it a few times then i realized it was working here is a new log without me stopping it. https://drive.google.com/file/d/1b6jM2YtdO66wr067xtPdrdoFWNJtQ5Qv/view?usp=sharing

Animosity022 · April 1, 2019, 4:40pm

allow-non-empty is just an awful parameter and not sure why fuse includes it at all as it allows over mounting on items that are already there.

What’s the client? It seems to be open/closing the file quite a bit.

egrep  'ONLY|Flush' log.log
2019/04/01 18:16:32 DEBUG : My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv: Open: flags=O_RDONLY
2019/04/01 18:16:33 DEBUG : My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv: Open: flags=O_RDONLY
2019/04/01 18:16:37 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: Flush:
2019/04/01 18:16:37 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: >Flush: err=<nil>
2019/04/01 18:16:37 DEBUG : My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv: Open: flags=O_RDONLY
2019/04/01 18:16:37 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: Flush:
2019/04/01 18:16:37 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: >Flush: err=<nil>
2019/04/01 18:23:26 DEBUG : My Drive/Downloads/TV/Modern Family/Season 1/Modern Family - S01E15 - My Funky Valentine Bluray-1080p.mkv.partial~: Open: flags=O_WRONLY|O_CREATE|O_EXCL
2019/04/01 18:24:54 DEBUG : &{My Drive/Downloads/TV/Modern Family/Season 1/Modern Family - S01E15 - My Funky Valentine Bluray-1080p.mkv.partial~ (w)}: Flush:
2019/04/01 18:24:57 DEBUG : &{My Drive/Downloads/TV/Modern Family/Season 1/Modern Family - S01E15 - My Funky Valentine Bluray-1080p.mkv.partial~ (w)}: >Flush: err=<nil>
2019/04/01 18:25:00 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: Flush:
2019/04/01 18:25:00 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: >Flush: err=<nil>
2019/04/01 18:25:00 DEBUG : My Drive/Downloads/TV/Modern Family/Season 1/Modern Family - S01E15 - My Funky Valentine Bluray-1080p.mkv: Open: flags=O_RDONLY
2019/04/01 18:25:02 DEBUG : &{My Drive/Downloads/TV/Modern Family/Season 1/Modern Family - S01E15 - My Funky Valentine Bluray-1080p.mkv (r)}: Flush:
2019/04/01 18:25:02 DEBUG : &{My Drive/Downloads/TV/Modern Family/Season 1/Modern Family - S01E15 - My Funky Valentine Bluray-1080p.mkv (r)}: >Flush: err=<nil>
2019/04/01 18:25:03 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: Flush:
2019/04/01 18:25:03 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: >Flush: err=<nil>
2019/04/01 18:25:03 DEBUG : My Drive/Downloads/TV/Modern Family/Season 1/Modern Family - S01E15 - My Funky Valentine Bluray-1080p.mkv: Open: flags=O_RDONLY
2019/04/01 18:25:04 DEBUG : &{My Drive/Downloads/TV/Modern Family/Season 1/Modern Family - S01E15 - My Funky Valentine Bluray-1080p.mkv (r)}: Flush:
2019/04/01 18:25:04 DEBUG : &{My Drive/Downloads/TV/Modern Family/Season 1/Modern Family - S01E15 - My Funky Valentine Bluray-1080p.mkv (r)}: >Flush: err=<nil>
2019/04/01 18:25:04 DEBUG : My Drive/Downloads/TV/Modern Family/Season 1/Modern Family - S01E15 - My Funky Valentine Bluray-1080p.mkv: Open: flags=O_RDONLY
2019/04/01 18:25:07 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: Flush:
2019/04/01 18:25:07 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: >Flush: err=<nil>
2019/04/01 18:25:08 DEBUG : &{My Drive/Downloads/TV/Modern Family/Season 1/Modern Family - S01E15 - My Funky Valentine Bluray-1080p.mkv (r)}: Flush:
2019/04/01 18:25:08 DEBUG : &{My Drive/Downloads/TV/Modern Family/Season 1/Modern Family - S01E15 - My Funky Valentine Bluray-1080p.mkv (r)}: >Flush: err=<nil>
2019/04/01 18:25:10 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: Flush:
2019/04/01 18:25:10 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: >Flush: err=<nil>
2019/04/01 18:25:23 DEBUG : My Drive/Downloads/TV/Modern Family/Season 1/Modern Family - S01E14 - Moon Landing Bluray-1080p.mkv.partial~: Open: flags=O_WRONLY|O_CREATE|O_EXCL
2019/04/01 18:26:21 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: Flush:
2019/04/01 18:26:21 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: >Flush: err=<nil>

dantheman61 · April 1, 2019, 4:47pm

so should i remove allow-non-empty?

i am streaming with plex on windows with windows desktop plex app.

Animosity022 · April 1, 2019, 4:50pm

I personally would never ever use non empty as I rather it error out if a file got there than mount on top of it.

You could try turning off Direct Play and just allow it to Direct Stream, which has almost no CPU hit anyway.

I don’t have any Windows machines so not sure how Plex works on them.

dantheman61 · April 1, 2019, 5:39pm

still get buffering with direct play off

Animosity022 · April 1, 2019, 5:45pm

Can you share the log when you did that?

dantheman61 · April 1, 2019, 7:04pm

Animosity022 · April 1, 2019, 7:57pm

Seems like it still closes the file out after 9 seconds, which is strange.

 egrep  'ONLY|Flush' log.log  | grep Sky
2019/04/01 20:44:28 DEBUG : My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv: Open: flags=O_RDONLY
2019/04/01 20:44:28 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: Flush:
2019/04/01 20:44:28 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: >Flush: err=<nil>
2019/04/01 20:44:29 DEBUG : My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv: Open: flags=O_RDONLY
2019/04/01 20:44:29 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: Flush:
2019/04/01 20:44:29 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: >Flush: err=<nil>
2019/04/01 20:44:29 DEBUG : My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv: Open: flags=O_RDONLY
2019/04/01 20:53:06 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: Flush:
2019/04/01 20:53:06 DEBUG : &{My Drive/Downloads/Movies/Skyscraper (2018)/Skyscraper.2018.1080p.BluRay.REMUX.AVC.Atmos-EPSiLON-Obfuscated.mkv (r)}: >Flush: err=<nil>

I think your issue relates back to another post with a deadlocking item and something expiring from your directory cache.

Can you try to update your --dir-cache-time to something higher?

VFS Mount Freezes was the item I was thinking of when I read this as it’s only when you are writing the file and probably when it expires the cache perhaps.

dantheman61 · April 1, 2019, 11:00pm

so what should i do? do i add --dir-cache-time=24h to mount command? i did that with no deference.

Animosity022 · April 2, 2019, 11:31am

@ncw - think it might be something related back to this? https://github.com/ncw/rclone/issues/2811

ncw · April 2, 2019, 4:24pm

I wonder if the upload is using all the upload bandwidth? You could try with --bwlimit to see if that helps.

600 Mbit/s is 75 MByte/s so you could try --bwlimit 25 to stay well below that and see if it helps.

If it is deadlocking everything will come to a complete halt and never recover. It sound like it does recover though from reading the above, so it probably isn’t a deadlock.

dantheman61 · April 2, 2019, 6:17pm

so plex has not buffered in 2hr test now that i have added --buffer-size 0. don’t know if this is a coincidence or if that fixed it.

system · July 1, 2019, 6:26pm

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.