And now suddenly, I CAN download it. Obviously midnight PT hasn’t passed. Nothing has changed. Just retried it and now it works.
That’s after the error has happened as well. Do you have any logs of before the error happened with that file?
I’m still waiting for my ban to be lifted. Seems to lift for me around 4pm MT
My ban is lifted but I don’t want to trip it again right now. Once I add that flag back to my mount command I can trip that thing within a matter of an hour, thus rendering my plex useless 
Since I haven’t been able to watch anything on the server in a few days we’ve got some catching up to do, before I ban it.
Oh I’ve got a better idea, I’ll setup a mount with my gmail account with that v2 on it and see what I can do to trip it.
Be happy to log my transfers but what command could I use to copy the whole log into a txt file?
I’m not sure how much you can get in pastebin or something like that but you could also zip them up and attach them as well I believe.
--log-level="DEBUG" --log-file=/PATH/TO/LOG/FILE.txt
Add those two options.
log-level can be lower but i’d use DEBUG in this case.
Going to add my experience here as well (sorry for making a new post)
I’ve experienced several days of “Download Quote Exceeded” from Gdrive and unfortunately I am unsure why it a.) hasn’t reset post 24hrs and b.) what to do to fix it.
I went ahead and added my own client id to the remote but am still getting issues. Any ideas?
Can you please include logs/mount command ?
MOUNT
#!/bin/bash
RCLONECACHE=$HOME/.cache/rclone
RCLONEHOME=$HOME/.config/rclone
MOUNTTO=$HOME/media/Plex
LOGS=$HOME/tmp/logs
UPLOADS=$HOME/torrents/uploads
if mount|grep ${MOUNTTO}; then
echo “Gdrive mounted”
else
echo “Mounting Gdrive…”
mkdir -p ${MOUNTTO}
/bin/fusermount -uz ${MOUNTTO} > /dev/null 2>&1
$HOME/bin/rclone mount
–rc
–log-file ${LOGS}/rclone.log
–umask 022
–allow-other
–allow-non-empty
–fuse-flag sync_read
–tpslimit 10
–tpslimit-burst 10
–dir-cache-time=48h
–buffer-size=64M
–vfs-read-chunk-size=32M
–vfs-read-chunk-size-limit=2G
–vfs-cache-max-age=5m
–vfs-cache-mode=writes
–attr-timeout=1s
–cache-dir ${UPLOADS}
–config ${RCLONEHOME}/rclone.conf \
CONFIG
[gcache]
type = cache
remote = gdrive:
plex_url = http://127.0.0.1:16625
plex_username = matt@
plex_password = a
chunk_size = 32M
info_age = 24h
chunk_total_size = 10G
plex_token = removetoken
[gdrive]
type = drive
client_id = ######929-vqfvrm0bkaplo5b9s026fhmnqhqukfd4.apps.googleusercontent.com
client_secret = #####gvNfeK9RKCejzZYb2
scope = drive
token = {“access_token”:"###remove-removeAP4BBN9G7mkCTcTnj50RFy_df",“token_type”:“Bearer”,“refresh_token”:“1/I-BFXUEyUbrnVlNrkNRSIDrd3eirK7HPOH9ci2BBRgM”,“expiry”:“2018-10-20T19:40:41.737701376+02:00”}
RCLONE LOGS
2018/10/20 04:35:49 ERROR : Movies_Y/Trouble with the Curve.(2012).mkv: ReadFileHandle.Read error: low level retry 6/10: open file failed: googleapi: Error 403: The d$
2018/10/20 04:35:58 ERROR : Movies_Y/Trouble with the Curve.(2012).mkv: ReadFileHandle.Read error: low level retry 7/10: open file failed: googleapi: Error 403: The d$
2018/10/20 04:36:07 ERROR : Movies_Y/Trouble with the Curve.(2012).mkv: ReadFileHandle.Read error: low level retry 8/10: open file failed: googleapi: Error 403: The d$
2018/10/20 04:36:07 ERROR : Movies_Y/Trouble with the Curve.(2012).mkv: ReadFileHandle.Read error: low level retry 9/10: open file failed: googleapi: Error 403: The d$
2018/10/20 04:36:09 ERROR : Movies_Y/Trouble with the Curve.(2012).mkv: ReadFileHandle.Read error: low level retry 10/10: open file failed: googleapi: Error 403: The $
2018/10/20 04:36:09 ERROR : Movies_Y/Trouble with the Curve.(2012).mkv: ReadFileHandle.Read error: open file failed: googleapi: Error 403: The download quota for this$
2018/10/20 04:36:10 ERROR : Movies_Y/Trouble with the Curve.(2012).mkv: ReadFileHandle.Release error: file already closed
2018/10/20 05:00:05 NOTICE: Serving remote control on http://127.0.0.1:5572/
2018/10/20 17:11:08 ERROR : /: Dir.Stat error: couldn’t list directory: googleapi: Error 404: Team Drive not found: n, notFound
2018/10/20 17:11:09 ERROR : /: Dir.Stat error: couldn’t list directory: googleapi: Error 404: Team Drive not found: n, notFound
That’s after the error happened so not helpful in figuring out the cause. Do you have any logs prior ?
This is the earliest log I have
2018/09/28 03:29:05 NOTICE: Serving remote control on http://127.0.0.1:5572/
2018/09/28 05:08:22 NOTICE: Serving remote control on http://127.0.0.1:5572/
2018/10/08 05:16:01 ERROR : NEW/Only the Brave 2017 BluRay 10Bit 1080p DD5.1 H265-d3g.mkv: ReadFileHandle.Read error: low level retry 1/10: open file failed: googleapi: Error 403: Rate Limit Exceeded, ra$
2018/10/11 04:05:56 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 1/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:06:09 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 1/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:06:19 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 1/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:06:40 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 1/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:06:48 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 2/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:06:59 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 3/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:06:59 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 4/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:07:00 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 5/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:07:09 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 6/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:07:18 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 7/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:07:29 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 8/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:07:37 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 9/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:07:37 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 10/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., dow$
2018/10/11 04:07:38 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/10/11 04:07:38 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 1/10: file already closed
2018/10/11 04:07:38 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 2/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:07:38 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 3/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:07:38 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 4/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:07:39 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 5/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:07:39 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 6/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:07:39 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 7/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:07:48 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 8/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:07:56 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 9/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:07:57 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 10/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., dow$
2018/10/11 04:07:57 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/10/11 04:07:57 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 1/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:07:57 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 2/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:07:58 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 3/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:08:00 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 4/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:08:00 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 5/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:08:16 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 1/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:08:17 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 2/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:08:17 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 3/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:08:19 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 4/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:08:19 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 5/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:08:20 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 6/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:08:29 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 7/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:08:37 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 8/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:08:37 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 9/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., down$
2018/10/11 04:08:37 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 10/10: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., dow$
2018/10/11 04:08:40 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: open file failed: googleapi: Error 403: The download quota for this file has been exceeded., downloadQuotaExceeded
2018/10/11 04:08:40 ERROR : NEW/The_Big_Sick.(2017).mkv: ReadFileHandle.Read error: low level retry 1/10: file already closed
Yep, it’s already broken by that point so can’t figure out the cause with the prior logs.
Thanks man. Will try when I feel I can wait 24h…
So I actually talked to support and they told me
“As per the logs, the file called ‘UFC 229 Khabib Nurmagomedov Vs Conor McGregor 1080p HDTV DD 5.1 H264-JustHD.ts’ has been downloaded between 60 and 70 times per minute in the last 24 hours. This is why you are running into issues.”
A lot of this is over my head but why would it be downloaded that often? I’ve watched it once in 2 weeks and I am the only one who has access to the server.
That’s what you need the logs for so we can figure out what the issue is. The downloaded x times is something that is a bug by far, but without seeing the logs and seeing why it’s doing it, it’s really tough to figure out.
At some point Plex or something requested the file to be scanned/played/analzyed/something as rclone doesn’t request files, it’s the applications that do that.
Normally if it does that, it grabs a bit of it depending on what the app does but for whatever reason, it’s opening/closing the file and that’s counting completely.
That was an issue way back in earlier versions but it’s since been fixed with the vfs chunked reading or the cache backend.
The common thread I’ve seen so far is the cache backend and the sometimes the v2 flag being added. I personally don’t use either and haven’t seen the issue at all. I’m one person and just 1 data point so it’s hard to make conclusions from that unfortunately.
Since a few days I’ve been having the same issues, and I was running Plexdrive and Rclone 1.36. Going to try the latest Rclone with cache enabled (and ditch Plexdrive) with new credentials, but wanted to share because it doesn’t seem to only be with cache (but Rclone 1.36 does use v2 of the API instead of v3, so could have been related to that).
Anyway, I have disabled Rclone on all servers, will wait for the ban to be lifted, and then see what this clean setup (VM just for testing this) brings. The plan is to copy my Plex install to this new server and scan my library with debug logging turned on.
Alright, I was unlocked. Mounted Rclone (latest version) using:
rclone mount --log-file=rclone.log -vv --allow-other --allow-non-empty gdrive-media-cached: /mnt/media &
With all scheduled tasks in Plex turned off, I did a library scan for my movies: I have 639 in total of which 2 hadn’t been indexed yet.
Following along with the log, I could see Rclone do its thing; Plex found the two new movies, did media analysis and downloaded metadata. To do the scanning (no files cached), analysis and metadata it burned through ~440M. Looking at Google’s developer console, requests peaked at 0.6 per second (very well below quota).
Looking at the Drive audit log, I saw 46 items being downloaded. Those 46 downloads were for two items (I assume those two new movies). One 19 times, the other 27 times.
I used chunk_size = 10M, which probably means that Rclone download 46 * 10M = 460M which is really close to the 440M I observed being downloaded (445M in the cache directory). Is this how it works? 
If so, I’d say that to decrease the amount of downloads and hitting Google’s limit, I could just increase the chunk size (1Gbit/s connection) to say 50M? That would still mean hitting play would be fairly instant (I observed speeds of 15MB/s, so about 4 seconds to get the first chunk in). That would decrease my downloaded items count fivefold.
TL;DR; Doesn’t look like there’s a bug in Rclone, unless you expect chunked downloading to work differently. That means, I think, that either Plex is re-requesting files when it shouldn’t (assuming scheduled tasks are turned off) and/or that Google drastically lowered the quota for download counts.
Trying to be helpful, but not sure if I actually am telling something new. No 403 hit this time, but I have an Rclone log for the above session, plus a csv file with the 46 downloads as logged by Google’s audit tool.
Will start rolling this out to a single production server for testing, with debug logging enabled (I have 1TB to spare).
No. Don’t have that log.
The problem isn’t API hits as those are 403 rate limits that happen normally and rclone will back.
The download Quota Exceeded is related to repeatedly grabbing the same file and for whatever reason (as seen in earlier rclone versions since it didn’t use any chunked type reading), it would count each hit as a full file download. With that behavior with Plex (it open and closes files a lot during the scanning process and depending on the player, it open/closes many times during playing), it would trigger the download error.
If you can get a log file of before the error happens with debug, that’s what we are looking for to help troubleshoot the issue.
Once the error happens and people are posting the 403s with the download exceeded, already, the problem has already occurred so that doesn’t help get to the root cause.
The issue is with rclone, but where is the challenge.