On Sunday, I managed to break my Rclone tinkering around ( I have no idea what I did exactly) and decided to start from scratch by deleting both remotes and setting up a new Google Drive and Cache
I followed these instructions and the scan is taking days! This seems off.
https://kb.ultraseedbox.com/display/DOC/Rclone+mount+with+google+drive
My Rclone knowledge is at an absolute minimum (Im trying 
) and was wondering if there is a way to check to see if things are running “smoothly” or not. There is about 10TB of content.
Cheers
What’s your actual mount command that you are using if you:
ps -ef | grep rclone
Are you playing/scanning directly to the mount or using something else like unionfs?
ohheyth+ 14821 16700 0 Sep25 pts/299 00:21:27 rclone mount -vvv --allow-other --allow-non-empty gcache: /home11/ohheythere/gcache
ohheyth+ 39500 36521 0 17:25 pts/103 00:00:00 grep rclone
Honestly, I have no idea if I am playing direct or unionfs.
Someone originally setup the Rclone for me on USB and things were working flawlessly. I then decided to tinker, broke it, deleted the remotes and then reset them up using the link above.
What’s your:
rclone version
output and if you can share your rclone.conf (with the passwords and keys blanked out), that would help as well.
rclone v1.40
- os/arch: linux/amd64
- go version: go1.10
I apologize for my ignorance but how do I get my rclone.conf?
On the guide you posted, you need to execute step #2 to grab the later version as that’s a pretty old version missing some key fixes in it.
Grab that first and update the version.
You can grab the config by:
rclone config show
make sure to not paste in any passwords or keys when you post it here.
[gdrive]
type = drive
client_id =
client_secret =
scope = drive
root_folder_id =
service_account_file =
token = {“access_token”:"tokenremoved
[gcache]
type = cache
remote = gdrive:
plex_url = removed
plex_username = matt@removed
plex_password = removed
chunk_size = 5M
info_age = 24h
chunk_total_size = 10G
plex_token = removed
I was able to update to the 1.43 and it helped a bit however, for direct stream files, it went from 6-10 seconds to load, to 2 mins
I’d adjust the chunk size from 5M to 32M to start.
Can you see put on the debug logs and see what’s going on and share the logs so we have some information to look at?
Thank you for all of your help! I sincerely appreciate your kindness.
I fixed the chunk size, however (I swear I am searching for how ) I am not sure how to do the debug logs. haha, I am very new at this.
What is the best command? Thanks!
Here is a copy of the DEBUG LOGS when trying to play a file. It is till take minutes to direct play and still buffers quite a bit.
2018/09/28 00:34:38 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: >Attr: a=valid=1s ino=0 size=26922104832 mode=-rw-r–r--, err=
2018/09/28 00:34:38 DEBUG : &{MEDIA/NEW/Oceans Eight.(2018).m2ts ®}: Read: len=36864, offset=26921852928
2018/09/28 00:34:38 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: ReadFileHandle.seek from 6094848 to 26921852928 (fs.RangeSeeker)
2018/09/28 00:34:38 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: ChunkedReader.RangeSeek from 22016000 to 26921852928 length -1
2018/09/28 00:34:38 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: ChunkedReader.Read at -1 length 4096 chunkOffset 26921852928 chunkSize 134217728
2018/09/28 00:34:38 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: ChunkedReader.openRange at 26921852928 length 134217728
2018/09/28 00:34:40 DEBUG : pacer: Rate limited, sleeping for 1.429847269s (1 consecutive low level retries)
2018/09/28 00:34:40 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/09/28 00:34:40 DEBUG : pacer: Rate limited, sleeping for 2.522804337s (2 consecutive low level retries)
2018/09/28 00:34:40 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/09/28 00:34:41 DEBUG : pacer: Rate limited, sleeping for 4.901567028s (3 consecutive low level retries)
2018/09/28 00:34:41 DEBUG : pacer: low level retry 3/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/09/28 00:34:44 DEBUG : pacer: Rate limited, sleeping for 8.914540078s (4 consecutive low level retries)
2018/09/28 00:34:44 DEBUG : pacer: low level retry 4/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/09/28 00:34:49 DEBUG : pacer: Resetting sleep to minimum 10ms on success
2018/09/28 00:34:49 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: moving offset set from 0 to 26921852928
2018/09/28 00:34:49 INFO : MEDIA/NEW/Oceans Eight.(2018).m2ts: confirmed reading by external reader
2018/09/28 00:34:49 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: scale workers to 4
2018/09/28 00:34:50 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: cache reader closed 22016000
2018/09/28 00:34:50 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: 26910654464: chunk retry storage: 0
2018/09/28 00:34:50 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: 26910654464: chunk retry storage: 1
2018/09/28 00:34:51 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: 26910654464: chunk retry storage: 2
2018/09/28 00:34:51 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: 26910654464: chunk retry storage: 3
2018/09/28 00:34:52 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: 26910654464: chunk retry storage: 4
2018/09/28 00:34:52 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: 26910654464: chunk retry storage: 5
2018/09/28 00:34:53 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: 26910654464: chunk retry storage: 6
2018/09/28 00:34:53 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: 26910654464: chunk retry storage: 7
2018/09/28 00:34:54 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: 26910654464: chunk retry storage: 8
2018/09/28 00:34:54 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: 26910654464: chunk retry storage: 9
2018/09/28 00:34:55 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: 26910654464: chunk retry storage: 10
2018/09/28 00:34:55 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: 26910654464: chunk retry storage: 11
2018/09/28 00:34:56 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: 26910654464: chunk retry storage: 12
2018/09/28 00:34:56 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: 26910654464: chunk retry storage: 13
2018/09/28 00:34:57 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: 26910654464: chunk retry storage: 14
2018/09/28 00:34:57 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: 26910654464: chunk retry storage: 15
2018/09/28 00:34:58 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: 26910654464: chunk retry storage: 16
2018/09/28 00:34:58 DEBUG : worker-3 <Oceans Eight.(2018).m2ts>: partial downloaded chunk 25.062G
2018/09/28 00:34:58 DEBUG : worker-0 <Oceans Eight.(2018).m2ts>: downloaded chunk 26877100032
2018/09/28 00:34:58 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: ChunkedReader.Read at 26921857024 length 8192 chunkOffset 26921852928 chunkSize 134217728
2018/09/28 00:34:58 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: ChunkedReader.Read at 26921865216 length 16384 chunkOffset 26921852928 chunkSize 134217728
2018/09/28 00:34:58 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: ChunkedReader.Read at 26921881600 length 32768 chunkOffset 26921852928 chunkSize 134217728
2018/09/28 00:34:58 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: ChunkedReader.Read at 26921914368 length 65536 chunkOffset 26921852928 chunkSize 134217728
2018/09/28 00:34:58 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: ChunkedReader.Read at 26921979904 length 131072 chunkOffset 26921852928 chunkSize 134217728
2018/09/28 00:34:58 DEBUG : &{MEDIA/NEW/Oceans Eight.(2018).m2ts ®}: >Read: read=36864, err=
2018/09/28 00:34:58 DEBUG : &{MEDIA/NEW/Oceans Eight.(2018).m2ts ®}: Read: len=16384, offset=26921836544
2018/09/28 00:34:58 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: ReadFileHandle.seek from 26921889792 to 26921836544 (fs.RangeSeeker)
2018/09/28 00:34:58 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: ChunkedReader.RangeSeek from 26922104832 to 26921836544 length -1
2018/09/28 00:34:58 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: ChunkedReader.Read at -1 length 4096 chunkOffset 26921836544 chunkSize 134217728
2018/09/28 00:34:58 DEBUG : MEDIA/NEW/Oceans Eight.(2018).m2ts: ChunkedReader.openRange at 26921836544 length 134217728
2018/09/28 00:35:00 DEBUG : pacer: Rate limited, sleeping for 1.72743001s (1 consecutive low level retries)
2018/09/28 00:35:00 DEBUG : pacer: low level retry 1/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/09/28 00:35:00 DEBUG : pacer: Rate limited, sleeping for 2.077821188s (2 consecutive low level retries)
2018/09/28 00:35:00 DEBUG : pacer: low level retry 2/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/09/28 00:35:02 DEBUG : pacer: Rate limited, sleeping for 4.411806431s (3 consecutive low level retries)
2018/09/28 00:35:02 DEBUG : pacer: low level retry 3/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
2018/09/28 00:35:04 DEBUG : pacer: Rate limited, sleeping for 8.169767515s (4 consecutive low level retries)
2018/09/28 00:35:04 DEBUG : pacer: low level retry 4/10 (error googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded)
Ouch. Those 403s are why life is bad for you. Are you able to use your own api key?