Rclone mount random slow speeds

ashlar · July 8, 2022, 10:10pm

Problem with that is if then you discover that you transfer data to Dropbox at 20Mbps. With tens of terabytes of data (if not hundreds, for some)... how long is that gonna take?

filthyrich · July 8, 2022, 10:16pm

Its going to be quicker to start over.

If I started over today theres plenty I would change anyway

Bolagnaise · July 8, 2022, 10:52pm

I have switched to using IP 142.251.40.202 which is a google server in california (im in australia) and speeds are significantly faster and remain fast the entire time.

filthyrich · July 8, 2022, 10:58pm

How do you do that? Just paste just that IP in the hosts file?

ashlar · July 8, 2022, 11:01pm

Yes, you use an IP from a server somewhere else and put it in hosts file. It's easy to find them if you have a VPN server that allows you to switch easily from exit points around the world. You then check what IP rclone is using and then use that, if performance is good enough for your needs.

Still... it's incredible to have to resort to this. Unacceptable, actually.

filthyrich · July 8, 2022, 11:06pm

Agreed..... I'm in NZ so piggy backing off the Aus problem, but I wonder what the Consumer Guarantees Act would say, as its now unusable.

ashlar · July 8, 2022, 11:10pm

Oh but I have an open ticket with Google. Sooner or later I'll manage to speak with somebody... my organization has several accounts (in excess of five), over the course of several years we've paid thousands of dollars to Google. I can't accept silence as an answer.

Nebarik · July 8, 2022, 11:40pm

Just happened to me this morning.

Super annoying. Guess I'm going to have to set this script as a cronjob.

gondost · July 9, 2022, 3:19am

I'm having this problem in the southeastern US. I'm using an unlimited .edu account, mount and crypt. I thought my HTPC was having overheating issues, or RAM issues, or CPU saturation issues, or something, until I checked all of that and had no problem. I didn't think that Google would have been my problem.

I have a systemd timer which runs every hour and synchronizes any changes from my .edu account to a different Google account in a workspace I own. I don't ever mount that one, it's mostly parity in case my .edu account gets shut down one day, so I don't know if the behavior is the same. (Update: workspace account is slow too, so it doesn't appear to be google account-related)

Edit: Running the endpoint scanner, this is all I get:

[GES] [INFO] Please wait. Downloading the test file from 142.250.64.234...
[GES] [INFO] Parsing connection with 142.250.64.234.
[GES] [WARNING] Could not parse connection with IP '142.250.64.234'.

I can download my test file successfully using the normal rclone command directly, so it's something with the script. Any ideas on where to look for the source of the issue?

Frazel · July 9, 2022, 4:21am

You read my mind, today I just had 7/7 servers with download speeds around the 300KiB.

Im moving to USA servers to test them out. I'll post a list of USA servers here later today...

rambunctuousity · July 9, 2022, 4:51am

Just registered to say, same issue for me in Australia since yesterday, out of the blue.

I have Google Workspace (Enterprise) rclone-mounted to a NAS folder. Mounted videos completely unplayable now, buffering extreme.

I run emby server on NAS, play media via Shield TV. Zero issue for years. Now ~300kbps DL speeds from Google Workspace throughout (Enterprise). Even direct copy maxes at about 1.3MB/s.

I has zero speed or performance issues before this and maxed out the line at all times.
This is absolutely infuriating and unacceptable. I'm livid.

Edit: The same applies to downloads directly from GDrive Web app, 300kbps. Not limited to rclone. I've contavted Google Workspace support. Naturally, Google Support absolves themselves of responsibility. It MUST be my ISP irrespective that no other issues exist outside GDrive speeds, full speed available. They apparently will investigate but may take 48h. I will report and update this edit.

Bolagnaise · July 9, 2022, 5:04am

Yep, australian servers have literally shit the bed today. Only 1 or two at any one time can even get a few MB/s and i have seen all of them die. I wonder if this is somehow related to the rogers incident somehow.

rowshambow · July 9, 2022, 5:07am

Thanks for this topic (and for the script)!

I'm also based in Melbourne, Australia and I have a dedicated server in a Sydney DC (Equinix I think). Both are horrible using my rclone mounted crypt, at ~300KB/s download (upload is still uncapped it seemed)

The title of the thread could be better. This feels like more of an outage or an incident rather then some new type of enforcement. Many enterprise customers will be severely impacted by this literally unable to work - so I hope with some patience this is going to go away

bolex17 · July 9, 2022, 5:08am

I've set my host to 172.217.168.234 which seems to be working fine 'for now'... Will keep an eye on it.
I also tried downloading directly from Google Drive website and only getting around 350KBps as well so it's definitely not an rclone thing.

rowshambow · July 9, 2022, 5:51am

as a workaround and with a VPN to singapore - these yielded much better results (in AU, without staying connected to a VPN) - you could add them to /etc/hosts (or the windows equivelant) in the meantime.. I might keep editing this post in case others bump into it and find it useful

142.251.12.95 www.googleapis.com
142.250.4.95 www.googleapis.com

bolex17 · July 9, 2022, 6:48am

Thanks for this, just tried this and works better than the one I was connected to.

Frazel · July 9, 2022, 6:57am

List of servers around the world. Keep in mind your data will be in two locations at least 100miles apart. Generally speaking the two locations will be the two closest points where you access the data. So just because a site in India is slow, it might just mean that your data is in Europe, so it needs to fetch the data from Europe to put it through the API server in India before it can hand it off to you.

Sinagpore
142.251.10.95
142.251.12.95
172.217.194.95
142.250.4.95
74.125.200.95
74.125.24.95
South Korea
172.217.161.74
172.217.26.234
172.217.175.10
172.217.175.42
172.217.175.74
172.217.31.170
172.217.161.42
142.250.207.10
172.217.174.106
216.58.220.106
142.250.199.106
142.250.196.106
142.250.196.138
142.251.42.170
142.251.42.202
172.217.31.138
Mumbai, India
216.58.203.10
216.58.196.74
172.217.160.170
142.250.67.138
216.58.203.42
172.217.166.74
142.250.67.170
142.250.67.202
142.250.76.170
142.250.76.202
142.250.183.42
142.250.183.74
142.250.199.170
142.251.42.106
172.217.167.170
172.217.174.234
Los Angeles, USA
142.250.68.106
142.250.72.138
142.250.72.170
142.250.176.10
142.250.188.234
142.250.72.234
142.251.40.42
142.250.217.138
142.250.189.10
172.217.14.74
172.217.14.106
142.250.68.10
142.250.68.42
142.250.68.74
Tokyo, Japan
172.217.175.106
142.251.42.138
142.251.42.170
142.251.42.202
172.217.31.138
172.217.161.74
172.217.26.234
216.58.220.138
172.217.175.10
172.217.175.74
172.217.31.170
172.217.161.42
142.250.207.10
172.217.174.106
142.250.199.106
142.250.196.106

Im doing testing over all the IPs, but from early testing Singapore (unsurprisingly) is the best with 65-85MiB/s for a 500MB test file.

Frazel · July 9, 2022, 7:41am

These are the IPs are are resovable from each city/country. It does not nesscessary mean the server is in that country, e.g. there is overlap between Japan and South Korea.

Test file is 50MB

Singapore
Please wait, downloading the test file from 142.251.10.95... 5.253 MiB/s
Please wait, downloading the test file from 142.251.12.95... 5.500 MiB/s
Please wait, downloading the test file from 172.217.194.95... 5.999 MiB/s
Please wait, downloading the test file from 142.250.4.95... 5.426 MiB/s
Please wait, downloading the test file from 74.125.200.95... 8.250 MiB/s
Please wait, downloading the test file from 74.125.24.95... 5.749 MiB/s
South Korea
Please wait, downloading the test file from 172.217.161.74... 5.998 MiB/s
Please wait, downloading the test file from 172.217.26.234... 953.6 KiB/s - Blacklisting
Please wait, downloading the test file from 172.217.175.10... 6.572 MiB/s
Please wait, downloading the test file from 172.217.175.42... 9.745 MiB/s
Please wait, downloading the test file from 172.217.175.74... 7.000 MiB/s
Please wait, downloading the test file from 172.217.31.170... 993.8 KiB/s - Blacklisting
Please wait, downloading the test file from 172.217.161.42... 8.001 MiB/s
Please wait, downloading the test file from 142.250.207.10... 839.1 KiB/s - Blacklisting
Please wait, downloading the test file from 172.217.174.106... 7.000 MiB/s
Please wait, downloading the test file from 216.58.220.106... 9.247 MiB/s
Please wait, downloading the test file from 142.250.199.106... 948.0 KiB/s - Blacklisting
Please wait, downloading the test file from 142.250.196.106... 857.5 KiB/s - Blacklisting
Please wait, downloading the test file from 142.250.196.138... 900.3 KiB/s - Blacklisting
Please wait, downloading the test file from 142.251.42.170... 939.1 KiB/s - Blacklisting
Please wait, downloading the test file from 142.251.42.202... 960.1 KiB/s - Blacklisting
Please wait, downloading the test file from 172.217.31.138... 8.999 MiB/s
Mumbai, India
Please wait, downloading the test file from 216.58.203.10... 525.0 KiB/s - Blacklisting
Please wait, downloading the test file from 216.58.196.74... 533.3 KiB/s - Blacklisting
Please wait, downloading the test file from 172.217.160.170... 539.0 KiB/s - Blacklisting
Please wait, downloading the test file from 142.250.67.138... 547.1 KiB/s - Blacklisting
Please wait, downloading the test file from 216.58.203.42... 552.8 KiB/s - Blacklisting
Please wait, downloading the test file from 172.217.166.74... 545.8 KiB/s - Blacklisting
Please wait, downloading the test file from 142.250.67.170... 2.335 MiB/s
Please wait, downloading the test file from 142.250.67.202... 546.3 KiB/s - Blacklisting
Please wait, downloading the test file from 142.250.76.170... 669.8 KiB/s - Blacklisting
Please wait, downloading the test file from 142.250.76.202... 562.1 KiB/s - Blacklisting
Please wait, downloading the test file from 142.250.183.42... 513.1 KiB/s - Blacklisting
Please wait, downloading the test file from 142.250.183.74... 533.8 KiB/s - Blacklisting
Please wait, downloading the test file from 142.250.199.170... 563.5 KiB/s - Blacklisting
Please wait, downloading the test file from 142.251.42.106... 558.4 KiB/s - Blacklisting
Please wait, downloading the test file from 172.217.167.170... 488.2 KiB/s - Blacklisting
Please wait, downloading the test file from 172.217.174.234... 543.4 KiB/s - Blacklisting
Los Angeles, USA
Please wait, downloading the test file from 142.250.68.106... 9.745 MiB/s
Please wait, downloading the test file from 142.250.72.138... 7.004 MiB/s
Please wait, downloading the test file from 142.250.72.170... 4.999 MiB/s
Please wait, downloading the test file from 142.250.176.10... 4.090 MiB/s
Please wait, downloading the test file from 142.250.188.234... 4.000 MiB/s
Please wait, downloading the test file from 142.250.72.234... 9.995 MiB/s
Please wait, downloading the test file from 142.251.40.42... 4.900 MiB/s
Please wait, downloading the test file from 142.250.217.138... 3.538 MiB/s
Please wait, downloading the test file from 142.250.189.10... 4.599 MiB/s
Please wait, downloading the test file from 172.217.14.74... 9.251 MiB/s
Please wait, downloading the test file from 172.217.14.106... 8.396 MiB/s
Please wait, downloading the test file from 142.250.68.10... 8.666 MiB/s
Please wait, downloading the test file from 142.250.68.42... 8.327 MiB/s
Please wait, downloading the test file from 142.250.68.74... 1.999 MiB/s
Tokyo, Japan
Please wait, downloading the test file from 172.217.175.106... 8.334 MiB/s
Please wait, downloading the test file from 142.251.42.138... 954.5 KiB/s - Blacklisting
Please wait, downloading the test file from 142.251.42.170... 961.0 KiB/s - Blacklisting
Please wait, downloading the test file from 142.251.42.202... 1005. KiB/s - Blacklisting
Please wait, downloading the test file from 172.217.31.138... 1.853 MiB/s
Please wait, downloading the test file from 172.217.161.74... 1.543 MiB/s
Please wait, downloading the test file from 172.217.26.234... 933.5 KiB/s - Blacklisting
Please wait, downloading the test file from 216.58.220.138... 8.202 MiB/s
Please wait, downloading the test file from 172.217.175.10... 12.00 MiB/s
Please wait, downloading the test file from 172.217.175.74... 7.745 MiB/s
Please wait, downloading the test file from 172.217.31.170... 10.99 MiB/s
Please wait, downloading the test file from 172.217.161.42... 869.7 KiB/s - Blacklisting
Please wait, downloading the test file from 142.250.207.10... 897.8 KiB/s - Blacklisting
Please wait, downloading the test file from 172.217.174.106... 8.998 MiB/s
Please wait, downloading the test file from 142.250.199.106... 1005. KiB/s - Blacklisting
Please wait, downloading the test file from 142.250.196.106... 1.062 MiB/s

5)MB Test File Summary:
Singapore servers are rock solid
USA is next best, but they have a couple of bad servers.
South Korea / Japan / India arent worth the time and effort.

500MB Test file with Singapore and USA servers

Please wait, downloading the test file from 142.251.10.95... 83.14 MiB/s
Please wait, downloading the test file from 142.251.12.95... 81.07 MiB/s
Please wait, downloading the test file from 172.217.194.95... 68.84 MiB/s
Please wait, downloading the test file from 142.250.4.95... 78.50 MiB/s
Please wait, downloading the test file from 74.125.200.95... 80.08 MiB/s
Please wait, downloading the test file from 74.125.24.95... 80.74 MiB/s
Please wait, downloading the test file from 142.250.68.106... 63.81 MiB/s
Please wait, downloading the test file from 142.250.72.138... 9.113 MiB/s
Please wait, downloading the test file from 142.250.72.170... 11.80 MiB/s
Please wait, downloading the test file from 142.250.176.10... 6.961 MiB/s
Please wait, downloading the test file from 142.250.188.234... 9.427 MiB/s
Please wait, downloading the test file from 142.250.72.234... 70.96 MiB/s
Please wait, downloading the test file from 142.251.40.42... 11.65 MiB/s
Please wait, downloading the test file from 142.250.217.138... 8.229 MiB/s
Please wait, downloading the test file from 142.250.189.10... 9.667 MiB/s
Please wait, downloading the test file from 172.217.14.74... 71.35 MiB/s
Please wait, downloading the test file from 172.217.14.106... 68.19 MiB/s
Please wait, downloading the test file from 142.250.68.10... 78.80 MiB/s
Please wait, downloading the test file from 142.250.68.42... 76.30 MiB/s
Please wait, downloading the test file from 142.250.68.74... 78.76 MiB/s

Frazel · July 9, 2022, 8:03am

OK, so if you have just popped along to the thread, here is the highlights.

In Australia (and other countries) Google has issues with the servers that sit behind www.googleapis.com which is what rclone talks out to if you are using google drive with rclone
At the moment, the best fix it to modify your hosts file with a fast server to force Plex/Jellyfin etc to download from the fastest server
If you are in or near Australia, look at the list above and find a server that has the highest MiB/s
a) On linux go to /etc/hosts and add the following line 142.251.10.95 www.googleapis.com and save and close
b) On Windows go to C:\Windows\System32\drivers\etc\ and cut the hosts file from that location and put it on your desktop. Open the file and add the following line 142.251.10.95 www.googleapis.com . Then save the file and cut and paste the file back to C:\Windows\System32\drivers\etc\ . Then click on the start button and type ipconfig /flushdns and press enter . Then you should be using the new IP address, if all else fails just restart the computer for the change to apply.
Speeds above are in MiB/s this is different to Mbps or MBps. If you dont understand, use a calculator Convert MiB/s to Mbps - Conversion of Measurement Units
Just because a server is fast now, it does not mean it will always stay fast.
Try and use a server IP that is in Singapore as these so far seem more stable

rambunctuousity · July 9, 2022, 9:32am

Phenomenal work. I really appreciate your work mate!