Slow response time over http server with google drive

kcubeterm · May 13, 2021, 1:40pm

Doesn't help. I tried already.

Animosity022 · May 13, 2021, 2:04pm

That's something local/phone/etc as rclone isn't waiting but something on your device is doing that as it's a phone, I'm not sure what else to suggest.

Mine starts instantly:

When I type wget.

kcubeterm · May 13, 2021, 2:28pm

I tried on my vps, cloudshell also. Same thing happens. Maybe something issue with my google drive itself.

Animosity022 · May 13, 2021, 2:38pm

Is a regular GSuite account / EDU account?

Any region differences? Are you in the EU and the drive is US?

Seems like there is some latency in the request process.

kcubeterm · May 13, 2021, 2:43pm

I am from india, no idea about location of drive. That's my personal account and free account.

My VPS is in european region. Same issue there too.
35+ second of latency is too high. I hope google don't keep drive on moon.

Animosity022 · May 13, 2021, 2:52pm

What do you get when you ping api.google.com?

kcubeterm · May 13, 2021, 2:54pm

Ping is normal.

api.l.google.com ping statistics ---
12 packets transmitted, 12 received, 0% packet loss, time 11016ms
rtt min/avg/max/mdev = 51.640/63.314/74.716/7.110 ms

Ole · May 13, 2021, 7:17pm

You may want to try the flag --dump requests or --dump 'requests,responses'
Both are described here

Be careful before sharing, the dumps may reveal secrets!

It was a DNS setup issue last time I saw something similar

kcubeterm · May 14, 2021, 2:40am

rclone -vv serve http gdrive: --dump requests                          2021/05/14 02:36:05 DEBUG : Using config file from "/data/data/com.termux/files/home/.config/rclone/rclone.conf"                                        2021/05/14 02:36:05 DEBUG : rclone: Version "1.55.1-termux" starting with parameters ["rclone" "-vv" "serve" "http" "gdrive:" "--dump" "requests"]
2021/05/14 02:36:05 DEBUG : Creating backend with remote "gdrive:"          2021/05/14 02:36:05 DEBUG : You have specified to dump information. Please be noted that the Accept-Encoding as shown may not be correct in the request and the response may not show Content-Encoding if the go standard libraries auto gzip encoding was in effect. In this case the body of the request will be gunzipped before showing it.
2021/05/14 02:36:05 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                                                2021/05/14 02:36:05 DEBUG : HTTP REQUEST (req 0x40002a1b00)
2021/05/14 02:36:05 DEBUG : GET /drive/v3/files/root?alt=json&fields=id&prettyPrint=false&supportsAllDrives=true HTTP/1.1                               Host: www.googleapis.com
User-Agent: rclone/1.55.1-termux                                            Authorization: XXXX                                                         X-Goog-Api-Client: gl-go/1.16.3 gdcl/20210128
Accept-Encoding: gzip                                                                                                                                   2021/05/14 02:36:05 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>                                                                2021/05/14 02:36:06 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:36:06 DEBUG : HTTP RESPONSE (req 0x40002a1b00)                2021/05/14 02:36:06 DEBUG : HTTP/1.1 200 OK                                 Transfer-Encoding: chunked
Alt-Svc: h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
Cache-Control: no-cache, no-store, max-age=0, must-revalidate               Content-Security-Policy: frame-ancestors 'self'                             Content-Type: application/json; charset=UTF-8
Date: Fri, 14 May 2021 02:36:07 GMT                                         Expires: Mon, 01 Jan 1990 00:00:00 GMT                                      Pragma: no-cache
Server: GSE                                                                 Vary: Origin                                                                Vary: X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 1; mode=block

2021/05/14 02:36:06 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:36:06 DEBUG : Google drive root '': root_folder_id = "0ABl-z_9UxhBvUk9PVA" - save this in the config to speed up startup
2021/05/14 02:36:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:36:06 DEBUG : HTTP REQUEST (req 0x40003e5700)
2021/05/14 02:36:06 DEBUG : GET /drive/v3/changes/startPageToken?alt=json&prettyPrint=false&supportsAllDrives=true HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/1.55.1-termux
Authorization: XXXX
X-Goog-Api-Client: gl-go/1.16.3 gdcl/20210128
Accept-Encoding: gzip

2021/05/14 02:36:06 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:36:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:36:07 DEBUG : HTTP RESPONSE (req 0x40003e5700)
2021/05/14 02:36:07 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Alt-Svc: h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Security-Policy: frame-ancestors 'self'
Content-Type: application/json; charset=UTF-8
Date: Fri, 14 May 2021 02:36:07 GMT
Expires: Mon, 01 Jan 1990 00:00:00 GMT
Pragma: no-cache
Server: GSE
Vary: Origin
Vary: X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 1; mode=block

2021/05/14 02:36:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:36:07 NOTICE: Google drive root '': Serving on http://localhost:8080/
2021/05/14 02:36:14 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:36:14 DEBUG : HTTP REQUEST (req 0x400047f500)
2021/05/14 02:36:14 DEBUG : GET /drive/v3/files?alt=json&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=true&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%270ABl-z_9UxhBvUk9PVA%27+in+parents%29&supportsAllDrives=true HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/1.55.1-termux
Authorization: XXXX
X-Goog-Api-Client: gl-go/1.16.3 gdcl/20210128
Accept-Encoding: gzip

2021/05/14 02:36:14 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:36:15 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:36:15 DEBUG : HTTP RESPONSE (req 0x400047f500)
2021/05/14 02:36:15 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Alt-Svc: h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Security-Policy: frame-ancestors 'self'
Content-Type: application/json; charset=UTF-8
Date: Fri, 14 May 2021 02:36:15 GMT
Expires: Mon, 01 Jan 1990 00:00:00 GMT
Pragma: no-cache
Server: GSE
Vary: Origin
Vary: X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 1; mode=block

2021/05/14 02:36:15 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:36:15 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:36:15 DEBUG : HTTP REQUEST (req 0x40002a1900)
2021/05/14 02:36:15 DEBUG : GET /drive/v3/files?alt=json&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=true&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%271DWccU7ScJ6ndlN7nZpVhHIe-yMRNpLZw%27+in+parents%29&supportsAllDrives=true HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/1.55.1-termux
Authorization: XXXX
X-Goog-Api-Client: gl-go/1.16.3 gdcl/20210128
Accept-Encoding: gzip

2021/05/14 02:36:15 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:36:15 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:36:15 DEBUG : HTTP RESPONSE (req 0x40002a1900)
2021/05/14 02:36:15 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Alt-Svc: h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Security-Policy: frame-ancestors 'self'
Content-Type: application/json; charset=UTF-8
Date: Fri, 14 May 2021 02:36:16 GMT
Expires: Mon, 01 Jan 1990 00:00:00 GMT
Pragma: no-cache
Server: GSE
Vary: Origin
Vary: X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 1; mode=block

2021/05/14 02:36:15 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:36:15 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:36:15 DEBUG : HTTP REQUEST (req 0x4000a62200)
2021/05/14 02:36:15 DEBUG : GET /drive/v3/files?alt=json&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=true&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%271GOY-I8JTBNHL2HUDnEYB6NyTowUtFQLe%27+in+parents%29&supportsAllDrives=true HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/1.55.1-termux
Authorization: XXXX
X-Goog-Api-Client: gl-go/1.16.3 gdcl/20210128
Accept-Encoding: gzip

2021/05/14 02:36:15 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:36:16 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:36:16 DEBUG : HTTP RESPONSE (req 0x4000a62200)
2021/05/14 02:36:16 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Alt-Svc: h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Security-Policy: frame-ancestors 'self'
Content-Type: application/json; charset=UTF-8
Date: Fri, 14 May 2021 02:36:16 GMT
Expires: Mon, 01 Jan 1990 00:00:00 GMT
Pragma: no-cache
Server: GSE
Vary: Origin
Vary: X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 1; mode=block

2021/05/14 02:36:16 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:36:16 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:36:16 DEBUG : HTTP REQUEST (req 0x40007e0400)
2021/05/14 02:36:16 DEBUG : GET /drive/v3/files?alt=json&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=true&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%271GQRX-c_ysS35XucagwJq4OeeiQl1fGGY%27+in+parents%29&supportsAllDrives=true HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/1.55.1-termux
Authorization: XXXX
X-Goog-Api-Client: gl-go/1.16.3 gdcl/20210128
Accept-Encoding: gzip

2021/05/14 02:36:16 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:36:16 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:36:16 DEBUG : HTTP RESPONSE (req 0x40007e0400)
2021/05/14 02:36:16 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Alt-Svc: h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Security-Policy: frame-ancestors 'self'
Content-Type: application/json; charset=UTF-8
Date: Fri, 14 May 2021 02:36:17 GMT
Expires: Mon, 01 Jan 1990 00:00:00 GMT
Pragma: no-cache
Server: GSE
Vary: Origin
Vary: X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 1; mode=block

2021/05/14 02:36:16 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:36:16 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: Open: flags=O_RDONLY
2021/05/14 02:36:16 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: >Open: fd=files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb (r), err=<nil>
2021/05/14 02:36:16 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.openRange at 0 length 134217728
2021/05/14 02:36:16 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:36:16 DEBUG : HTTP REQUEST (req 0x40007e0700)
2021/05/14 02:36:16 DEBUG : GET /drive/v3/files/1SQsXWefS4F62zRwIlAV5RsJyXlK82EUz?alt=media HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/1.55.1-termux
Authorization: XXXX
Range: bytes=0-134217727

2021/05/14 02:36:16 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:36:47 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:36:47 DEBUG : HTTP RESPONSE (req 0x40007e0700)
2021/05/14 02:36:47 DEBUG : HTTP/1.1 206 Partial Content
Content-Length: 61668086
Alt-Svc: h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
Cache-Control: private, max-age=0, must-revalidate
Content-Disposition: attachment
Content-Range: bytes 0-61668085/61668086
Content-Type: application/x-debian-package
Date: Fri, 14 May 2021 02:36:48 GMT
Expires: Fri, 14 May 2021 02:36:48 GMT
Server: UploadServer
Vary: Origin
Vary: X-Origin
X-Goog-Hash: crc32c=NsjJNQ==
X-Guploader-Uploadid: ABg5-UylgBrgIUF9PCCQpEn_FHmfbQSk7aF3ulZbx_EyskvvtQpjtikoXeGP5XnyveK3fy4I-VXiaJ-V7_PhaSw2-mY

2021/05/14 02:36:47 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:36:47 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 0 length 4096 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:47 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 4096 length 8192 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:47 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 12288 length 16384 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:47 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 28672 length 32768 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:47 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 61440 length 65536 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:47 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 126976 length 131072 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:48 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 258048 length 262144 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:48 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 520192 length 524288 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:48 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 1044480 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:48 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 2093056 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:49 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 3141632 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:49 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 4190208 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:50 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 5238784 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:51 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 6287360 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:51 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 7335936 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:52 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 8384512 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:52 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 9433088 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:53 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 10481664 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:53 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 11530240 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:54 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 12578816 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:54 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 13627392 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:55 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 14675968 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:55 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 15724544 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:56 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 16773120 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:56 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 17821696 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:57 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 18870272 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:57 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 19918848 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:58 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 20967424 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:59 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 22016000 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:36:59 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 23064576 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:00 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 24113152 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:00 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 25161728 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:01 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 26210304 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:01 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 27258880 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:02 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 28307456 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:03 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 29356032 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:03 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 30404608 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:04 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 31453184 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:04 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 32501760 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:05 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 33550336 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:05 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 34598912 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:06 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 35647488 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:06 INFO  :
Transferred:       33.996M / 58.811 MBytes, 58%, 697.509 kBytes/s, ETA 36s
Transferred:            0 / 1, 0%
Elapsed time:       1m1.2s
Transferring:
 * files/L/Lol/Copy of go…ng_2:1.16.3_x86_64.deb: 57% /58.811M, 1.780M/s, 13s

2021/05/14 02:37:06 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 36696064 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:07 DEBUG : Google drive root '': Checking for changes on remote
2021/05/14 02:37:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:37:07 DEBUG : HTTP REQUEST (req 0x400047f400)
2021/05/14 02:37:07 DEBUG : GET /drive/v3/changes?alt=json&fields=nextPageToken%2CnewStartPageToken%2Cchanges%28fileId%2Cfile%28name%2Cparents%2CmimeType%29%29&includeItemsFromAllDrives=true&pageSize=1000&pageToken=26124&prettyPrint=false&supportsAllDrives=true HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/1.55.1-termux
Authorization: XXXX
X-Goog-Api-Client: gl-go/1.16.3 gdcl/20210128
Accept-Encoding: gzip

2021/05/14 02:37:07 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:37:07 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 37744640 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:37:07 DEBUG : HTTP RESPONSE (req 0x400047f400)
2021/05/14 02:37:07 DEBUG : HTTP/1.1 200 OK
Transfer-Encoding: chunked
Alt-Svc: h3-29=":443"; ma=2592000,h3-T051=":443"; ma=2592000,h3-Q050=":443"; ma=2592000,h3-Q046=":443"; ma=2592000,h3-Q043=":443"; ma=2592000,quic=":443"; ma=2592000; v="46,43"
Cache-Control: no-cache, no-store, max-age=0, must-revalidate
Content-Security-Policy: frame-ancestors 'self'
Content-Type: application/json; charset=UTF-8
Date: Fri, 14 May 2021 02:37:08 GMT
Expires: Mon, 01 Jan 1990 00:00:00 GMT
Pragma: no-cache
Server: GSE
Vary: Origin
Vary: X-Origin
X-Content-Type-Options: nosniff
X-Frame-Options: SAMEORIGIN
X-Xss-Protection: 1; mode=block

2021/05/14 02:37:07 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:37:07 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 38793216 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:08 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 39841792 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:09 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 40890368 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:09 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 41938944 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:10 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 42987520 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:10 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 44036096 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:11 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 45084672 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:11 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 46133248 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:12 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 47181824 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:12 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 48230400 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:13 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 49278976 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:14 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 50327552 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:14 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 51376128 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:15 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 52424704 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:15 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 53473280 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:16 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 54521856 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:16 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 55570432 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:17 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 56619008 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:17 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 57667584 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:18 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 58716160 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:18 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 59764736 length 1048576 chunkOffset 0 chunkSize 134217728
2021/05/14 02:37:19 DEBUG : files/L/Lol/Copy of golang_2:1.16.3_x86_64.deb: ChunkedReader.Read at 60813312 length 1048576 chunkOffset 0 chunkSize 134217728

Ole · May 14, 2021, 7:43am

It looks fine to me. It just takes some time to get the first chunk from Google:

2021/05/14 02:36:16 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:36:16 DEBUG : HTTP REQUEST (req 0x40007e0700)
2021/05/14 02:36:16 DEBUG : GET /drive/v3/files/1SQsXWefS4F62zRwIlAV5RsJyXlK82EUz?alt=media HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/1.55.1-termux
Authorization: XXXX
Range: bytes=0-134217727

2021/05/14 02:36:16 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:36:47 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:36:47 DEBUG : HTTP RESPONSE (req 0x40007e0700)
2021/05/14 02:36:47 DEBUG : HTTP/1.1 206 Partial Content
Content-Length: 61668086

Download speed: 61668086 bytes / 31 sec = 2 MByte/sec (app. 20 Mbit/sec incl. overhead)
That is within my expectations for a single file download from Google.

It may not make a difference in your setup, but did you try tweaking --multi-thread-streams and --multi-thread-streams-cutoff, both are documented here.

How does your solution in this post affect the HTTP response pattern and overall responsiveness?

kcubeterm · May 14, 2021, 9:22am

It takes 35 second to receive first chunk. Do you believe this is normal.

In last post, that solution doesn't help me for big files even many times i got 503 error.

Ole · May 14, 2021, 9:40am

That really depends on your platform, your network connection and load on your the local Google servers. Your could try to isolate the root cause by comparing to a download of the same file from Google in a browser on the same platform, on another platform (e.g. a PC). And so forth.

I typically think in bisection (halving the possibilities) when trouble shooting issues like this.

kcubeterm · May 14, 2021, 9:55am

I tried almost everything and did many research on it but i found nothing. Could you please confirm that issue doesn't exist with your cloud. Please try to repoduce it with same file, here golang_2:1.16.3_x86_64.deb - Google Drive

Ole · May 14, 2021, 10:09am

Sorry to hear that, I doubt rclone can do better than a download from GoogleDrive using the Chrome browser on your PC.

Sorry, I never download files from unverified sources.

kcubeterm · May 14, 2021, 10:23am

Cool. Thanks, finally I found something. Issue is occurring with *.deb only. Just tried with 272 MBof mp4 videos, everything is normal.

Have you ever encountered such issues here 9r any forum ?

kcubeterm · May 14, 2021, 11:12am

What the hell, same file just changed the extension .deb to .mp4 get downloaded in 6 second.

ncw · May 14, 2021, 1:59pm

I tried this

rclone -P backend copyid drive: 1SQsXWefS4F62zRwIlAV5RsJyXlK82EUz /tmp/

And yes - it did nothing for approx 30 seconds before downloading normally.

Maybe google is virus checking it or something?

kcubeterm · May 14, 2021, 2:01pm

Maybe google is virus checking it or something?

Yes, Do any ways to disable it.

ncw · May 14, 2021, 2:07pm

I thought --drive-acknowledge-abuse might help but it did nothing.

I don't think there is a flag in the drive API to turn off virus checks - not one I've found anyway.

system · July 14, 2021, 10:07am

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.