Slow response time over http server with google drive

It looks fine to me. It just takes some time to get the first chunk from Google:

2021/05/14 02:36:16 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:36:16 DEBUG : HTTP REQUEST (req 0x40007e0700)
2021/05/14 02:36:16 DEBUG : GET /drive/v3/files/1SQsXWefS4F62zRwIlAV5RsJyXlK82EUz?alt=media HTTP/1.1
Host: www.googleapis.com
User-Agent: rclone/1.55.1-termux
Authorization: XXXX
Range: bytes=0-134217727

2021/05/14 02:36:16 DEBUG : >>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>>
2021/05/14 02:36:47 DEBUG : <<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<<
2021/05/14 02:36:47 DEBUG : HTTP RESPONSE (req 0x40007e0700)
2021/05/14 02:36:47 DEBUG : HTTP/1.1 206 Partial Content
Content-Length: 61668086

Download speed: 61668086 bytes / 31 sec = 2 MByte/sec (app. 20 Mbit/sec incl. overhead)
That is within my expectations for a single file download from Google.

It may not make a difference in your setup, but did you try tweaking --multi-thread-streams and --multi-thread-streams-cutoff, both are documented here.

How does your solution in this post affect the HTTP response pattern and overall responsiveness?