Rclone Script not working with GDrive

What is the problem you are having with rclone?

I cannot get my rclone sync script to worth with GDrive anymore. I script acts like it's it's going to run just fine, getting good speeds (5+ MBs), and then all of a sudden speeds get reduced to 0 bps. I'm not sure why. Everything used to run just find with this config, and I'm not sure what changed

Run the command 'rclone version' and share the full output of the command.

Yes. The log shows the next to most recent release, but I am getting the same problems with 1.5.7 and was trying an older version to see if it resolved the issue

Which cloud storage system are you using? (eg Google Drive)

Google Drive, shared drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

C:\Progra~1\rclone\rclone sync e:\TV n8ers:/Multimedia/TV -vv --progress --checkers=10 --fast-list --size-only

The rclone config contents with secrets removed.

[photos]
type = google photos
token = {"access_token":"REMOVED","expiry":"2022-01-18T15:23:06.6689836-07:00"}
read_only = true

[n8ers]
type = drive
client_id = REMOVED
client_secret = REMOVE
scope = drive
token = {"access_token":"REMOVED","token_type":"Bearer","refresh_token":"REMOVED","expiry":"2022-01-20T21:03:56.0060293-07:00"}
team_drive = REMOVED
root_folder_id = 


A log from the command with the -vv flag


C:\Scripts>C:\Progra~1\rclone\rclone sync e:\TV n8ers:/Multimedia/TV -vv --size-only
2022/01/20 20:14:18 DEBUG : rclone: Version "v1.56.2" starting with parameters ["C:\\Progra~1\\rclone\\rclone" "sync" "e:\\TV" "n8ers:/Multimedia/TV" "-vv" "--size-only"]
2022/01/20 20:14:18 DEBUG : Creating backend with remote "e:\\TV"
2022/01/20 20:14:18 DEBUG : Using config file from "C:\\Users\\n8chavez\\.config\\rclone\\rclone.conf"
2022/01/20 20:14:18 DEBUG : fs cache: renaming cache item "e:\\TV" to be canonical "//?/e:/TV"
2022/01/20 20:14:18 DEBUG : Creating backend with remote "n8ers:/Multimedia/TV"
2022/01/20 20:14:19 DEBUG : fs cache: renaming cache item "n8ers:/Multimedia/TV" to be canonical "n8ers:Multimedia/TV"
2022/01/20 20:14:19 DEBUG : Desktop.ini: Sizes identical
2022/01/20 20:14:19 DEBUG : Desktop.ini: Unchanged skipping
2022/01/20 20:14:22 DEBUG : Arrested Development/S01E02 - Top Banana.avi: Sending chunk 0 length 8388608
2022/01/20 20:14:22 DEBUG : Arrested Development/S01E01 - Pilot.avi: Sending chunk 0 length 8388608
2022/01/20 20:14:22 DEBUG : Arrested Development/S01E02 - Top Banana_avi_JRSidecar.xml: md5 = d9afdc681b6b9a9c2017b142567a7dc2 OK
2022/01/20 20:14:22 INFO  : Arrested Development/S01E02 - Top Banana_avi_JRSidecar.xml: Copied (new)
2022/01/20 20:14:23 DEBUG : Arrested Development/S01E01 - Pilot_avi_JRSidecar.xml: md5 = 04ed19ff1928e06fc673a56ea001bb6b OK
2022/01/20 20:14:23 INFO  : Arrested Development/S01E01 - Pilot_avi_JRSidecar.xml: Copied (new)
2022/01/20 20:14:24 DEBUG : Arrested Development/S01E03 - Bringing Up Buster.avi: Sending chunk 0 length 8388608
2022/01/20 20:14:24 DEBUG : Arrested Development/S01E03 - Bringing Up Buster_avi_JRSidecar.xml: md5 = 879afc0de00bd07d70a6647892eae2df OK
2022/01/20 20:14:24 INFO  : Arrested Development/S01E03 - Bringing Up Buster_avi_JRSidecar.xml: Copied (new)
2022/01/20 20:14:26 DEBUG : Arrested Development/S01E04 - Key Decisions.avi: Sending chunk 0 length 8388608
2022/01/20 20:15:19 INFO  :
Transferred:       32.005Mi / 575.595 GiByte, 0%, 127.465 KiByte/s, ETA 7w5d19h13m5s
Checks:                 1 / 1, 100%
Transferred:            3 / 10015, 0%
Elapsed time:       1m1.0s
Transferring:
 *       Arrested Development/S01E01 - Pilot.avi:  7% /102.561Mi, 36.127Ki/s, 44m40s
 *  Arrested Development/S01E02 - Top Banana.avi: 10% /79.254Mi, 35.955Ki/s, 33m49s
 * Arrested Development/S…Bringing Up Buster.avi: 10% /79.601Mi, 41.056Ki/s, 29m45s
 * Arrested Development/S…04 - Key Decisions.avi: 10% /77.879Mi, 46.427Ki/s, 25m41s

2022/01/20 20:16:19 INFO  :
Transferred:       32.005Mi / 575.595 GiByte, 0%, 2.652 KiByte/s, ETA 7y11w1d8h35m48s
Checks:                 1 / 1, 100%
Transferred:            3 / 10015, 0%
Elapsed time:       2m1.0s
Transferring:
 *       Arrested Development/S01E01 - Pilot.avi:  7% /102.561Mi, 769/s, 35h46m34s
 *  Arrested Development/S01E02 - Top Banana.avi: 10% /79.254Mi, 766/s, 27h5m14s
 * Arrested Development/S…Bringing Up Buster.avi: 10% /79.601Mi, 874/s, 23h50m15s
 * Arrested Development/S…04 - Key Decisions.avi: 10% /77.879Mi, 989/s, 20h34m22s

2022/01/20 20:17:19 INFO  :
Transferred:       32.005Mi / 575.595 GiByte, 0%, 56 Byte/s, ETA -238y13w1d8h56m38s709ms
Checks:                 1 / 1, 100%
Transferred:            3 / 10015, 0%
Elapsed time:       3m1.0s
Transferring:
 *       Arrested Development/S01E01 - Pilot.avi:  7% /102.561Mi, 16/s, 1719h10m22s
 *  Arrested Development/S01E02 - Top Banana.avi: 10% /79.254Mi, 15/s, 1301h38m37s
 * Arrested Development/S…Bringing Up Buster.avi: 10% /79.601Mi, 18/s, 1145h28m27s
 * Arrested Development/S…04 - Key Decisions.avi: 10% /77.879Mi, 20/s, 988h36m2s

2022/01/20 20:18:19 INFO  :
Transferred:       32.005Mi / 575.595 GiByte, 0%, 1 Byte/s, ETA 281y9w5d4h53m21s132ms
Checks:                 1 / 1, 100%
Transferred:            3 / 10015, 0%
Elapsed time:       4m1.0s
Transferring:
 *       Arrested Development/S01E01 - Pilot.avi:  7% /102.561Mi, 0/s, 82611h58m3s
 *  Arrested Development/S01E02 - Top Banana.avi: 10% /79.254Mi, 0/s, 62548h18m18s
 * Arrested Development/S…Bringing Up Buster.avi: 10% /79.601Mi, 0/s, 55043h50m52s
 * Arrested Development/S…04 - Key Decisions.avi: 10% /77.879Mi, 0/s, 47505h32m59s

2022/01/20 20:19:19 INFO  :
Transferred:       32.005Mi / 575.595 GiByte, 0%, 0 Byte/s, ETA -238y14w15h4m36s376ms
Checks:                 1 / 1, 100%
Transferred:            3 / 10015, 0%
Elapsed time:       5m1.0s
Transferring:
 *       Arrested Development/S01E01 - Pilot.avi:  7% /102.561Mi, 0/s, 0s
 *  Arrested Development/S01E02 - Top Banana.avi: 10% /79.254Mi, 0/s, 0s
 * Arrested Development/S…Bringing Up Buster.avi: 10% /79.601Mi, 0/s, 0s
 * Arrested Development/S…04 - Key Decisions.avi: 10% /77.879Mi, 0/s, 2282799h28m32s

2022/01/20 20:19:22 DEBUG : pacer: low level retry 1/10 (error Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ADPycdtz4NlDjf4fxpvTNUprcjNTnSHeY9JlVegJy2Vfhe3XEt4PykvYfH4qNzc0-2pawuRPbh3GlYI-L8D7kqpaKwpK3-2opQ": net/http: timeout awaiting response headers)
2022/01/20 20:19:22 DEBUG : pacer: Rate limited, increasing sleep to 1.607943172s
2022/01/20 20:19:22 DEBUG : Arrested Development/S01E02 - Top Banana.avi: Sending chunk 0 length 8388608
2022/01/20 20:19:22 DEBUG : pacer: low level retry 1/10 (error Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ADPycduBRfhp-AR7qoF1LxxVQFeDO-Rs78meWPBl3UMTBdo28N9v77kjxVaqyMBKVqdjT1KF0z9Z64wbZBidvxtP3A": net/http: timeout awaiting response headers)
2022/01/20 20:19:22 DEBUG : pacer: Rate limited, increasing sleep to 2.554484724s
2022/01/20 20:19:24 DEBUG : Arrested Development/S01E01 - Pilot.avi: Sending chunk 0 length 8388608
2022/01/20 20:19:24 DEBUG : pacer: low level retry 1/10 (error Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ADPycdvfyNGy5nYAU_iH06GVUZjz8wsP8863DN_4WEIS4Msh1eZrdlmGeYiApTCqeFdQB2DsWWu22Z6umv-luIgR1jpG56qlOQ": net/http: timeout awaiting response headers)
2022/01/20 20:19:24 DEBUG : pacer: Rate limited, increasing sleep to 4.905324065s
2022/01/20 20:19:26 DEBUG : pacer: low level retry 1/10 (error Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ADPycdtB-wIRCi-_QqvsYhKtUcFutiKnJWiQETa-2A_1ehhbL1wQb0PG8wovnm4RpnF7iOUIIVPvxd9eJY8bO-XGoVUIxivdeQ": net/http: timeout awaiting response headers)
2022/01/20 20:19:26 DEBUG : pacer: Rate limited, increasing sleep to 8.737707364s
2022/01/20 20:19:26 DEBUG : Arrested Development/S01E03 - Bringing Up Buster.avi: Sending chunk 0 length 8388608
2022/01/20 20:19:35 DEBUG : Arrested Development/S01E04 - Key Decisions.avi: Sending chunk 0 length 8388608
2022/01/20 20:20:19 INFO  :
Transferred:       32.005Mi / 575.595 GiByte, 0%, 0 Byte/s, ETA 247y44w4d2m24s337ms
Checks:                 1 / 1, 100%
Transferred:            3 / 10015, 0%
Elapsed time:       6m1.0s
Transferring:
 *       Arrested Development/S01E01 - Pilot.avi:  7% /102.561Mi, 0/s, 1169554h49m25.746590208s
 *  Arrested Development/S01E02 - Top Banana.avi: 10% /79.254Mi, 0/s, 956975h24m33.132554752s
 * Arrested Development/S…Bringing Up Buster.avi: 10% /79.601Mi, 0/s, 0s
 * Arrested Development/S…04 - Key Decisions.avi: 10% /77.879Mi, 0/s, 2090091h2m58.099416064s

2022/01/20 20:21:19 INFO  :
Transferred:       32.005Mi / 575.595 GiByte, 0%, 0 Byte/s, ETA 46y19w5d16h18m58s634ms
Checks:                 1 / 1, 100%
Transferred:            3 / 10015, 0%
Elapsed time:       7m1.0s
Transferring:
 *       Arrested Development/S01E01 - Pilot.avi:  7% /102.561Mi, 0/s, 0s
 *  Arrested Development/S01E02 - Top Banana.avi: 10% /79.254Mi, 0/s, 2395240h51m6.267111936s
 * Arrested Development/S…Bringing Up Buster.avi: 10% /79.601Mi, 0/s, 0s
 * Arrested Development/S…04 - Key Decisions.avi: 10% /77.879Mi, 0/s, 0s

2022/01/20 20:22:19 INFO  :
Transferred:       32.005Mi / 575.595 GiByte, 0%, 0 Byte/s, ETA 196y8w4d20h44m11s60ms
Checks:                 1 / 1, 100%
Transferred:            3 / 10015, 0%
Elapsed time:       8m1.0s
Transferring:
 *       Arrested Development/S01E01 - Pilot.avi:  7% /102.561Mi, 0/s, 0s
 *  Arrested Development/S01E02 - Top Banana.avi: 10% /79.254Mi, 0/s, 0s
 * Arrested Development/S…Bringing Up Buster.avi: 10% /79.601Mi, 0/s, 0s
 * Arrested Development/S…04 - Key Decisions.avi: 10% /77.879Mi, 0/s, 2229532h37m10.734966272s

2022/01/20 20:22:56 DEBUG : pacer: low level retry 2/10 (error Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ADPycdtB-wIRCi-_QqvsYhKtUcFutiKnJWiQETa-2A_1ehhbL1wQb0PG8wovnm4RpnF7iOUIIVPvxd9eJY8bO-XGoVUIxivdeQ": read tcp 172.20.182.3:33863->142.250.68.42:443: wsarecv: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.)
2022/01/20 20:22:56 DEBUG : pacer: Rate limited, increasing sleep to 16.808336808s
2022/01/20 20:22:56 DEBUG : Arrested Development/S01E04 - Key Decisions.avi: Sending chunk 0 length 8388608
2022/01/20 20:23:19 INFO  :
Transferred:       32.005Mi / 575.595 GiByte, 0%, 0 Byte/s, ETA 0s
Checks:                 1 / 1, 100%
Transferred:            3 / 10015, 0%
Elapsed time:       9m1.0s
Transferring:
 *       Arrested Development/S01E01 - Pilot.avi:  7% /102.561Mi, 0/s, 1697226h18m20.001394688s
 *  Arrested Development/S01E02 - Top Banana.avi: 10% /79.254Mi, 0/s, 1233891h28m59.07924992s
 * Arrested Development/S…Bringing Up Buster.avi: 10% /79.601Mi, 0/s, 0s
 * Arrested Development/S…04 - Key Decisions.avi: 10% /77.879Mi, 0/s, 0s

2022/01/20 20:24:19 INFO  :
Transferred:       32.005Mi / 575.595 GiByte, 0%, 0 Byte/s, ETA 0s
Checks:                 1 / 1, 100%
Transferred:            3 / 10015, 0%
Elapsed time:      10m1.0s
Transferring:
 *       Arrested Development/S01E01 - Pilot.avi:  7% /102.561Mi, 0/s, 0s
 *  Arrested Development/S01E02 - Top Banana.avi: 10% /79.254Mi, 0/s, 0s
 * Arrested Development/S…Bringing Up Buster.avi: 10% /79.601Mi, 0/s, 0s
 * Arrested Development/S…04 - Key Decisions.avi: 10% /77.879Mi, 0/s, 995803h17m29.85612288s

2022/01/20 20:24:22 DEBUG : pacer: low level retry 2/10 (error Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ADPycdtz4NlDjf4fxpvTNUprcjNTnSHeY9JlVegJy2Vfhe3XEt4PykvYfH4qNzc0-2pawuRPbh3GlYI-L8D7kqpaKwpK3-2opQ": net/http: timeout awaiting response headers)
2022/01/20 20:24:22 DEBUG : pacer: Rate limited, increasing sleep to 16.745592537s
2022/01/20 20:24:22 DEBUG : Arrested Development/S01E02 - Top Banana.avi: Sending chunk 0 length 8388608
2022/01/20 20:24:24 DEBUG : pacer: low level retry 2/10 (error Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ADPycduBRfhp-AR7qoF1LxxVQFeDO-Rs78meWPBl3UMTBdo28N9v77kjxVaqyMBKVqdjT1KF0z9Z64wbZBidvxtP3A": net/http: timeout awaiting response headers)
2022/01/20 20:24:24 DEBUG : pacer: Rate limited, increasing sleep to 16.706470899s
2022/01/20 20:24:26 DEBUG : pacer: low level retry 2/10 (error Post "https://www.googleapis.com/upload/drive/v3/files?alt=json&fields=id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks&supportsAllDrives=true&uploadType=resumable&upload_id=ADPycdvfyNGy5nYAU_iH06GVUZjz8wsP8863DN_4WEIS4Msh1eZrdlmGeYiApTCqeFdQB2DsWWu22Z6umv-luIgR1jpG56qlOQ": net/http: timeout awaiting response headers)
2022/01/20 20:24:26 DEBUG : pacer: Rate limited, increasing sleep to 16.706395386s
2022/01/20 20:24:39 DEBUG : Arrested Development/S01E01 - Pilot.avi: Sending chunk 0 length 8388608
2022/01/20 20:24:55 DEBUG : Arrested Development/S01E03 - Bringing Up Buster.avi: Sending chunk 0 length 8388608

I've tried everything I know how to do and cannot get this to run properly. Thank you for the help.

Those are all network related errors.

That's not the output of rclone version. We ask for the version as it gives you the OS output and such.

You should check all your networking gear/restart/reboot it/check OS on your machine running it for firewalls/AV/etc.

Sorry. I forgot to put that log section in.


C:\Program Files\rclone>rclone version
rclone v1.56.2
- os/version: Microsoft Windows 10 Pro 2009 (64 bit)
- os/kernel: 10.0.22000.438 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.16.8
- go/linking: dynamic
- go/tags: cmount

Although, I just now noticed something. Rclone thinks I'm running Windows 10 x64. I am not. I'm running Windows 11 x64. Could that matter?

Nah. There would be an update needed to match the new version number as it’s basically the same as Windows 10.

As far as anything that could be blocking my connection, there's nothing 3rd party on my system. I don't use any anti-malware product, other than Windows security, and I don't have any firewall enabled, or any hosts file entries.

I solved the issue. It was nothing to do with rclone. With that in mind, could you please close this thread? Thank you.

What did you do to solve it?

that is not a problem.
i also run win11 and get the same output.

Could one of you share the complete output of rclone version on Windows 11?

OP did a few lines up as well:

C:\Users\earlt\iCloudDrive\Windows\Downloads\rclone-v1.57.0-windows-amd64\rclone-v1.57.0-windows-amd64>rclone version
rclone v1.57.0
- os/version: Microsoft Windows 10 Pro 2009 (64 bit)
- os/kernel: 10.0.22000.438 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.17.2
- go/linking: dynamic
- go/tags: cmount
rclone version
rclone v1.57.0
- os/version: Microsoft Windows 10 Pro 2009 (64 bit)
- os/kernel: 10.0.22000.434 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.17.2
- go/linking: dynamic
- go/tags: cmount

output of winver command
image

output of ver command

ver

Microsoft Windows [Version 10.0.22000.434]

Oh yes, sorry. Thanks.

Seems it comes from third party package github.com/shirou/gopsutil, and the fact that:

While ProductName remains "Windows 10", versions with Build no. >= 22000
are Windows 11.

The version in current master (v3.21.10) should include a fix, but perhaps it was upgraded after latest release, if so it should be correct in beta..?

Edit: Yes, rclone 1.57 used version v3.21.8 of the package, which is before the win11 fix.

that is correct

C:\data\rclone\scripts>d:\data\rclone\exe\windows\rclone-beta-latest-windows-amd64\rclone.exe version
rclone v1.58.0-beta.5948.c504d9701
- os/version: Microsoft Windows 11 Pro 2009 (64 bit)
- os/kernel: 10.0.22000.434 (x86_64)
- os/type: windows
- os/arch: amd64
- go/version: go1.17.6
- go/linking: dynamic
- go/tags: cmount

The 2009 part there is wrong, I think, should be 21H2. That piece is something rclone reads from registry, and google(*) says Microsoft (but unconfirmed) changed where they store this information from ReleaseID to DisplayInformation.

Can you confirm? E.g. from PowerShell:

Get-ItemProperty "HKLM:\SOFTWARE\Microsoft\Windows NT\CurrentVersion" | Select-Object ReleaseID, DisplayVersion

(*) and this, which should be quite reliable: https://ss64.com/nt/ver.html

great website, i have referenced it for many years.
and up above, i did provide the output for ver

 Get-ItemProperty "HKLM:\SOFTWARE\Microsoft\Windows NT\CurrentVersion" | Select-Object ReleaseID, DisplayVersion

ReleaseId DisplayVersion
--------- --------------
2009      21H2

It turns out my VPN was the block it for some reason, despite it being excluded via spit tunnel and even turned off. I'm not sure why/how, but once I uninstalled it everything ran fine.

1 Like

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.