Folder Enumeration issue with Gdrive

Help and Support
1

What is the problem you are having with rclone?

When I try to enumare the folder mounted with rclone, I'm unable to do that with a lot of error in logs.
This problem was started autonomusly some days ago without any change from my side.

Run the command 'rclone version' and share the full output of the command.

rclone v1.62.2

  • os/version: ubuntu 22.04 (64 bit)
  • os/kernel: 5.15.0-70-generic (x86_64)
  • os/type: linux
  • os/arch: amd64
  • go/version: go1.20.2
  • go/linking: static
  • go/tags: none
2023/04/23 09:55:07 DEBUG : serie_tv/: ReadDirAll: 
2023/04/23 09:55:16 DEBUG : pacer: low level retry 1/10 (error Get "https://www.googleapis.com/drive/v3/files?alt=json&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%2CresourceKey%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=true&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%2713vxkM9cxydAOCjXv5jPfbO6720dP48x4%27+in+parents%29&supportsAllDrives=true": net/http: timeout awaiting response headers)
2023/04/23 09:55:16 DEBUG : pacer: Rate limited, increasing sleep to 1.848059144s
2023/04/23 09:55:17 DEBUG : pacer: low level retry 2/10 (error Get "https://www.googleapis.com/drive/v3/files?alt=json&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%2CresourceKey%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=true&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%2713vxkM9cxydAOCjXv5jPfbO6720dP48x4%27+in+parents%29&supportsAllDrives=true": net/http: timeout awaiting response headers)
2023/04/23 09:55:17 DEBUG : pacer: Rate limited, increasing sleep to 2.281997827s
2023/04/23 09:55:19 DEBUG : pacer: low level retry 3/10 (error Get "https://www.googleapis.com/drive/v3/files?alt=json&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%2CresourceKey%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=true&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%2713vxkM9cxydAOCjXv5jPfbO6720dP48x4%27+in+parents%29&supportsAllDrives=true": read tcp REDACTED:58734->142.250.113.95:443: i/o timeout)
2023/04/23 09:55:19 DEBUG : pacer: Rate limited, increasing sleep to 4.304162792s
2023/04/23 09:55:21 DEBUG : pacer: low level retry 4/10 (error Get "https://www.googleapis.com/drive/v3/files?alt=json&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%2CresourceKey%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=true&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%2713vxkM9cxydAOCjXv5jPfbO6720dP48x4%27+in+parents%29&supportsAllDrives=true": net/http: timeout awaiting response headers)
2023/04/23 09:55:21 DEBUG : pacer: Rate limited, increasing sleep to 8.197893183s
2023/04/23 09:55:25 DEBUG : pacer: low level retry 5/10 (error Get "https://www.googleapis.com/drive/v3/files?alt=json&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%2CresourceKey%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=true&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%2713vxkM9cxydAOCjXv5jPfbO6720dP48x4%27+in+parents%29&supportsAllDrives=true": read tcp REDACTED:56876->142.250.113.95:443: i/o timeout)
2023/04/23 09:55:25 DEBUG : pacer: Rate limited, increasing sleep to 16.884544599s
2023/04/23 09:55:33 DEBUG : pacer: low level retry 6/10 (error Get "https://www.googleapis.com/drive/v3/files?alt=json&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%2CresourceKey%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=true&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%2713vxkM9cxydAOCjXv5jPfbO6720dP48x4%27+in+parents%29&supportsAllDrives=true": net/http: timeout awaiting response headers)
2023/04/23 09:55:33 DEBUG : pacer: Rate limited, increasing sleep to 16.996937214s
2023/04/23 09:55:50 DEBUG : pacer: low level retry 7/10 (error Get "https://www.googleapis.com/drive/v3/files?alt=json&fields=files%28id%2Cname%2Csize%2Cmd5Checksum%2Ctrashed%2CexplicitlyTrashed%2CmodifiedTime%2CcreatedTime%2CmimeType%2Cparents%2CwebViewLink%2CshortcutDetails%2CexportLinks%2CresourceKey%29%2CnextPageToken%2CincompleteSearch&includeItemsFromAllDrives=true&pageSize=1000&prettyPrint=false&q=trashed%3Dfalse+and+%28%2713vxkM9cxydAOCjXv5jPfbO6720dP48x4%27+in+parents%29&supportsAllDrives=true": net/http: timeout awaiting response headers)
2023/04/23 09:55:50 DEBUG : pacer: Rate limited, increasing sleep to 16.634766955s
2023/04/23 09:55:57 DEBUG : Google drive root 'Backups': Checking for changes on remote
2023/04/23 09:56:07 DEBUG : pacer: Reducing sleep to 0s

image

2

That's a networking/firewall/antivirus type issue as you are timing out.

3

Thanks for your reply.

This is so strange is a machine on hetzner used only for sync with gdrive, firewall rules allow all in outbound and there is no antivirus on machine.

I haven't made some change on this machine.

Some small folder can be enumerated only big folder have this issue, after some investigation

FIXED: Editing randomly the rclone config the problem was fixed.

4

This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.