Rclone lsf with Gdrive long/repeating directory paths

STOP and READ USE THIS TEMPLATE NO EXCEPTIONS - By not using this, you waste your time, our time and really hate puppies. Please remove these two lines and that will confirm you have read them.

What is the problem you are having with rclone?

When running rclone lsf command to output the contents of google drive, I run across some results that show extermely long path names with repeating directory names. I have not found any special characters that could be causing the issue. I'm not sure if its an rclone issue or a true representation of the individuals actual folder structure in GDrive. I am running the rclone lsf command with "--drive-impersonate" in order to audit drives within our organization. See log examples below. Curious if others have had this issue or if you have any ideas about what may be causing it.

Run the command 'rclone version' and share the full output of the command.

PS E:\rclone> ./rclone version
rclone v1.66.0

  • os/version: Microsoft Windows Server 2019 Standard 1809 (64 bit)
  • os/kernel: 10.0.17763.5576 (x86_64)
  • os/type: windows
  • os/arch: amd64
  • go/version: go1.22.1
  • go/linking: static
  • go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

Google Drive

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone.exe lsf --format "tshpi" --absolute --recursive Profile1: --drive-impersonate $email --checkers=16 --drive-pacer-min-sleep=10ms -vvvv --log-file $logfile1\$email.log >$csvoutput\$email.csv
Paste command here

Please run 'rclone config redacted' and share the full output. If you get command not found, please make sure to update rclone.

[Profile1]
type = drive
client_id = XXX
client_secret = XXX
scope = drive
service_account_file = testproject-d5a06e07fda5.json
team_drive =

[Profile2]
type = drive
client_id = XXX
client_secret = XXX
scope = drive
service_account_file = testproject-d5a06e07fda5.json
team_drive =

[Profile3]
type = drive
client_id = XXX
client_secret = XXX
scope = drive
service_account_file = testproject-d5a06e07fda5.json
team_drive =

[Profile4]
type = drive
client_id = XXX
client_secret = XXX
scope = drive
service_account_file = testproject-d5a06e07fda5.json
team_drive =

A log from the command that you were trying to run with the -vv flag

2024/03/29 06:26:51 DEBUG : rclone: Version "v1.66.0" starting with parameters ["E:\\rclone\\rclone.exe" "lsf" "--format" "tshpi" "--absolute" "--recursive" "Profile3:" "--drive-impersonate" "user@somewhere.org" "-vvvv" "--log-file" "Z:\\project\\active\\missing\\log\\user.log"]
2024/03/29 06:26:52 DEBUG : Creating backend with remote "Profile3:"
2024/03/29 06:26:52 DEBUG : Using config file from "C:\\Users\\auser1\\AppData\\Roaming\\rclone\\rclone.conf"
2024/03/29 06:26:52 DEBUG : Profile3: detected overridden config - adding "{F1mgB}" suffix to name
2024/03/29 06:26:52 DEBUG : Google drive root '': 'root_folder_id = 0ALHSnis8IIYtUk9PVA' - save this in the config to speed up startup
2024/03/29 06:26:52 DEBUG : fs cache: renaming cache item "Profile3:" to be canonical "Profile3{F1mgB}:"


Actual output of the command:

2023-03-03 20:32:14;24918784;5078590056dc829f9e3a4c2fd707412f;/LED 2022-2023/3_Archive/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Spring Productions/Friday Concerts/2023_03_03 Teenatown/Photos_Raw/DSC07869.ARW;1XUzlxGlMLv0OrQwC5cbXb3B_qDB2p6wf

welcome to the forum,

not sure this is your issue?
these could easily blow rclone up if you do a list recursive on them!

Interesting! I will take a look

This flag might be helpful if it is a problem with shortcuts

  --drive-skip-shortcuts            If set skip shortcut files

good idea. I did not see that option. I'll give it a try and post results.

1 Like