FYI Sep 30 - New Google Drive Shortcuts and Folder Structure

[chrissv (Steven C)]

@ncw

It isn't currently possible to create shortcuts with rclone.

If I only use rclone to write and read a particular Google Drive area, then the issue of shortcuts is moot and has no impact on me, correct?

In my case I am strictly using the GD area for backups via rclone.

Thanks for all the work!

[ncw (Nick Craig-Wood)]

@durval

Just gave this a quick reading. My initial impressions are, (a) what a clusterf*ck coming from Google, and (b) kudos to @ncw for trying to fix and accommodate it all the best possible way.

Ha! I think the original multiple parents idea was the bad one - that can easily cause data loss if you are careless. Shortcuts are OK but do add complication.

@durval

Just one question: if I never "Shift-Z" anything on any of my Google drive accounts (which I'm pretty sure I didn't), can I just ignore all of this? Or is there anyway this can come and bite me in the rear when I'm not looking?

I think if you don't have stuff with multiple parents then you'll be fine. Most people don't - the SHIFT-Z is quite obscure.

[ncw (Nick Craig-Wood)]

@green_green

Thank you very much for the beta rclone. It's work very well.

Thanks for testing

@green_green

If one shortcut invalid like this

How did you create that invalid shortcut?

@green_green

ex 1:

gd1:
0418/music
0418/music_old <=invalid
0418/folder1
0418/folder2

rclone gd1:0418/ gd2:
rclone will not work

In what way does rclone not work?

Did rclone produce an ERROR? Can paste the error message?

I tried making some invalid shortcuts by deleting the target. Rclone ignored them in all cases I could find.

[ncw (Nick Craig-Wood)]

@chrissv

If I only use rclone to write and read a particular Google Drive area, then the issue of shortcuts is moot and has no impact on me, correct?

In my case I am strictly using the GD area for backups via rclone.

I think if you didn't create any shortcuts or duplicate folders with SHIFT-Z then you can ignore them completely.

[Edward_Barker (Edward)]

Yes - well done for not getting tempted into trying shift-Z.

[durval (Durval Menezes)]

Thanks @ncw and @Edward_Barker -- I can now rest easy

[green_green]

use A and B account. B share the folder by using:
On - Anyone with the link: Anyone who has the link can use your file, without signing in to their Google Account.

A add the shortcut and then B cancel the permission.
It will be a invalid shortcut.

If path have a invalid shortcut
the log will like this.

2020-04-20 12:31:48 ERROR : shirt_z: error reading source directory: list: faile
d to resolve shortcut: googleapi: Error 404: File not found: 177eLis9xJ5y_eQkjzs
9poV2qZGci_GHf., notFound
2020-04-20 12:31:48 DEBUG : Google drive root 'test/test_2': Waiting for checks
to finish
2020-04-20 12:31:48 DEBUG : Google drive root 'test/test_2': Waiting for transfe
rs to finish
2020-04-20 12:31:48 INFO : There was nothing to transfer
2020-04-20 12:31:48 ERROR : Attempt 1/3 failed with 1 errors and: list: failed t
o resolve shortcut: googleapi: Error 404: File not found: 177eLis9xJ5y_eQkjzs9po
V2qZGci_GHf., notFound
2020-04-20 12:31:52 ERROR : shirt_z: error reading source directory: list: faile
d to resolve shortcut: googleapi: Error 404: File not found: 177eLis9xJ5y_eQkjzs
9poV2qZGci_GHf., notFound
2020-04-20 12:31:52 DEBUG : Google drive root 'test/test_2': Waiting for checks
to finish
2020-04-20 12:31:52 DEBUG : Google drive root 'test/test_2': Waiting for transfe
rs to finish
2020-04-20 12:31:52 INFO : There was nothing to transfer
2020-04-20 12:31:52 ERROR : Attempt 2/3 failed with 1 errors and: list: failed t
o resolve shortcut: googleapi: Error 404: File not found: 177eLis9xJ5y_eQkjzs9po
V2qZGci_GHf., notFound
2020-04-20 12:31:53 ERROR : shirt_z: error reading source directory: list: faile
d to resolve shortcut: googleapi: Error 404: File not found: 177eLis9xJ5y_eQkjzs
9poV2qZGci_GHf., notFound
2020-04-20 12:31:53 DEBUG : Google drive root 'test/test_2': Waiting for checks
to finish
2020-04-20 12:31:53 DEBUG : Google drive root 'test/test_2': Waiting for transfe
rs to finish
2020-04-20 12:31:53 INFO : There was nothing to transfer
2020-04-20 12:31:53 ERROR : Attempt 3/3 failed with 1 errors and: list: failed t
o resolve shortcut: googleapi: Error 404: File not found: 177eLis9xJ5y_eQkjzs9po
V2qZGci_GHf., notFound
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 1 (retrying may help)
Elapsed time: 0.0s
2020/04/20 12:31:53 INFO :
Transferred: 0 / 0 Bytes, -, 0 Bytes/s, ETA -
Errors: 1 (retrying may help)
Elapsed time: 0.0s

2020/04/20 12:31:53 DEBUG : 8 go routines active
2020/04/20 12:31:53 Failed to copy: list: failed to resolve shortcut: googleapi:
Error 404: File not found: 177eLis9xJ5y_eQkjzs9poV2qZGci_GHf., notFound

[Animosity022]

@green_green

A add the shortcut and then B cancel the permission.
It will be a invalid shortcut.

If path have a invalid shortcut
the log will like this.

2020-04-20 12:31:48 ERROR : shirt_z: error reading source directory: list: faile
d to resolve shortcut: googleapi: Error 404: File not found: 177eLis9xJ5y_eQkjzs
9poV2qZGci_GHf., notFound

You get 404s for any shared items in Google Drive when you don't have permissions.

[ncw (Nick Craig-Wood)]

@green_green

2020-04-20 12:31:48 ERROR : shirt_z: error reading source directory: list: faile
d to resolve shortcut: googleapi: Error 404: File not found: 177eLis9xJ5y_eQkjzs
9poV2qZGci_GHf., notFound

Ah ok - thanks.

What does everyone think rclone should do here?

1. Report the error as it is? This is analogous with rsync as in if you have a dangling symlink then rsync will copy everything else and report an error at the end.

2. Skip shortcuts that don't resolve. If you are syncing then having a shortcut disappear for any reason will mean that rclone deletes the copy you have on the destination.

I'm probably in favour of option 1 but would like to see what others think.

[calisro (Rob)]

option 1. If you don't report it, the user might not even know and think its being managed. With 2 you've deleted your copies which may not be expected. That could be bad.

[green_green]

I prefer option 1. it's good.

[Lex]

Adding link here to the issue page and further discussion about Google Drive Shortcuts.
For those who start at the bottom.

Support new Google Drive shortcuts