When syncing to Google Photos "album" location, it creates hundreds of albums containing one photo each, instead of an album with all the photos in for each directory as I would expect. Some albums appear to contain the right number of albums, but I now have hundreds of erroneous albums, with no bulk-delete function available.
rclone v1.59.2
- os/version: ubuntu 20.04 (64 bit)
- os/kernel: 5.4.0-137-generic (x86_64)
- os/type: linux
- os/arch: amd64
- go/version: go1.18.6
- go/linking: static
- go/tags: none
Google Photos.
rclone copy /tmp remote:tmp)
rclone sync ~/Backups/Exports photos:album --log-level DEBUG --log-file ~/rclone/photos.txt --tpslimit 1
My Exports directory is structured as follows:
tree | tail -n 100
# ...
├── 2022-10-28 Blahblah
│ ├── DSCF4644.jpeg
│ ├── DSCF4646.jpeg
│ ├── DSCF4650.jpeg
│ ├── DSCF4695.jpeg
│ ├── DSCF4697.jpeg
│ ├── DSCF4727.jpeg
│ ├── DSCF4731.jpeg
│ └── DSCF4738.jpeg
├── 2022-11-03 Blahblah
│ ├── DSCF4782.jpeg
│ ├── DSCF4797.jpeg
│ ├── DSCF4829.jpeg
│ └── DSCF4845.jpeg
├── 2022-11-27 Blahblah
│ ├── DSCF4882.jpeg
│ ├── DSCF4891.jpeg
│ ├── DSCF4893.jpeg
│ ├── DSCF4899.jpeg
│ ├── DSCF4900.jpeg
│ ├── DSCF4903.jpeg
│ ├── DSCF4906.jpeg
│ ├── DSCF4918.jpeg
│ └── DSCF4951.jpeg
So I would expect each single directory to create one single album containing all the photos within that directory.
rclone config show photos
[photos]
type = google photos
token = {"access_token":"xxx","refresh_token":"xxx","expiry":"2023-01-23T23:01:06.189769934Z"}
-vv flag
Logs .
I killed the rsync job here as it had already created 3 new albums (per watch 'rclone lsd photos:album | grep \{ | wc -l'), and there's no easy way to mass-delete albums on Google Photos.
That’s an older version.
Can you update to the latest and retest?
ncw
January 24, 2023, 9:29am
3
Hundreds? That is weird. You can try --transfers 1 to see if that helps.
Can you do a small test and show a -vv log of the problem?
Sure, I'll re-test on the latest version and post a new log below.
Here's it occurring on the latest version with --transfers 1. I'm up to 460 albums in Google Photos now, from a directory containing 60 photo folders
Log from rclone v1.61.1
ncw
January 25, 2023, 11:20am
6
I've found the cause for this.
It is rclone's duplicate directory detection...
You'll see if you do an rclone lsf of the albums directory, you'll albums like this
test_album {ABdUxBg6PNE4kAXDxKVxIZM-_G_rs8xEtPi80_0lvXHQeDGAgTNaU9T6vnw-HIgQJ1nZQ1md2EdQ}/
test_album {ABdUxBgFDDy2wPdnlg51YF7j7OHe5VoX-qI9piCGPhkTEFQ8HK4Iase6F1JJenuoWunTidR_cfs-}/
test_album {ABdUxBhkUi1x9KYuSHya_ajTeTPpNw0UOXrfebtuyjgcFnki-L0SkkHlSoeBvrfuEo22MF5zEQ1B}/
test_album {ABdUxBipkIsxZAafvE-RnYdLLTHUTvZwMJWB2UPDxEReb3R_bDeesZ5BGjL2CUHNx5Ced__O_9Qu}/
test_album {ABdUxBjdNfxqO5kIFiAmkQecQzuTRB-mmWXX66Lgvzmnc43qY3fDniuA2sXVTwaiPWQRZcoEUhWC}/
The {XXX} are to disambiguate identical names.
However there is no test_album as rclone lsf will show you.
So if you upload to test_album rclone will create a new suffixed album.
So I think if you had no duplicate folders everything would work just fine.
I don't know how the first duplicate folder got in there though.
Rclone's handling of uploads to a potentially duplicated folder could be better! If you upload to test_album it could
give an error saying there are duplicate album names
pick one and upload there
Rather than what it does at the moment
Awesome, thank you @ncw - I can confirm that after deleting every album (yay macros!), and re-running rclone on an "empty" output, there are no duplicates.
As to where the duplicates came from, it looks like I already had some albums by the same names from long ago, so that might have confused rclone
Either way, if anyone has the same issue, deleting the albums with duplicate names does indeed resolve the issue.
Thanks all!
1 Like
system
January 30, 2023, 1:08pm
8
This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.
Logs.
Not sure.