How to not automatically copy subdirectories to google photos?

gummybear · May 21, 2021, 3:21pm

I am using RClone 1.54.0 on MacOS 10.15.7 to sync photo album directories from my computer to google photos. This is actually working very well, except that it also tries to upload subdirectories.

The command I am using is

rclone copy /path/to/album remote:album/MyAlbumName

This is my config file

[gphotos]
type = google photos
token = {"access_token":"...","token_type":"Bearer","refresh_token":"...","expiry":"2021-05-20T17:44:16.449232-04:00"}

The problem is, if I have any subdirectories inside /path/to/album, they are automatically being uploaded to a google photo album named MyAlbumName/SubDirName. That behavior is well documented at https://rclone.org/googlephotos/, but I'd actually prefer it to ignore subdirectories by default. I can't seem to figure out how prevent rclone copy from automatically recursing through my file system.

I am aware that I could use --exclude, but I'm trying to automate the process and am really just looking for a way to generically ignore the contents of any subdirectories. How do I prevent rclone from trying to copy the contents of subdirectories?

Here is a log file where I am uploading files to an album called "MiddlesexFells", and rclone is creating a second unwanted album called "MiddlesexFells/extras" using pictures from a subdirectory called "extras".

$ rclone --config .rcloneconf copy 2020/0321-March-Fells-Hiking gphotos:album/MiddlesexFells --exclude .DS_Store --exclude album.txt -vv
2021/05/21 11:08:22 DEBUG : rclone: Version "v1.54.0-DEV" starting with parameters ["rclone" "--config" ".rcloneconf" "copy" "2020/0321-March-Fells-Hiking" "gphotos:album/MiddlesexFells" "--exclude" ".DS_Store" "--exclude" "album.txt" "-vv"]
2021/05/21 11:08:22 DEBUG : Creating backend with remote "2020/0321-March-Fells-Hiking"
2021/05/21 11:08:22 DEBUG : Using config file from "/Users/me/Pictures/Albums/.rcloneconf"
2021/05/21 11:08:22 DEBUG : fs cache: renaming cache item "2020/0321-March-Fells-Hiking" to be canonical "/Users/me/Pictures/Albums/2020/0321-March-Fells-Hiking"
2021/05/21 11:08:22 DEBUG : Creating backend with remote "gphotos:album/MiddlesexFells"
2021/05/21 11:08:22 DEBUG : Google Photos path "album/MiddlesexFells": List: dir=""
2021/05/21 11:08:22 DEBUG : .DS_Store: Excluded
2021/05/21 11:08:22 DEBUG : album.txt: Excluded
2021/05/21 11:08:22 DEBUG : gphotos: Loaded invalid token from config file - ignoring
2021/05/21 11:08:22 DEBUG : gphotos: Saved new token in config file
2021/05/21 11:08:29 DEBUG : Google Photos path "album/MiddlesexFells": >List: err=directory not found
2021/05/21 11:08:29 DEBUG : Google Photos path "album/MiddlesexFells": Waiting for checks to finish
2021/05/21 11:08:29 DEBUG : Google Photos path "album/MiddlesexFells": Waiting for transfers to finish
2021/05/21 11:08:29 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06244.jpg
2021/05/21 11:08:29 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06246.jpg
2021/05/21 11:08:29 DEBUG : DSC06246.jpg: Update: src=DSC06246.jpg
2021/05/21 11:08:29 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06247.jpg
2021/05/21 11:08:29 DEBUG : DSC06247.jpg: Update: src=DSC06247.jpg
2021/05/21 11:08:29 DEBUG : DSC06244.jpg: Update: src=DSC06244.jpg
2021/05/21 11:08:29 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06243.jpg
2021/05/21 11:08:29 DEBUG : DSC06243.jpg: Update: src=DSC06243.jpg
2021/05/21 11:08:38 DEBUG : DSC06244.jpg: >Update: err=<nil>
2021/05/21 11:08:38 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:38 DEBUG : DSC06244.jpg: Size:
2021/05/21 11:08:38 DEBUG : DSC06244.jpg: >Size:
2021/05/21 11:08:38 INFO  : DSC06244.jpg: Copied (new)
2021/05/21 11:08:38 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06248.jpg
2021/05/21 11:08:38 DEBUG : DSC06248.jpg: Update: src=DSC06248.jpg
2021/05/21 11:08:39 DEBUG : DSC06243.jpg: >Update: err=<nil>
2021/05/21 11:08:39 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:39 DEBUG : DSC06243.jpg: Size:
2021/05/21 11:08:39 DEBUG : DSC06243.jpg: >Size:
2021/05/21 11:08:39 INFO  : DSC06243.jpg: Copied (new)
2021/05/21 11:08:39 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06249.jpg
2021/05/21 11:08:39 DEBUG : DSC06249.jpg: Update: src=DSC06249.jpg
2021/05/21 11:08:40 DEBUG : DSC06246.jpg: >Update: err=<nil>
2021/05/21 11:08:40 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:40 DEBUG : DSC06246.jpg: Size:
2021/05/21 11:08:40 DEBUG : DSC06246.jpg: >Size:
2021/05/21 11:08:40 INFO  : DSC06246.jpg: Copied (new)
2021/05/21 11:08:40 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06250.jpg
2021/05/21 11:08:40 DEBUG : DSC06250.jpg: Update: src=DSC06250.jpg
2021/05/21 11:08:41 DEBUG : DSC06247.jpg: >Update: err=<nil>
2021/05/21 11:08:41 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:41 DEBUG : DSC06247.jpg: Size:
2021/05/21 11:08:41 DEBUG : DSC06247.jpg: >Size:
2021/05/21 11:08:41 INFO  : DSC06247.jpg: Copied (new)
2021/05/21 11:08:41 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06253.jpg
2021/05/21 11:08:41 DEBUG : DSC06253.jpg: Update: src=DSC06253.jpg
2021/05/21 11:08:42 DEBUG : DSC06249.jpg: >Update: err=<nil>
2021/05/21 11:08:42 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:42 DEBUG : DSC06249.jpg: Size:
2021/05/21 11:08:42 DEBUG : DSC06249.jpg: >Size:
2021/05/21 11:08:42 INFO  : DSC06249.jpg: Copied (new)
2021/05/21 11:08:42 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06255.jpg
2021/05/21 11:08:42 DEBUG : DSC06255.jpg: Update: src=DSC06255.jpg
2021/05/21 11:08:43 DEBUG : DSC06248.jpg: >Update: err=<nil>
2021/05/21 11:08:43 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:43 DEBUG : DSC06248.jpg: Size:
2021/05/21 11:08:43 DEBUG : DSC06248.jpg: >Size:
2021/05/21 11:08:43 INFO  : DSC06248.jpg: Copied (new)
2021/05/21 11:08:43 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06256.jpg
2021/05/21 11:08:43 DEBUG : DSC06256.jpg: Update: src=DSC06256.jpg
2021/05/21 11:08:44 DEBUG : DSC06253.jpg: >Update: err=<nil>
2021/05/21 11:08:44 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:44 DEBUG : DSC06253.jpg: Size:
2021/05/21 11:08:44 DEBUG : DSC06253.jpg: >Size:
2021/05/21 11:08:44 INFO  : DSC06253.jpg: Copied (new)
...
2021/05/21 11:08:46 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:46 DEBUG : DSC06255.jpg: Size:
2021/05/21 11:08:46 DEBUG : DSC06255.jpg: >Size:
2021/05/21 11:08:46 INFO  : DSC06255.jpg: Copied (new)
2021/05/21 11:08:46 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06262.jpg
2021/05/21 11:08:46 DEBUG : DSC06262.jpg: Update: src=DSC06262.jpg
2021/05/21 11:08:47 DEBUG : DSC06256.jpg: >Update: err=<nil>
2021/05/21 11:08:47 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:47 DEBUG : DSC06256.jpg: Size:
2021/05/21 11:08:47 DEBUG : DSC06256.jpg: >Size:
2021/05/21 11:08:47 INFO  : DSC06256.jpg: Copied (new)
2021/05/21 11:08:47 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06264.jpg
2021/05/21 11:08:47 DEBUG : DSC06264.jpg: Update: src=DSC06264.jpg
2021/05/21 11:08:48 DEBUG : DSC06258.jpg: >Update: err=<nil>
2021/05/21 11:08:48 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:48 DEBUG : DSC06258.jpg: Size:
2021/05/21 11:08:48 DEBUG : DSC06258.jpg: >Size:
2021/05/21 11:08:48 INFO  : DSC06258.jpg: Copied (new)
2021/05/21 11:08:48 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06265.jpg
2021/05/21 11:08:48 DEBUG : DSC06265.jpg: Update: src=DSC06265.jpg
2021/05/21 11:08:49 DEBUG : DSC06260.jpg: >Update: err=<nil>
2021/05/21 11:08:49 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:49 DEBUG : DSC06260.jpg: Size:
2021/05/21 11:08:49 DEBUG : DSC06260.jpg: >Size:
2021/05/21 11:08:49 INFO  : DSC06260.jpg: Copied (new)
2021/05/21 11:08:49 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06266.jpg
2021/05/21 11:08:49 DEBUG : DSC06266.jpg: Update: src=DSC06266.jpg
2021/05/21 11:08:50 DEBUG : DSC06262.jpg: >Update: err=<nil>
2021/05/21 11:08:50 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:50 DEBUG : DSC06262.jpg: Size:
2021/05/21 11:08:50 DEBUG : DSC06262.jpg: >Size:
2021/05/21 11:08:50 INFO  : DSC06262.jpg: Copied (new)
2021/05/21 11:08:50 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06267.jpg
2021/05/21 11:08:50 DEBUG : DSC06267.jpg: Update: src=DSC06267.jpg
2021/05/21 11:08:51 DEBUG : DSC06264.jpg: >Update: err=<nil>
2021/05/21 11:08:51 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:51 DEBUG : DSC06264.jpg: Size:
2021/05/21 11:08:51 DEBUG : DSC06264.jpg: >Size:
2021/05/21 11:08:51 INFO  : DSC06264.jpg: Copied (new)
2021/05/21 11:08:51 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06268.jpg
2021/05/21 11:08:51 DEBUG : DSC06268.jpg: Update: src=DSC06268.jpg
2021/05/21 11:08:52 DEBUG : DSC06265.jpg: >Update: err=<nil>
2021/05/21 11:08:52 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:52 DEBUG : DSC06265.jpg: Size:
2021/05/21 11:08:52 DEBUG : DSC06265.jpg: >Size:
2021/05/21 11:08:52 INFO  : DSC06265.jpg: Copied (new)
2021/05/21 11:08:52 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06269.jpg
2021/05/21 11:08:52 DEBUG : DSC06269.jpg: Update: src=DSC06269.jpg
2021/05/21 11:08:53 DEBUG : DSC06266.jpg: >Update: err=<nil>
2021/05/21 11:08:53 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:53 DEBUG : DSC06266.jpg: Size:
2021/05/21 11:08:53 DEBUG : DSC06266.jpg: >Size:
2021/05/21 11:08:53 INFO  : DSC06266.jpg: Copied (new)
2021/05/21 11:08:53 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06271.jpg
2021/05/21 11:08:53 DEBUG : DSC06271.jpg: Update: src=DSC06271.jpg
2021/05/21 11:08:54 DEBUG : DSC06267.jpg: >Update: err=<nil>
2021/05/21 11:08:54 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:54 DEBUG : DSC06267.jpg: Size:
2021/05/21 11:08:54 DEBUG : DSC06267.jpg: >Size:
2021/05/21 11:08:54 INFO  : DSC06267.jpg: Copied (new)
2021/05/21 11:08:54 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06272.jpg
2021/05/21 11:08:54 DEBUG : DSC06272.jpg: Update: src=DSC06272.jpg
2021/05/21 11:08:55 DEBUG : DSC06268.jpg: >Update: err=<nil>
2021/05/21 11:08:55 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:55 DEBUG : DSC06268.jpg: Size:
2021/05/21 11:08:55 DEBUG : DSC06268.jpg: >Size:
2021/05/21 11:08:55 INFO  : DSC06268.jpg: Copied (new)
2021/05/21 11:08:55 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06273.jpg
2021/05/21 11:08:55 DEBUG : DSC06273.jpg: Update: src=DSC06273.jpg
2021/05/21 11:08:56 DEBUG : DSC06271.jpg: >Update: err=<nil>
2021/05/21 11:08:56 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:56 DEBUG : DSC06271.jpg: Size:
2021/05/21 11:08:56 DEBUG : DSC06271.jpg: >Size:
2021/05/21 11:08:56 INFO  : DSC06271.jpg: Copied (new)
2021/05/21 11:08:56 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06274.jpg
2021/05/21 11:08:56 DEBUG : DSC06274.jpg: Update: src=DSC06274.jpg
2021/05/21 11:08:57 DEBUG : DSC06269.jpg: >Update: err=<nil>
2021/05/21 11:08:57 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:57 DEBUG : DSC06269.jpg: Size:
2021/05/21 11:08:57 DEBUG : DSC06269.jpg: >Size:
2021/05/21 11:08:57 INFO  : DSC06269.jpg: Copied (new)
2021/05/21 11:08:57 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06276.jpg
2021/05/21 11:08:57 DEBUG : DSC06276.jpg: Update: src=DSC06276.jpg
2021/05/21 11:08:58 DEBUG : DSC06272.jpg: >Update: err=<nil>
2021/05/21 11:08:58 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:58 DEBUG : DSC06272.jpg: Size:
2021/05/21 11:08:58 DEBUG : DSC06272.jpg: >Size:
2021/05/21 11:08:58 INFO  : DSC06272.jpg: Copied (new)
2021/05/21 11:08:58 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06279.jpg
2021/05/21 11:08:58 DEBUG : DSC06279.jpg: Update: src=DSC06279.jpg
2021/05/21 11:08:59 DEBUG : DSC06273.jpg: >Update: err=<nil>
2021/05/21 11:08:59 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:08:59 DEBUG : DSC06273.jpg: Size:
2021/05/21 11:08:59 DEBUG : DSC06273.jpg: >Size:
2021/05/21 11:08:59 INFO  : DSC06273.jpg: Copied (new)
2021/05/21 11:08:59 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06280.jpg
2021/05/21 11:08:59 DEBUG : DSC06280.jpg: Update: src=DSC06280.jpg
2021/05/21 11:09:00 DEBUG : DSC06276.jpg: >Update: err=<nil>
2021/05/21 11:09:00 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:09:00 DEBUG : DSC06276.jpg: Size:
2021/05/21 11:09:00 DEBUG : DSC06276.jpg: >Size:
2021/05/21 11:09:00 INFO  : DSC06276.jpg: Copied (new)
2021/05/21 11:09:00 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06289-Pano.jpg
2021/05/21 11:09:00 DEBUG : DSC06289-Pano.jpg: Update: src=DSC06289-Pano.jpg
2021/05/21 11:09:01 DEBUG : DSC06274.jpg: >Update: err=<nil>
2021/05/21 11:09:01 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:09:01 DEBUG : DSC06274.jpg: Size:
2021/05/21 11:09:01 DEBUG : DSC06274.jpg: >Size:
2021/05/21 11:09:01 INFO  : DSC06274.jpg: Copied (new)
2021/05/21 11:09:01 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06300.jpg
2021/05/21 11:09:01 DEBUG : DSC06300.jpg: Update: src=DSC06300.jpg
2021/05/21 11:09:02 DEBUG : DSC06279.jpg: >Update: err=<nil>
2021/05/21 11:09:02 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:09:02 DEBUG : DSC06279.jpg: Size:
2021/05/21 11:09:02 DEBUG : DSC06279.jpg: >Size:
2021/05/21 11:09:02 INFO  : DSC06279.jpg: Copied (new)
2021/05/21 11:09:02 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06301.jpg
2021/05/21 11:09:02 DEBUG : DSC06301.jpg: Update: src=DSC06301.jpg
2021/05/21 11:09:03 DEBUG : DSC06280.jpg: >Update: err=<nil>
2021/05/21 11:09:03 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:09:03 DEBUG : DSC06280.jpg: Size:
2021/05/21 11:09:03 DEBUG : DSC06280.jpg: >Size:
2021/05/21 11:09:03 INFO  : DSC06280.jpg: Copied (new)
2021/05/21 11:09:03 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06302.jpg
2021/05/21 11:09:03 DEBUG : DSC06302.jpg: Update: src=DSC06302.jpg
2021/05/21 11:09:04 DEBUG : DSC06300.jpg: >Update: err=<nil>
2021/05/21 11:09:04 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:09:04 DEBUG : DSC06300.jpg: Size:
2021/05/21 11:09:04 DEBUG : DSC06300.jpg: >Size:
2021/05/21 11:09:04 INFO  : DSC06300.jpg: Copied (new)
2021/05/21 11:09:04 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06308.jpg
2021/05/21 11:09:04 DEBUG : DSC06308.jpg: Update: src=DSC06308.jpg
2021/05/21 11:09:05 DEBUG : DSC06289-Pano.jpg: >Update: err=<nil>
2021/05/21 11:09:05 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:09:05 DEBUG : DSC06289-Pano.jpg: Size:
2021/05/21 11:09:05 DEBUG : DSC06289-Pano.jpg: >Size:
2021/05/21 11:09:05 INFO  : DSC06289-Pano.jpg: Copied (new)
2021/05/21 11:09:05 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06310.jpg
2021/05/21 11:09:05 DEBUG : DSC06310.jpg: Update: src=DSC06310.jpg
2021/05/21 11:09:05 DEBUG : DSC06301.jpg: >Update: err=<nil>
2021/05/21 11:09:05 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:09:05 DEBUG : DSC06301.jpg: Size:
2021/05/21 11:09:05 DEBUG : DSC06301.jpg: >Size:
2021/05/21 11:09:05 INFO  : DSC06301.jpg: Copied (new)
2021/05/21 11:09:05 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06312.jpg
2021/05/21 11:09:05 DEBUG : DSC06312.jpg: Update: src=DSC06312.jpg
2021/05/21 11:09:06 DEBUG : DSC06302.jpg: >Update: err=<nil>
2021/05/21 11:09:06 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:09:06 DEBUG : DSC06302.jpg: Size:
2021/05/21 11:09:06 DEBUG : DSC06302.jpg: >Size:
2021/05/21 11:09:06 INFO  : DSC06302.jpg: Copied (new)
2021/05/21 11:09:06 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06314.jpg
2021/05/21 11:09:06 DEBUG : DSC06314.jpg: Update: src=DSC06314.jpg
2021/05/21 11:09:07 DEBUG : DSC06310.jpg: >Update: err=<nil>
2021/05/21 11:09:07 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:09:07 DEBUG : DSC06310.jpg: Size:
2021/05/21 11:09:07 DEBUG : DSC06310.jpg: >Size:
2021/05/21 11:09:07 INFO  : DSC06310.jpg: Copied (new)
2021/05/21 11:09:07 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06315.jpg
2021/05/21 11:09:07 DEBUG : DSC06315.jpg: Update: src=DSC06315.jpg
2021/05/21 11:09:08 DEBUG : DSC06308.jpg: >Update: err=<nil>
2021/05/21 11:09:08 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:09:08 DEBUG : DSC06308.jpg: Size:
2021/05/21 11:09:08 DEBUG : DSC06308.jpg: >Size:
2021/05/21 11:09:08 INFO  : DSC06308.jpg: Copied (new)
2021/05/21 11:09:08 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06317.jpg
2021/05/21 11:09:08 DEBUG : DSC06317.jpg: Update: src=DSC06317.jpg
2021/05/21 11:09:08 DEBUG : pacer: low level retry 1/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:08 DEBUG : pacer: Rate limited, increasing sleep to 1.499794049s
2021/05/21 11:09:08 DEBUG : pacer: Reducing sleep to 0s
2021/05/21 11:09:08 DEBUG : pacer: low level retry 2/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:08 DEBUG : pacer: Rate limited, increasing sleep to 1.217647044s
2021/05/21 11:09:08 DEBUG : pacer: Reducing sleep to 0s
2021/05/21 11:09:08 DEBUG : DSC06314.jpg: >Update: err=<nil>
2021/05/21 11:09:08 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:09:08 DEBUG : DSC06314.jpg: Size:
2021/05/21 11:09:08 DEBUG : DSC06314.jpg: >Size:
2021/05/21 11:09:08 INFO  : DSC06314.jpg: Copied (new)
2021/05/21 11:09:08 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06318.jpg
2021/05/21 11:09:08 DEBUG : DSC06318.jpg: Update: src=DSC06318.jpg
2021/05/21 11:09:09 DEBUG : DSC06312.jpg: >Update: err=<nil>
2021/05/21 11:09:09 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:09:09 DEBUG : DSC06312.jpg: Size:
2021/05/21 11:09:09 DEBUG : DSC06312.jpg: >Size:
2021/05/21 11:09:09 INFO  : DSC06312.jpg: Copied (new)
2021/05/21 11:09:09 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06319.jpg
2021/05/21 11:09:09 DEBUG : DSC06319.jpg: Update: src=DSC06319.jpg
2021/05/21 11:09:10 DEBUG : pacer: low level retry 3/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:10 DEBUG : pacer: Rate limited, increasing sleep to 1.4166821s
2021/05/21 11:09:10 DEBUG : pacer: low level retry 4/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:10 DEBUG : pacer: Rate limited, increasing sleep to 2.06965093s
2021/05/21 11:09:11 DEBUG : pacer: Reducing sleep to 0s
2021/05/21 11:09:11 DEBUG : DSC06317.jpg: >Update: err=<nil>
2021/05/21 11:09:11 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:09:11 DEBUG : DSC06317.jpg: Size:
2021/05/21 11:09:11 DEBUG : DSC06317.jpg: >Size:
2021/05/21 11:09:11 INFO  : DSC06317.jpg: Copied (new)
2021/05/21 11:09:11 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06322.jpg
2021/05/21 11:09:11 DEBUG : DSC06322.jpg: Update: src=DSC06322.jpg
2021/05/21 11:09:11 DEBUG : pacer: low level retry 5/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:11 DEBUG : pacer: Rate limited, increasing sleep to 1.523618919s
2021/05/21 11:09:11 DEBUG : pacer: low level retry 1/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:11 DEBUG : pacer: low level retry 1/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:11 DEBUG : pacer: Rate limited, increasing sleep to 2.970601073s
2021/05/21 11:09:11 DEBUG : pacer: Rate limited, increasing sleep to 4.187919196s
2021/05/21 11:09:12 DEBUG : pacer: Reducing sleep to 0s
2021/05/21 11:09:13 DEBUG : DSC06315.jpg: >Update: err=<nil>
2021/05/21 11:09:13 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:09:13 DEBUG : DSC06315.jpg: Size:
2021/05/21 11:09:13 DEBUG : DSC06315.jpg: >Size:
2021/05/21 11:09:13 INFO  : DSC06315.jpg: Copied (new)
2021/05/21 11:09:13 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06324.jpg
2021/05/21 11:09:13 DEBUG : DSC06324.jpg: Update: src=DSC06324.jpg
2021/05/21 11:09:13 DEBUG : pacer: low level retry 2/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:13 DEBUG : pacer: Rate limited, increasing sleep to 1.494633086s
2021/05/21 11:09:13 DEBUG : pacer: low level retry 1/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:13 DEBUG : pacer: Rate limited, increasing sleep to 2.688837862s
2021/05/21 11:09:13 DEBUG : pacer: low level retry 2/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:13 DEBUG : pacer: Rate limited, increasing sleep to 4.79006364s
2021/05/21 11:09:13 DEBUG : pacer: low level retry 3/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:13 DEBUG : pacer: Rate limited, increasing sleep to 8.057069624s
2021/05/21 11:09:14 DEBUG : pacer: Reducing sleep to 0s
2021/05/21 11:09:15 DEBUG : pacer: low level retry 2/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:15 DEBUG : pacer: Rate limited, increasing sleep to 1.205080155s
2021/05/21 11:09:15 DEBUG : pacer: low level retry 4/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:15 DEBUG : pacer: Rate limited, increasing sleep to 2.067913441s
2021/05/21 11:09:15 DEBUG : pacer: low level retry 3/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:15 DEBUG : pacer: Rate limited, increasing sleep to 4.713112947s
2021/05/21 11:09:15 DEBUG : pacer: low level retry 1/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:15 DEBUG : pacer: Rate limited, increasing sleep to 8.871974697s
2021/05/21 11:09:15 DEBUG : pacer: low level retry 3/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:15 DEBUG : pacer: Rate limited, increasing sleep to 16.318865207s
2021/05/21 11:09:16 DEBUG : pacer: low level retry 5/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:16 DEBUG : pacer: Rate limited, increasing sleep to 16.661502157s
2021/05/21 11:09:22 INFO  :
Transferred:   	  128.444M / 158.580 MBytes, 81%, 2.426 MBytes/s, ETA 12s
Transferred:           36 / 47, 77%
Elapsed time:       1m0.0s
Transferring:
 *                                  DSC06318.jpg:100% /3.039M, 239.244k/s, 0s
 *                                  DSC06319.jpg:100% /4.649M, 395.500k/s, 0s
 *                                  DSC06322.jpg:100% /4.966M, 505.986k/s, 0s
 *                                  DSC06324.jpg:100% /4.499M, 509.285k/s, 0s

2021/05/21 11:09:32 DEBUG : pacer: low level retry 4/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:32 DEBUG : pacer: Rate limited, increasing sleep to 16.864960096s
2021/05/21 11:09:49 DEBUG : pacer: low level retry 2/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:09:49 DEBUG : pacer: Rate limited, increasing sleep to 16.887946983s
2021/05/21 11:10:06 DEBUG : pacer: low level retry 4/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:10:06 DEBUG : pacer: Rate limited, increasing sleep to 16.461083845s
2021/05/21 11:10:22 INFO  :
Transferred:   	  128.444M / 158.580 MBytes, 81%, 1.137 MBytes/s, ETA 26s
Transferred:           36 / 47, 77%
Elapsed time:       2m0.0s
Transferring:
 *                                  DSC06318.jpg:100% /3.039M, 4.909k/s, 0s
 *                                  DSC06319.jpg:100% /4.649M, 7.990k/s, 0s
 *                                  DSC06322.jpg:100% /4.966M, 9.692k/s, 0s
 *                                  DSC06324.jpg:100% /4.499M, 9.365k/s, 0s

2021/05/21 11:10:24 DEBUG : pacer: Reducing sleep to 0s
2021/05/21 11:10:24 DEBUG : DSC06318.jpg: >Update: err=<nil>
2021/05/21 11:10:24 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:10:24 DEBUG : DSC06318.jpg: Size:
2021/05/21 11:10:24 DEBUG : DSC06318.jpg: >Size:
2021/05/21 11:10:24 INFO  : DSC06318.jpg: Copied (new)
2021/05/21 11:10:24 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=DSC06325.jpg
2021/05/21 11:10:24 DEBUG : DSC06325.jpg: Update: src=DSC06325.jpg
2021/05/21 11:10:39 DEBUG : pacer: low level retry 5/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:10:39 DEBUG : pacer: Rate limited, increasing sleep to 1.374346926s
2021/05/21 11:10:40 DEBUG : pacer: Reducing sleep to 0s
2021/05/21 11:10:41 DEBUG : DSC06324.jpg: >Update: err=<nil>
2021/05/21 11:10:41 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:10:41 DEBUG : DSC06324.jpg: Size:
2021/05/21 11:10:41 DEBUG : DSC06324.jpg: >Size:
2021/05/21 11:10:41 INFO  : DSC06324.jpg: Copied (new)
2021/05/21 11:10:41 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=extras/DSC06352.jpg
2021/05/21 11:10:41 DEBUG : extras/DSC06352.jpg: Update: src=extras/DSC06352.jpg
2021/05/21 11:10:42 DEBUG : DSC06319.jpg: >Update: err=<nil>
2021/05/21 11:10:42 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:10:42 DEBUG : DSC06319.jpg: Size:
2021/05/21 11:10:42 DEBUG : DSC06319.jpg: >Size:
2021/05/21 11:10:42 INFO  : DSC06319.jpg: Copied (new)
2021/05/21 11:10:42 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=extras/DSC06353.jpg
2021/05/21 11:10:42 DEBUG : extras/DSC06353.jpg: Update: src=extras/DSC06353.jpg
2021/05/21 11:10:43 DEBUG : DSC06322.jpg: >Update: err=<nil>
2021/05/21 11:10:43 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:10:43 DEBUG : DSC06322.jpg: Size:
2021/05/21 11:10:43 DEBUG : DSC06322.jpg: >Size:
2021/05/21 11:10:43 INFO  : DSC06322.jpg: Copied (new)
2021/05/21 11:10:43 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=extras/DSC06357.jpg
2021/05/21 11:10:43 DEBUG : extras/DSC06357.jpg: Update: src=extras/DSC06357.jpg
2021/05/21 11:10:43 DEBUG : DSC06325.jpg: >Update: err=<nil>
2021/05/21 11:10:43 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:10:43 DEBUG : DSC06325.jpg: Size:
2021/05/21 11:10:43 DEBUG : DSC06325.jpg: >Size:
2021/05/21 11:10:43 INFO  : DSC06325.jpg: Copied (new)
2021/05/21 11:10:43 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=extras/DSC06359.jpg
2021/05/21 11:10:43 DEBUG : extras/DSC06359.jpg: Update: src=extras/DSC06359.jpg
2021/05/21 11:10:44 DEBUG : pacer: low level retry 1/10 (error Quota exceeded for quota metric 'Write requests' and limit 'Write requests per minute per user' of service 'photoslibrary.googleapis.com' for consumer 'project_number:202264815644'. (429 RESOURCE_EXHAUSTED))
2021/05/21 11:10:44 DEBUG : pacer: Rate limited, increasing sleep to 1.257718732s
2021/05/21 11:10:44 DEBUG : pacer: Reducing sleep to 0s
2021/05/21 11:10:45 DEBUG : extras/DSC06357.jpg: >Update: err=<nil>
2021/05/21 11:10:45 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:10:45 DEBUG : extras/DSC06357.jpg: Size:
2021/05/21 11:10:45 DEBUG : extras/DSC06357.jpg: >Size:
2021/05/21 11:10:45 INFO  : extras/DSC06357.jpg: Copied (new)
2021/05/21 11:10:45 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=extras/DSC06361.jpg
2021/05/21 11:10:45 DEBUG : extras/DSC06361.jpg: Update: src=extras/DSC06361.jpg
2021/05/21 11:10:47 DEBUG : extras/DSC06359.jpg: >Update: err=<nil>
2021/05/21 11:10:47 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:10:47 DEBUG : extras/DSC06359.jpg: Size:
2021/05/21 11:10:47 DEBUG : extras/DSC06359.jpg: >Size:
2021/05/21 11:10:47 INFO  : extras/DSC06359.jpg: Copied (new)
2021/05/21 11:10:47 DEBUG : Google Photos path "album/MiddlesexFells": Put: src=extras/DSC06362.jpg
2021/05/21 11:10:47 DEBUG : extras/DSC06362.jpg: Update: src=extras/DSC06362.jpg
2021/05/21 11:10:48 DEBUG : extras/DSC06353.jpg: >Update: err=<nil>
2021/05/21 11:10:48 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:10:48 DEBUG : extras/DSC06353.jpg: Size:
2021/05/21 11:10:48 DEBUG : extras/DSC06353.jpg: >Size:
2021/05/21 11:10:48 INFO  : extras/DSC06353.jpg: Copied (new)
2021/05/21 11:10:50 DEBUG : extras/DSC06352.jpg: >Update: err=<nil>
2021/05/21 11:10:50 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:10:50 DEBUG : extras/DSC06352.jpg: Size:
2021/05/21 11:10:50 DEBUG : extras/DSC06352.jpg: >Size:
2021/05/21 11:10:50 INFO  : extras/DSC06352.jpg: Copied (new)
2021/05/21 11:10:51 DEBUG : extras/DSC06361.jpg: >Update: err=<nil>
2021/05/21 11:10:51 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:10:51 DEBUG : extras/DSC06361.jpg: Size:
2021/05/21 11:10:51 DEBUG : extras/DSC06361.jpg: >Size:
2021/05/21 11:10:51 INFO  : extras/DSC06361.jpg: Copied (new)
2021/05/21 11:10:51 DEBUG : extras/DSC06362.jpg: >Update: err=<nil>
2021/05/21 11:10:51 DEBUG : Google Photos path "album/MiddlesexFells": >Put:
2021/05/21 11:10:51 DEBUG : extras/DSC06362.jpg: Size:
2021/05/21 11:10:51 DEBUG : extras/DSC06362.jpg: >Size:
2021/05/21 11:10:51 INFO  : extras/DSC06362.jpg: Copied (new)
2021/05/21 11:10:51 INFO  :
Transferred:   	  158.580M / 158.580 MBytes, 100%, 1.111 MBytes/s, ETA 0s
Transferred:           47 / 47, 100%
Elapsed time:      2m29.8s

2021/05/21 11:10:51 DEBUG : 5 go routines active

ncw · May 21, 2021, 6:47pm

--include "/*" should do what you want

gummybear · May 21, 2021, 7:43pm

Thanks!

--include "/*" seems to work, however now I'm getting

ERROR : Using --filter is recommended instead of both --include and --exclude as the order they are parsed in is indeterminate

because I also have --exclude .DS_Store --exclude *.txt arguments (sorry, I included them in the log example but not in the first mention of what my command was).

I looked at https://rclone.org/filtering/ to try to figure out how to write the filter, but I'm not good enough at regular expressions to figure out how to combine your suggestion with the files I need excluded. Any chance you could help me figure out the filter expression?

ncw · May 21, 2021, 9:16pm

Change --include "X" into --filter "+ X" and --exclude "X" into --filter "- X"

Put the excludes first. At the end put --filter "- *"

If that doesn't work, post what you got to and I'll tell you why it didn't work.

gummybear · May 24, 2021, 1:43pm

Thank you so much! The following filter command seems to do what I was looking for

--filter "- .DS_Store" --filter "- *.txt" --filter "+ /*" --filter "- *"

- .DS_Store and - *.txt excludes non image files from trying to copy
+ /* Includes only the current directory (subdirectories will not try to copy)
- * Excludes everything else

ncw · May 24, 2021, 1:52pm

That looks perfect

system · July 24, 2021, 9:52am

This topic was automatically closed 60 days after the last reply. New replies are no longer allowed.