Google Photos: Failed to copy: failed to create media item: The operation was aborted. (409 ABORTED)

Suspected Bug
1

What is the problem you are having with rclone?

I am synching my local photolibrary to Google Photos and I get a lot of 409 ABORTED errors in the logs. I have about 115500 files with about 540GB.
It works for most of the files, also when I retry some get uploaded.
The last run looked like this:

Transferred: 21.850G / 21.926 GBytes, 100%, 1.219 MBytes/s, ETA 1m3s
Errors: 2258 (retrying may help)
Checks: 338646 / 338646, 100%
Transferred: 4259 / 4273, 100%

What is your rclone version (output from rclone version)

rclone v1.50.2
os/arch: windows/amd64
go version: go1.13.4

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Windows Server 2008R2 x64

Which cloud storage system are you using? (eg Google Drive)

Google Photos

The command you were trying to run (eg rclone copy /tmp remote:tmp)

C:\rclone\rclone.exe sync "G:\_BACKUPS\_FOTOS" googlephotos:album/FL --verbose --log-file="C:\rclone\_log_GooglePhotos.log"

A log from the command with the -vv flag (eg output from rclone -vv copy /tmp remote:tmp)

Here is a sample with 2 errors:

2020/02/02 13:57:06 DEBUG : Fotos Library - 7 - Schweden/03.02.2010/CIMG0027.JPG: Unchanged skipping 2020/02/02 13:57:06 DEBUG : Fotos Library - 11 - Brazil Bolivia Peru/Amsterdam 2015/P1060608.JPG: >Update: err=<nil> 2020/02/02 13:57:06 DEBUG : Google Photos path "album/FL": >Put: 2020/02/02 13:57:06 DEBUG : Fotos Library - 11 - Brazil Bolivia Peru/Amsterdam 2015/P1060608.JPG: Size: 2020/02/02 13:57:06 DEBUG : Fotos Library - 11 - Brazil Bolivia Peru/Amsterdam 2015/P1060608.JPG: >Size: 2020/02/02 13:57:06 INFO : Fotos Library - 11 - Brazil Bolivia Peru/Amsterdam 2015/P1060608.JPG: Copied (new) 2020/02/02 13:57:06 DEBUG : Google Photos path "album/FL": Put: src=Fotos Library - 11 - Brazil Bolivia Peru/Amsterdam 2015/P1060611.JPG 2020/02/02 13:57:06 DEBUG : Fotos Library - 11 - Brazil Bolivia Peru/Amsterdam 2015/P1060611.JPG: Update: src=Fotos Library - 11 - Brazil Bolivia Peru/Amsterdam 2015/P1060611.JPG 2020/02/02 13:57:06 DEBUG : Fotos Library - 11 - Brazil Bolivia Peru/Amsterdam 2015/P1060609.JPG: >Update: err=failed to create media item: The operation was aborted. (409 ABORTED) 2020/02/02 13:57:06 DEBUG : Google Photos path "album/FL": >Put: 2020/02/02 13:57:06 ERROR : Fotos Library - 11 - Brazil Bolivia Peru/Amsterdam 2015/P1060609.JPG: Failed to copy: failed to create media item: The operation was aborted. (409 ABORTED) 2020/02/02 13:57:06 DEBUG : Google Photos path "album/FL": >List: err=<nil>

2

I don't know what causes that error - the docs don't say...

Is the image below 75MB?

The cloud docs say

409 ABORTED Concurrency conflict, such as read-modify-write conflict.

So I wonder if setting --transfers 1 might help.

Are there any other errors in the logs? Quota errors maybe?

3

It is way below 75MB, an average picture has around 9MB

No other errors beside 409. I noticed that in case it tries to sync a file Google Photos cannot handle e.g. a textfile or the osx ".DS_Store" files it also throws an 409 error.
I now included an exclude list filter to prevent this.

I also checked the reported picture files to see if they are corrupt but I can open them without any issues and I can also upload them without any issues through the browser to Google Photos.

I will try the --transfers 1 flag if this changes something, thanks for the suggestion.

4

Quick update, it now runs since 20 minutes and no picture/video upload errors so far! :grinning:
I now added --retries-sleep 1m --transfers 1 to my command.

The only 409 errors I see is because I forgot to exclude "thumbs.db" files which GP cannot handle.

:+1:

5

That is good to know! I've not seen that 409 error before so I'll need to keep an eye on it.

6

My sync finished after 9h 19m and I can confirm this fixed the issue.

I tried setting --transfers 2 with another run and the errors reappeared, so definitely --transfers 1 solves the issue with the 409 error.

2020/02/03 22:15:42 INFO  : 
Transferred:   	   19.732G / 19.732 GBytes, 100%, 616.316 kBytes/s, ETA 0s
Errors:                 9 (retrying may help)
Checks:            339528 / 339528, 100%
Transferred:         7152 / 7152, 100%
Elapsed time:  9h19m31.8s

The 9 errors reported were thumbs.db files which could not be uploaded. So all relevant files went through with --transfers 1

7

Great - thank you.

Do you think this should be an official recommendation for the Google Photos backend?

8

It's hard to say as it seems I am the first or the only one with this issue so far and the reason is unknown. Maybe the issue is on my side somehow...
It could be a tip for troubleshooting, not sure about a recommendation although.

I scheduled my sync job every 4 days now so maybe I can recognize a pattern over time when I set it to --transfers 2

9

I'll see if any there are any other complaints of the same problem... If anyone in the future is reading this thread, make a note if you have the same problem!

2 Likes
10

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.