500 Internal error when copying videos to Google Photos

Help and Support
1

What is the problem you are having with rclone?

Consistently getting 500 (INTERNAL) error

What is your rclone version (output from rclone version)

rclone v1.56.0

  • os/version: Microsoft Windows 10 Pro 2009 (64 bit)
  • os/kernel: 10.0.19043.1237 (x86_64)
  • os/type: windows
  • os/arch: amd64
  • go/version: go1.16.5
  • go/linking: dynamic
  • go/tags: cmount

Which cloud storage system are you using? (eg Google Drive)

Google Photos

The command you were trying to run (eg rclone copy /tmp remote:tmp)

rclone copy "PATH_TO_PHOTOS" remote:album/Photos -v --retries 1 --stats=1m --low-level-retries 3 --tpslimit 2 --transfers=1 --ignore-case --include "*.mp4" --log-file="PATH_TO_LOGFILE"

The rclone config contents with secrets removed.

[remote]
type = google photos
token = XXXX

A log from the command with the -vv flag

2021/09/16 19:44:43 INFO  : Starting transaction limiter: max 2 transactions/s with burst 1
2021/09/16 19:44:43 DEBUG : rclone: Version "v1.56.0" starting with parameters ["C:\\bin\\rclone\\rclone.exe" "copy" "O:\\My Webs\\ekavi\\Source\\Photos\\2019.01" "remote:album/Photos/2019.01" "-vv" "--retries" "1" "--stats=1m" "--low-level-retries" "3" "--tpslimit" "2" "--transfers=1" "--ignore-case" "--include" "*.mp4" "--log-file=C:\\bin\\Photos\\rclone.video.log"]
2021/09/16 19:44:43 DEBUG : Creating backend with remote "O:\\My Webs\\ekavi\\Source\\Photos\\2019.01"
2021/09/16 19:44:43 DEBUG : Using config file from "C:\\Users\\Patel\\AppData\\Roaming\\rclone\\rclone.conf"
2021/09/16 19:44:43 DEBUG : fs cache: renaming cache item "O:\\My Webs\\ekavi\\Source\\Photos\\2019.01" to be canonical "//?/O:/My Webs/ekavi/Source/Photos/2019.01"
2021/09/16 19:44:43 DEBUG : Creating backend with remote "remote:album/Photos/2019.01"
2021/09/16 19:44:43 DEBUG : Google Photos path "album/Photos": NewObject: remote="2019.01"
2021/09/16 19:44:43 DEBUG : Google Photos path "album/Photos": List: dir=""
2021/09/16 19:44:50 DEBUG : Google Photos path "album/Photos": Error reading media count: strconv.ParseInt: parsing "": invalid syntax
2021/09/16 19:44:50 DEBUG : Google Photos path "album/Photos": >List: err=<nil>
2021/09/16 19:44:50 DEBUG : Google Photos path "album/Photos": >NewObject: 
2021/09/16 19:44:50 DEBUG : Google Photos path "album/Photos/2019.01": List: dir=""
2021/09/16 19:44:51 DEBUG : Google Photos path "album/Photos/2019.01": >List: err=<nil>
2021/09/16 19:44:51 DEBUG : Google Photos path "album/Photos/2019.01": Waiting for checks to finish
2021/09/16 19:44:51 DEBUG : Google Photos path "album/Photos/2019.01": Waiting for transfers to finish
2021/09/16 19:44:51 DEBUG : Google Photos path "album/Photos/2019.01": Put: src=2019-01-12 09-22-55 - video - 20190112_092203.mp4
2021/09/16 19:44:51 DEBUG : 2019-01-12 09-22-55 - video - 20190112_092203.mp4: Update: src=2019-01-12 09-22-55 - video - 20190112_092203.mp4
2021/09/16 19:45:50 INFO  : 
Transferred:   	   82.168Mi / 346.449 MiByte, 24%, 1.393 MiByte/s, ETA 3m9s
Transferred:            0 / 5, 0%
Elapsed time:       1m7.3s
Transferring:
 * 2019-01-12 09-22-55 - … - 20190112_092203.mp4: 79% /103.482Mi, 1.393Mi/s, 15s

2021/09/16 19:46:07 DEBUG : pacer: low level retry 1/3 (error Internal error encountered. (500 INTERNAL))
2021/09/16 19:46:07 DEBUG : pacer: Rate limited, increasing sleep to 1.723666697s
2021/09/16 19:46:07 DEBUG : pacer: low level retry 2/3 (error Internal error encountered. (500 INTERNAL))
2021/09/16 19:46:07 DEBUG : pacer: Rate limited, increasing sleep to 2.681593286s
2021/09/16 19:46:09 DEBUG : pacer: low level retry 3/3 (error Internal error encountered. (500 INTERNAL))
2021/09/16 19:46:09 DEBUG : pacer: Rate limited, increasing sleep to 4.247472323s
2021/09/16 19:46:09 DEBUG : 2019-01-12 09-22-55 - video - 20190112_092203.mp4: >Update: err=failed to create media item: Internal error encountered. (500 INTERNAL)
2021/09/16 19:46:09 DEBUG : Google Photos path "album/Photos/2019.01": >Put: 
2021/09/16 19:46:09 DEBUG : 2019-01-12 09-22-55 - video - 20190112_092203.mp4: Received error: failed to create media item: Internal error encountered. (500 INTERNAL) - low level retry 1/3
2021/09/16 19:46:09 DEBUG : Google Photos path "album/Photos/2019.01": Put: src=2019-01-12 09-22-55 - video - 20190112_092203.mp4
2021/09/16 19:46:09 DEBUG : 2019-01-12 09-22-55 - video - 20190112_092203.mp4: Update: src=2019-01-12 09-22-55 - video - 20190112_092203.mp4
2

A follow up on this ... I created a Test folder, and put in just the MP4 file. I continued to have the same issue. So, I added a JPG file in that folder. The JPG file is 5MB, the MP4 file is 8MB. The JPG uploaded immediately, but I still run into the same issue with the MP4 file.

The command I used for this test is:

rclone copy "O:\My Webs\ekavi\Source\Photos\Test" remote:album/Photos/Test -vv --log-file="C:\bin\Photos\rclone.log"

I have tried the following:

  • deleting an re-creating the config
  • installing a fresh copy of the binaries
  • re-booting my system
  • throttling using various commands (retries, low-level-retries, tpslimit).

The log for this run is below:

2021/09/16 21:00:58 DEBUG : rclone: Version "v1.56.0" starting with parameters ["C:\bin\rclone\rclone.exe" "copy" "O:\My Webs\ekavi\Source\Photos\Test" "remote:album/Photos/Test" "-vv" "--log-file=C:\bin\Photos\rclone.log"]
2021/09/16 21:00:58 DEBUG : Creating backend with remote "O:\My Webs\ekavi\Source\Photos\Test"
2021/09/16 21:00:58 DEBUG : Using config file from "C:\Users\Patel\AppData\Roaming\rclone\rclone.conf"
2021/09/16 21:00:58 DEBUG : fs cache: renaming cache item "O:\My Webs\ekavi\Source\Photos\Test" to be canonical "//?/O:/My Webs/ekavi/Source/Photos/Test"
2021/09/16 21:00:58 DEBUG : Creating backend with remote "remote:album/Photos/Test"
2021/09/16 21:00:58 DEBUG : Google Photos path "album/Photos": NewObject: remote="Test"
2021/09/16 21:00:58 DEBUG : Google Photos path "album/Photos": List: dir=""
2021/09/16 21:01:05 DEBUG : Google Photos path "album/Photos": Error reading media count: strconv.ParseInt: parsing "": invalid syntax
2021/09/16 21:01:05 DEBUG : Google Photos path "album/Photos": Error reading media count: strconv.ParseInt: parsing "": invalid syntax
2021/09/16 21:01:05 DEBUG : Google Photos path "album/Photos": >List: err=
2021/09/16 21:01:05 DEBUG : Google Photos path "album/Photos": >NewObject:
2021/09/16 21:01:05 DEBUG : Google Photos path "album/Photos/Test": List: dir=""
2021/09/16 21:01:05 DEBUG : Google Photos path "album/Photos/Test": >List: err=
2021/09/16 21:01:05 DEBUG : Google Photos path "album/Photos/Test": Waiting for checks to finish
2021/09/16 21:01:05 DEBUG : Google Photos path "album/Photos/Test": Waiting for transfers to finish
2021/09/16 21:01:05 DEBUG : Google Photos path "album/Photos/Test": Put: src=MP4Test.mp4
2021/09/16 21:01:05 DEBUG : MP4Test.mp4: Update: src=MP4Test.mp4
2021/09/16 21:01:05 DEBUG : Google Photos path "album/Photos/Test": Put: src=JPGTest.jpg
2021/09/16 21:01:05 DEBUG : JPGTest.jpg: Update: src=JPGTest.jpg
2021/09/16 21:01:16 DEBUG : JPGTest.jpg: >Update: err=
2021/09/16 21:01:16 DEBUG : Google Photos path "album/Photos/Test": >Put:
2021/09/16 21:01:16 DEBUG : JPGTest.jpg: Size:
2021/09/16 21:01:16 DEBUG : JPGTest.jpg: >Size:
2021/09/16 21:01:16 INFO : JPGTest.jpg: Copied (new)
2021/09/16 21:01:16 DEBUG : pacer: low level retry 1/10 (error Internal error encountered. (500 INTERNAL))
2021/09/16 21:01:16 DEBUG : pacer: Rate limited, increasing sleep to 1.688771002s
2021/09/16 21:01:17 DEBUG : pacer: low level retry 2/10 (error Internal error encountered. (500 INTERNAL))
2021/09/16 21:01:17 DEBUG : pacer: Rate limited, increasing sleep to 2.550296981s
2021/09/16 21:01:19 DEBUG : pacer: low level retry 3/10 (error Internal error encountered. (500 INTERNAL))
2021/09/16 21:01:19 DEBUG : pacer: Rate limited, increasing sleep to 4.011062253s
2021/09/16 21:01:21 DEBUG : pacer: low level retry 4/10 (error Internal error encountered. (500 INTERNAL))
2021/09/16 21:01:21 DEBUG : pacer: Rate limited, increasing sleep to 8.007452372s
2021/09/16 21:01:25 DEBUG : pacer: low level retry 5/10 (error Internal error encountered. (500 INTERNAL))
2021/09/16 21:01:25 DEBUG : pacer: Rate limited, increasing sleep to 16.01754559s
2021/09/16 21:01:33 DEBUG : pacer: low level retry 6/10 (error Internal error encountered. (500 INTERNAL))
2021/09/16 21:01:33 DEBUG : pacer: Rate limited, increasing sleep to 16.33463952s
2021/09/16 21:01:49 DEBUG : pacer: low level retry 7/10 (error Internal error encountered. (500 INTERNAL))
2021/09/16 21:01:49 DEBUG : pacer: Rate limited, increasing sleep to 16.838797319s
2021/09/16 21:02:05 INFO :
Transferred: 13.599Mi / 13.599 MiByte, 100%, 54.216 KiByte/s, ETA 0s
Transferred: 1 / 2, 50%
Elapsed time: 1m6.9s
Transferring:

  •                               MP4Test.mp4:100% /8.565Mi, 34.147Ki/s, 0s

2021/09/16 21:02:06 DEBUG : pacer: low level retry 8/10 (error Internal error encountered. (500 INTERNAL))
2021/09/16 21:02:06 DEBUG : pacer: Rate limited, increasing sleep to 16.232334142s
2021/09/16 21:02:23 DEBUG : pacer: low level retry 9/10 (error Internal error encountered. (500 INTERNAL))
2021/09/16 21:02:23 DEBUG : pacer: Rate limited, increasing sleep to 16.831382194s

3

This seems to be working fine this morning, so we can close this topic. Not exactly sure what happened yesterday.

4

Google Photos is very odd at times and doesn't seem super reliable imo with the API.

Could have hit a limit or something and waiting just cleared it up.

5

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.