Sync with google photos to local drive will result in recoping

What is the problem you are having with rclone?

Hi,

if I rerun the sync command again for my files which I sync from Google Photos to my local drive, then all the files are copied again.

rclone sync -u -v --drive-skip-checksum-gphotos gphotos:media/by-month/2016/2016-06 /home/username/Bilder/Google_Fotos/sorted/2016/2016-06

I tried the following flags so far:
--size-only
--drive-skip-checksum-gphotos
-c

At the moment I have 58 files in that folder and it will all copy them again with the message similar to:

2019/09/04 09:19:15 INFO : 20160605_101933.jpg: Copied (Rcat, replaced existing)

What is your rclone version (output from rclone version )

rclone v1.49.1

  • os/arch: linux/amd64
  • go version: go1.12.9

Which OS you are using and how many bits (eg Windows 7, 64 bit)

Debian 9

Which cloud storage system are you using? (eg Google Drive)

Google Photos

Full log

2019/09/04 09:24:21 INFO : Local file system at /home/username/Bilder/Google_Fotos/sorted/2016/2016-06: Waiting for checks to finish
2019/09/04 09:24:21 INFO : Local file system at /home/username/Bilder/Google_Fotos/sorted/2016/2016-06: Waiting for transfers to finish
2019/09/04 09:24:22 INFO : 20160605_101857.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:22 INFO : 20160611_100219.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:22 INFO : 20160614_133454.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:22 INFO : 20160615_082952.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:22 INFO : 20160615_083000.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:22 INFO : 20160615_083004.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:23 INFO : 20160615_131216.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:23 INFO : 20160615_132307.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:23 INFO : 20160615_133150.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:24 INFO : 20160611_100114.mp4: Copied (Rcat, replaced existing)
2019/09/04 09:24:25 INFO : 20160616_150217.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:25 INFO : 20160611_100248.mp4: Copied (Rcat, replaced existing)
2019/09/04 09:24:25 INFO : 20160616_150249.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:25 INFO : 20160615_162859.mp4: Copied (Rcat, replaced existing)
2019/09/04 09:24:26 INFO : 20160617_084421.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:26 INFO : 20160611_100323.mp4: Copied (Rcat, replaced existing)
2019/09/04 09:24:28 INFO : 20160618_125646.mp4: Copied (Rcat, replaced existing)
2019/09/04 09:24:28 INFO : 20160618_093653.mp4: Copied (Rcat, replaced existing)
2019/09/04 09:24:28 INFO : 20160617_084425.mp4: Copied (Rcat, replaced existing)
2019/09/04 09:24:29 INFO : 20160616_160906.mp4: Copied (Rcat, replaced existing)
2019/09/04 09:24:29 INFO : 20160619_164824.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:29 INFO : 20160619_163705.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:29 INFO : 20160605_101811.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:29 INFO : 20160619_164825.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:29 INFO : 20160619_164826.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:29 INFO : 20160619_164829.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:29 INFO : 20160619_164839.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:30 INFO : 20160619_164843.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:30 INFO : 20160619_165624.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:31 INFO : 20160618_125659.mp4: Copied (Rcat, replaced existing)
2019/09/04 09:24:31 INFO : 20160619_154834.mp4: Copied (Rcat, replaced existing)
2019/09/04 09:24:31 INFO : 20160625_103547.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:32 INFO : 20160621_165023.mp4: Copied (Rcat, replaced existing)
2019/09/04 09:24:32 INFO : 20160626_132603.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:32 INFO : 20160621_165709.mp4: Copied (Rcat, replaced existing)
2019/09/04 09:24:32 INFO : 20160625_103554.mp4: Copied (Rcat, replaced existing)
2019/09/04 09:24:33 INFO : 20160626_132843.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:33 INFO : 20160626_132840.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:33 INFO : 20160628_174604.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:34 INFO : 20160626_132845.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:34 INFO : 20160628_174631.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:34 INFO : 20160628_174715 {AKKIdqdvAk08gYUxQaPFAgm1j2E7UiEpS2lIhfuFsy4b91pAQ2RnIOaFoy5h08NIS9ylhAWE8ms6lB4gbertv5Dq-3okplEfwA}.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:34 INFO : 20160628_174715 {AKKIdqchpTSPMqfN_Mea5lJKGJa-pvKq1i2K11UIN7pTQNTRd1o4tfJNptbjvYslwfqUx9JXhUyi76skwc-4ImZW0KgjPx1psg}.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:34 INFO : 20160605_102006.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:34 INFO : 20160630_184125.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:34 INFO : IMG-20160607-WA0000.jpeg: Copied (Rcat, replaced existing)
2019/09/04 09:24:34 INFO : 20160625_104523.mp4: Copied (Rcat, replaced existing)
2019/09/04 09:24:34 INFO : Passbild_Handy.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:34 INFO : IMG-20160608-WA0003.jpeg: Copied (Rcat, replaced existing)
2019/09/04 09:24:34 INFO : 20160605_162330.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:34 INFO : 20160605_194756.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:35 INFO : IMG_20160618_214156.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:35 INFO : 20160605_194802.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:35 INFO : 20160605_101933.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:35 INFO : image-20160611_222454.jpg: Copied (Rcat, replaced existing)
2019/09/04 09:24:35 INFO : VID-20160625-WA0003.mp4: Copied (Rcat, replaced existing)
2019/09/04 09:24:35 INFO : Waiting for deletions to finish
2019/09/04 09:24:35 INFO :
Transferred: 120.421M / 120.421 MBytes, 100%, 8.382 MBytes/s, ETA 0s
Errors: 0
Checks: 58 / 58, 100%
Transferred: 112 / 112, 100%
Elapsed time: 14.3s

Sorry for bugging you, I think I have a found a solution myself.
Here is something that seems to work:

I removed the -u flag and the problem of retransmitting the same files over and over again disappeared. I don't need any other flags like

--size-only
--drive-skip-checksum-gphotos
-c

anymore either.

I think this might be a bug to do with the google photos having an unknown size.

Can you try this beta with the -u flag?

https://beta.rclone.org/branch/v1.49.0-019-gc1823416-fix-update-beta/ (uploaded in 15-30 mins)

This topic was automatically closed 90 days after the last reply. New replies are no longer allowed.