Following up on Copying Google Drive to Google Photos ...
I've run my copy command 3 times now – each run taking 14-70 hours – and every time the stats are different re 'checks' and 'transferred'
Shouldn't a second run not transfer anything except maybe some 'errors' if I'm using the album directory which basically replicates the folder structure?
Help!
My command is:
rclone copy -Pvv \
"gdrive:folder" "gphotos:album/rclone" \
--transfers 16 \
--tpslimit 1 \
--drive-chunk-size 128M \
--exclude "*.{xml,bin,json,thm,DS_Store}*" \
--ignore-case \
--log-file=rclone-photos-"$(date +%Y%m%d_%H%M%S).log"
And these are the tails of the logs:
==> rclone-photos-20241205_142309.log <==
2024/12/08 12:16:25 INFO :
Transferred: 2.449 TiB / 2.449 TiB, 100%, 884.596 KiB/s, ETA 0s
Errors: 178 (retrying may help)
Checks: 45693 / 45693, 100%
Transferred: 26997 / 26997, 100%
Elapsed time: 2d21h53m15.9s
2024/12/08 12:16:25 DEBUG : 27 go routines active
2024/12/08 12:16:25 INFO : Google Photos path "album/rclone": Committing uploads - please wait...
2024/12/08 12:16:25 NOTICE: Failed to copy with 178 errors: last error was: failed to commit batch: batch upload failed: upload failed: Failed: There was an error while trying to create this media item. (3)
==> rclone-photos-20241209_101746.log <==
2024/12/10 05:35:03 INFO :
Transferred: 652.454 GiB / 652.454 GiB, 100%, 119.281 MiB/s, ETA 0s
Errors: 32 (retrying may help)
Checks: 50300 / 50300, 100%
Transferred: 23145 / 23145, 100%
Elapsed time: 19h17m16.6s
2024/12/10 05:35:03 DEBUG : 35 go routines active
2024/12/10 05:35:03 INFO : Google Photos path "album/rclone": Committing uploads - please wait...
2024/12/10 05:35:03 NOTICE: Failed to copy with 32 errors: last error was: failed to commit batch: batch upload failed: upload failed: Failed: There was an error while trying to create this media item. (3)
==> rclone-photos-20241210_192723.log <==
2024/12/11 09:56:55 INFO :
Transferred: 239.213 GiB / 239.213 GiB, 100%, 896.122 KiB/s, ETA 0s
Errors: 28 (retrying may help)
Checks: 50417 / 50417, 100%
Transferred: 23031 / 23031, 100%
Elapsed time: 14h29m31.1s
2024/12/11 09:56:55 DEBUG : 25 go routines active
2024/12/11 09:56:55 INFO : Google Photos path "album/rclone": Committing uploads - please wait...
2024/12/11 09:56:55 NOTICE: Failed to copy with 28 errors: last error was: failed to commit batch: batch upload failed: upload failed: Failed: There was an error while trying to create this media item. (3)