I want to make sure 1.5+ TB of local photos are copied to Google Photos. I add new photos to various loical folders.
That means, everytime rclone
does a copy
it has to do a full list of the Google Photos remote.
I'm trying to find ways to speed this up by keeping a local list/cache of what was copied on the previous run?
That way, whenever I do a copy, rclone will compare against the local copy/list and then go straight to uploading new files.
I'm open to any suggestions.
asdffdsa
(jojothehumanmonkey)
September 6, 2023, 1:10pm
2
to reduce the number of checks, might try something like
--max-age=24h --no-traverse
That won't work well for me. Sometimes I add new files and their created/modfiied time is very old. Plus, I won't run rclone copy
on a schedule. Sometimes it'll happen in a day, sometimes a week.
asdffdsa
(jojothehumanmonkey)
September 6, 2023, 8:52pm
4
imthenachoman:
cache backend
that has been deprecated. bugs that will never get fixed.
https://forum.rclone.org/t/big-syncs-with-millions-of-files/40182
could tweak that.
src
= output from previous run
dst
= output from current run
1 Like
This is fantastic. Thank you!
system
(system)
Closed
September 10, 2023, 2:36am
6
This topic was automatically closed 3 days after the last reply. New replies are no longer allowed.