I have a lot of objects (millions) that are already in both the local and the destination (some in glacier and some standard). What's the best/fastest way to make sure the destination stays up to date with the newest files?
Previous files will NEVER need to be updated.
My current command is
rclone copy /media/storage/Events/01/ gfevents:gfevents/Events/01/ -P -v --log-file=/var/log/rclone.log
And since I also don't need the modified date updated on previous files should I use the
How about --fast-list?
Maybe once I ensure that everything is in the destination moving forward I can use a max-age flag. My issue with that is, if for some reason the cron job doesn't run, now we can get behind.
How about, --ignore-existing? If I truly know my previous files won't change, would that be safe? Only possibility would be if an upload failed perhaps a file could be missed.