rclone is skipping files that are recently modified, "Destination is newer than source, skipping"
I am trying to sync files from my time machine storage to encrypted S3 Glacier. Using find, I can see files modified within the past 1 day. But looking at rclone output, it skips many files, giving the message noted above.
-- Find all time machine bundle files modified in the past 1 day
# find /opt/timemachine/macbook.backupbundle/ -mtime -1
-- Attempt to sync recently modified time machine files to S3 encrypted destination
# rclone sync --update --use-server-modtime /opt/timemachine/ cryptice:/opt/timemachine/ --transfers=6 --verbose --verbose --verbose
2023/08/15 16:47:26 DEBUG : rclone: Version "v1.56.2" starting with parameters ["rclone" "sync" "--update" "--use-server-modtime" "/opt/timemachine/" "cryptice:/opt/timemachine/" "--transfers=6" "--verbose" "--verbose" "--verbose"]
2023/08/15 16:47:42 DEBUG : macbook.backupbundle/bands/2672: Destination is newer than source, skipping
How can the destination be newer than the source, when the source was just modified moments ago when time machine performed a backup? In fact, many files were modified:
--verbose - using it multiple times will not provide more info.
if you want a deeper look, try --dump=headers
can you run those tests using latest stable rclone and post the full output?
if possible, rclone copy --dry-run, just one file and post full output.
try to just use rclone, let's figure out what the timestamps are, see what rclone is seeing
for that one file, what is the output of rclone lsl -vv on the source file rclone lsl -vv --use-server-modtime on the dest file
or could run, for that one file, rclone check --use-server-modtime -vv