Incremental backups and efficiency (continued)

[TowerBR]

rclone lsf --max-age 10d src > files-to-copy
rclone copy --files-from files-to-copy src Backup:src

There is a problem with this strategy: if you delete a folder or file from the source, which is older than 10 days, this will not be reflected in the destination.

And there is also the problem of folders or files that were just moved (which does not change the file timestamp)

This, combined with the use of "copying" (rather than "syncing"), can cause the backup to become "bloated" over time with multiple old files.

I've been through this in the past:

(rclone sync) or (rclone mount + sync)?

I have a folder with hundreds of thousands of small files, which I back up to Wasabi with rclone sync. The problem is that only a few files are changed daily (few Mb), and each time the sync command runs it scans all files (which is time-consuming) to copy only the few new ones that have been modified. I’ve thought about creating a kind of “cold folder”, but the changed files are in several sub folders, that is, several folders have small changes every day. Before adopting the radical solution…

The solution is (if you want to use this strategy), from time to time, perform a "full sync"