Dedupe between source and remote

Feature-request: The "include-from", "filter-from" or "files-from" flags only accept a file. It would be nice if they accepted a remote and used its contents as a criterion for the operation.

In the absence of the above, is it possible to delete files that are present in Folder2, from Folder1?

Folder1

  • file1
  • file2
  • file3
  • file4

Folder2

  • file1
  • file2

rclone is not deduplication program.

I suggest some specialised software like fclones.

Here some ideas how to use it effectively with rclone:

Thanks for the suggestion. I will surely check out fclones.

However, I am not particularly after deduplication. What I am wanting is the ability to use the contents of a directory/remote as a criterion for an operation.

As another example, I am doing a 'copy' operation from FolderA to FolderB. But I want to copy only those files that exist in FolderC. Currently the way it's done is, first I save the filelist of FolderC to a text file. Then I run the below command:
rclone copy FolderA FolderB --files-from filelist.txt

If instead the --files-from flag could accept FolderC as a parameter, it would save the user from having to first create a text file with the list of FolderC contents.

welcome to the forum,

not sure, but might try
https://rclone.org/docs/#copy-dest-dir

This topic was automatically closed 30 days after the last reply. New replies are no longer allowed.