Is there anyway to feed rclone dedupe two different directories and have the dedupe process treat those two different remote locations as one single location for the dedupe process without actually moving or merging them first?

[left1000]

Does anyone know a good local dedupe tool that can take 400,000 files mounted with rclone mount and dedupe them PURELY by size and name?

Ran czkawka_gui_gtk412 aka czkawka for about 5minutes and it found all the duplicates! That’s good. It is using 250megabytes of ram ALSO GOOD. I have no idea how to delete the files I want deleted though. I mounted all the badly sorted files as L: and the files sorted properly as M: So I want to delete all duplicates in L: buuuuuuut czkawka is not telling me anything about the file path of the duplicates! OH wait no I figured it out I can do custom select. Path. Set path to L: Dang that does …

Mounting the folders worked great, once I found a proper dedupe tool to run locally on my machine. There are a LOT of bad ones out there but I can recommend czkawka based stuff at least.

Deleting files from the mounted drive is much much much slower than rclone delete, it’ll take hours not minutes. I wonder if this is because I chose –network-mode or is it always like this for large changes to an rclone mount?