Quick question - I’m seeing a huge number of dupe files in my pictures folder, so running dedupe to clean them up. It’s been running for ages and hasn’t done anything yet.
But I’m wondering whether the dedupe is global (i.e., does rclone build a huge map of all files each with an MD5 hash) or is it folder-based (i.e., does rclone iterate each folder, and then enumerate any duplicate file entries within that folder structure)?
Im pretty sure it goes by folder. You’re allowed to have duplicates in different folders as those aren’t duplicates really in the context of this fixing them. I also be believe in recent betas it will also dedup folders themselves like this:
/root/folder1
/root/folder1
becomes just /root/folder1 and moves the files that were contained in each into a combined one. This just fixes google wierdness.