When uploading similar files to gdrive, gdrive might creates duplicate files. The solution to this problem is to use rclone dedupe. Unfortunately, using dedupe will take huge amount of time and the the size of data grows, do does dedupe.
It is possible to handle the duplicates by rclone itself? I mean, if rclone found dulicates, just ignore the old file and get the new one? Or are there any new solutions?
It does… However that dosen’t always work. I think it is to do with eventual consistency - you upload a file and it takes a while to appear in the listing.