How to prevent duplicates in gdrive? Can rclone mount handle dupelicates?


#1

When uploading similar files to gdrive, gdrive might creates duplicate files. The solution to this problem is to use rclone dedupe. Unfortunately, using dedupe will take huge amount of time and the the size of data grows, do does dedupe.

It is possible to handle the duplicates by rclone itself? I mean, if rclone found dulicates, just ignore the old file and get the new one? Or are there any new solutions?


#2

Stop it before it gets to rclone would be the best bet. What is creating duplicates?


#3

Good idea. Can rclone auto check if the file exist before uploading?


#4

It does… However that dosen’t always work. I think it is to do with eventual consistency - you upload a file and it takes a while to appear in the listing.