We’ve been having great success with rclone to copy an archive of data to Google Drive, however we have run into a problem. When trying to run rclone dedupe on a massive upload we have finished, we get the following error;
Failed to dedupe: find duplicate dirs: couldn’t list directory: googleapi: Error 403: Rate Limit Exceeded, rateLimitExceeded
We rerun the command and it will usually stops on a different directory, but will still stop. When copying the rate limit error doesn’t seem to effect things, however with dedupe it just seems to stop the process. Is there any way to make this continue? If we keep running the dedupe command will it eventually get through all the directories?