A tale of warning: silently corrupted/unreadable data on remote

[madison437]

Hi Durval,

Please look at the following posting I made earlier, about an issue I am still trying to figure out. This might be related:

Rclone not see all files in dir at Google Drive

Hi, I've been using rclone for well over a year to pull down md5sums of various directories of backup files that I have uploaded. To this end, my procedure is: 1) Build a local text file containing all md5sums on the local side for a particular backup directory (using rhash), and I run this periodically to pick up updates as new backup files are created within the directory. 2) I use the Syncovery app which on a scheduled basis, does a sync -- to mirror the local files to the remote Goog…

It is very possible that the “other 15 files” that were not found on the remote are still actually at Google Drive, but Google is not giving back a complete list of the files when asked to by rclone… a possible bug in their API.

What happens when you search for these filenames in the Google Drive web interface?

In my case, the files were actually there, and depending on some other variables, they sometimes “go missing” when addressed through the GDrive API by other apps (not just rclone).

I have escalated this through Google Support for Apps (GSuite), and am still trying to get data, but the last word from Google was (basically) that they weren’t interested in my problem because it involves 3rd party apps.

The odrive folks have been somewhat helpful in helping me track things down. I got sidelined on some other work, but will get back to this relatively soon.

– madison