Dedupe 25PB using dedupe and lsf possible?

I found this thread looking for dedupe advice ... see Question about Google Drive usage & duplicates for a script that might be helpful in organizing the results of lsf to find dupes.

I also cannot run dedupe on all my files .. but with lsf I can go folder by folder and then combine my results.