How winnowing fingerprints work
Every plagiarism detector that operates over a corpus larger than a few megabytes faces the same uncomfortable arithmetic. A document of n characters contains roughly n overlapping k-grams. Hashing all of them and storing the result produces an index larger than the corpus itself, which is fine for a homework folder and ruinous for the web. The whole problem of … Read more