How winnowing fingerprints work

How winnowing fingerprints work

Every plagiarism detector that operates over a corpus larger than a few megabytes faces the same uncomfortable arithmetic. A document of n characters contains roughly n overlapping k-grams. Hashing all of them and storing the result produces an index larger than the corpus itself, which is fine for a homework folder and ruinous for the web. The whole problem of … Read more

Why exact string matching still matters

Why exact string matching still matters

There is a tendency in any technical field to assume that the newest method is the best one. In plagiarism detection – and the broader family of problems concerned with finding copied text within and across very large document collections – the discourse of the past decade has been dominated by semantic embeddings, transformer-based paraphrase … Read more