How accurate is PureRank, really?
We scored 48 labeled websites — 34 clearly legitimate, 14 documented AI content farms — and published exactly what we found, including the bugs the test caught in our own engine. Here is where the AI Spam Score is trustworthy, and where it's only a hint.
A risk gradient, not a lie detector
Most "AI detectors" sell a yes/no verdict. We don't, and this benchmark is why. The AI Spam Score is a gradient: it is most reliable at the two ends and deliberately cautious in the middle, because the cost of falsely accusing an honest website is worse than missing a borderline one.
In plain terms: if PureRank scores your site 60 or above, take it seriously — nothing legitimate in our test reached that zone. If it scores under 25, you're almost certainly fine. The 30–55 middle is a prompt to look, not a verdict — it holds both cautious-legitimate sites and AI farms we didn't fully catch. The report always shows which signals fired, so you read the reasons, not just the number.
The dataset & method
48 labeled sites, scanned blind at a 25-page sample on the same engine build:
- 34 legitimate sites chosen to be hard — independent newsrooms and magazines (CT Mirror, MinnPost, Defector, Science News), developer docs and personal blogs (Astro, Tailwind, Simon Willison, Julia Evans, Martin Fowler), and small independent e-commerce. Not global mega-brands (those are out of scope) — the mid-sized, high-volume, sometimes-templated sites where a spam heuristic is most likely to trip.
- 14 documented AI content farms, each named by a reputable investigation — 404 Media, Nieman Lab, MIT Technology Review — and re-checked live before scanning: AI "news" rip-off sites, made-for-advertising health farms, and mass-produced recipe sites.
We measured specificity (how often we wrongly flag an honest site), class separation (do farms score higher than legit sites?), and the trade-off across every threshold. We did not compute a single "accuracy %" — with a gradient that would hide more than it shows.
Both sides were picked to be adversarial: fluent modern AI slop that reads human, and diverse legitimate publishers that stress our heuristics. A random sample of ordinary small-business sites would show much higher specificity than the figures here. Treat this as a floor, not the typical scan.
How the score behaved, band by band
| Score band | What it means | How it behaved on the benchmark |
|---|---|---|
| ≥ 60 · High–Critical | Confidently matches the scaled-content pattern | 0 legitimate sites. Caught the most blatant farms (a documented MFA health farm, a 300+‑page recipe mill). When it fires here, it's right. |
| 50–59 · High | Elevated — worth a real review | Almost all AI farms that reach here are genuine. A small number of heavily-templated e-commerce sites can also land here — see limitations. |
| 25–49 · Moderate | Advisory — read the signals | The crowded middle: cautious-legitimate publishers and AI farms we under-scored both live here. The band to investigate, not to trust blindly. |
| < 25 · Low | Confidently clean | Dominated by real human sites — docs, personal blogs, edited publications. Reliable "all clear". |
Documented AI farms averaged meaningfully higher than legitimate sites, but the classes overlap in the middle — which is exactly why we ship a gradient with an explained breakdown instead of a single verdict.
Two real bugs this benchmark caught — and we fixed
A dependency upgrade had introduced an HTML-parser incompatibility that could abort a scan on some legitimate sites (a nonprofit newsroom, a food magazine). The benchmark hit it immediately. Fixed with a resilient parser fallback — no single page can crash a scan again.
A gap in the Internet Archive's coverage of a long-lived site was being read as evidence the domain had died and been hijacked — flagging, among others, a well-known developer's own blog as an expired-domain-abuse case. Fixed: only a confirmed dead/parked period counts now; a bare archive gap on a site that kept its identity is treated as continuous ownership.
Both fixes shipped to production before this page went up. That's the whole reason to benchmark in public: it turns "trust us" into "here's what we found, and here's what we changed."
Where the score is weak (on purpose and not)
Modern AI farms produce text that reads cleanly, and several documented ones scored only "Moderate" in our test. Catching them without raising false alarms on honest sites is the hard, central problem — and our next engineering focus. We'd rather under-flag than falsely accuse, so today the top band is precise but not exhaustive.
A small independent shop with many near-identical product pages can look "scaled" to a site-level heuristic. It's the one legitimate category that can still reach the High band; we're calibrating the trust-surface weighting for it.
The expired-domain check reads the live Internet Archive, which is sometimes slow or incomplete — so that one signal can vary between scans. We flag it as lower-confidence when the archive doesn't respond fully.
Read your own report — signals, not just a number
Every scan shows the 7-dimension breakdown and every signal that fired, so you can judge the score for yourself. See the full methodology.
Run a free scan →