Truth version 1.5.0 · ProofRange

How we score without trusting the vendor

Every planted vulnerability has a machine-checkable signal. Decoys measure precision. Official runs use blind evaluation — the scanner never receives the answer key at runtime.

Metrics

Detected

Your finding maps to a planted vuln ID (keyword + endpoint + class heuristics). Weaker signal — useful for coverage tracking.

Verified

Evidence matches the oracle’s confirmation chain (e.g. exploitable output, OOB correlation, state change). Primary score for marketing and regression gates.

Decoy hits (FP)

Six safe endpoints per ring designed to look tempting. Any verified-style hit on a decoy is a ground-truth false positive — precision matters.

Precision

TP / (TP + decoy FP)

Reported at vuln-map level, not raw alert count.

Blind evaluation (required for certification)

Allowed at scan timeForbidden at scan time
Target URL (e.g. proofrange.vulngym.com)truth.json inside the scanner
Attacker credentials (Alice — fixed)Operator manifest (rotating victim/admin)
Your product’s normal crawl/exploit logicHard-coded vuln IDs from a prior run

After the scan, you may score offline with the oracle. That separation keeps benchmarks honest across vendors.

Anti-cheat

Rings

RingLabPlantedFocus
1ProofRange23Auth API, JWT, SSRF/OOB, logic, RCE chains
2AgentRange10GraphQL, MCP tools, agent scope abuse
3MeshRange10gRPC, WebSocket, OAuth replay, mesh trust

Lab health vs your score

coverage.js proves vulnerabilities are exploitable (operator tool). Your score measures your product against that ground truth — typically lower than 23/23 until your engine matures. We publish both concepts separately to avoid confusion.