Golden specimens
Golden specimens are known-answer test cases — the standing offer to catch us being wrong before you pay us. Each is a prepared signal with a planted property and a known correct verdict.
| specimen | planted property | expected verdict |
|---|---|---|
| golden_clean.json | a genuine, persistent edge | ✓ pass |
| golden_lookahead.json | leaked future information | ✕ fail · edge_collapses_at_lag1 |
| golden_cherry.json | best-of-300 parameter cherry-pick | ✕ fail · family_budget_exhausted |
| golden_thin.json | too little data to judge | insufficient_evidence |
What they prove
Together, the four cover the three things you should demand of any validator: it catches real flaws (lookahead, cherry), it doesn't cry wolf (clean passes), and it admits when it cannot know (thin abstains). A validator that only ever says no is as useless as one that only says yes.
Use them in CI
Responses are bit-identical on every run, so an agent can assert against them automatically —
before every trading session, if you like. Run them via POST /v1/assay/demo
(quickstart), free.