List your company

List length 200 prompts Qwen3-8B (test)

100AccuracyProbe-round
56.00867.42978.8590.271May 5, 2026

Evaluation results

MethodLinks
Probe-roundIntervention type=Probe-round, Argmax restriction=digit-restricted, Number of seeds=32026.05100
9-row repairIntervention type=9-row repair, Argmax restriction=digit-restricted, Number of seeds=3, Training protocol=9-row repair2026.0599.2
Fullvocab repairIntervention type=Fullvocab repair, Argmax restriction=full-vocabulary, Number of seeds=3, Training protocol=margin-hinge training2026.0592.7
BaselineIntervention type=None, Argmax restriction=digit-restricted, Number of seeds=32026.0557.7