D-separation Reasoning on D-separation (test)
73.9Average AccuracyD-separation V1
Evaluation results
| Method | Links | ||
|---|---|---|---|
| D-separation V1Prediction Pattern=Almost always ”No” (0-1.9k/8-10k), Collapse=Yes2026.05 | 73.9 | 7.6 | |
| Standard GemmaPrediction Pattern=Task-specific heuristics, Collapse=No2026.05 | 70.1 | 23.5 | |
| D-separation Sem V2Prediction Pattern=Context-dependent (27-6.3k), Collapse=No2026.05 | 68.6 | 25 |