Failure localization on LongMemEval
76.2AccuracyCircuit diagnostic
Evaluation results
| Method | Links | |
|---|---|---|
| Circuit diagnosticTrain?=✗, Model Scale=8B2026.05 | 76.2 | |
| Logistic regressionTrain?=✓, Model Scale=8B2026.05 | 63.4 | |
| Output entropyTrain?=✗, Model Scale=8B2026.05 | 51.5 | |
| Majority classTrain?=✗, Model Scale=8B2026.05 | 51 | |
| Behavioral rulesTrain?=✗, Model Scale=8B2026.05 | 45.4 |