Circuit Recovery Evaluation Suite
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Circuit Recovery Evaluation Suite (IOI, MCQA, Arithmetic, ARC) Llama-3 (3B to 8B) Transfer (test)
46Arithmetic (+) Score
13
Circuit Recovery Evaluation Suite Llama-3 1B to 8B
67Arithmetic (+) Accuracy
13