Math & Code Reasoning on SciQ
66.5ScoreDiReCT
Evaluation Results
| Method | Links | |
|---|---|---|
| DiReCTBackbone=Llama-1.1B2026.05 | 66.5 | |
| InfoBatchBackbone=Llama-1.1B2026.05 | 65.6 | |
| Perplexity-basedBackbone=Llama-1.1B2026.05 | 63.1 | |
| GradNorm (IS)Backbone=Llama-1.1B2026.05 | 62.8 | |
| Uniform SamplingBackbone=Llama-1.1B2026.05 | 61.2 | |
| Loss-basedBackbone=Llama-1.1B2026.05 | 60.5 | |
| DiReCTBackbone=GPT-2-Medium (355M)2026.05 | 48.5 | |
| InfoBatchBackbone=GPT-2-Medium (355M)2026.05 | 46 | |
| GradNorm (IS)Backbone=GPT-2-Medium (355M)2026.05 | 45.2 | |
| Perplexity-basedBackbone=GPT-2-Medium (355M)2026.05 | 44.6 | |
| Loss-basedBackbone=GPT-2-Medium (355M)2026.05 | 43.7 | |
| Uniform SamplingBackbone=GPT-2-Medium (355M)2026.05 | 43.1 |