Multi-domain Language Model Evaluation on Knowledge, Math, Code, Reasoning, and Biomedical Domains
69.2Average AccuracyCODA
Evaluation Results
| Method | Links | |
|---|---|---|
| CODABackbone=Gemma-2-9B, Controller Budget=50%2026.07 | 69.2 | |
| GradNormBackbone=Gemma-2-9B, Controller Budget=50%2026.07 | 68.3 | |
| CODABackbone=Qwen-2.5-7B, Controller Budget=50%2026.07 | 68 | |
| Full dataBackbone=Gemma-2-9B2026.07 | 67.2 | |
| GradNormBackbone=Qwen-2.5-7B, Controller Budget=50%2026.07 | 66.8 | |
| Full dataBackbone=Qwen-2.5-7B2026.07 | 66.2 | |
| CODABackbone=Qwen-2.5-3B, Controller Budget=50%2026.07 | 63.6 | |
| GradNormBackbone=Qwen-2.5-3B, Controller Budget=50%2026.07 | 62.8 | |
| Full dataBackbone=Qwen-2.5-3B2026.07 | 61.5 | |
| CODABackbone=Mistral-7B, Controller Budget=50%2026.07 | 60.3 | |
| GradNormBackbone=Mistral-7B, Controller Budget=50%2026.07 | 59.4 | |
| Full dataBackbone=Mistral-7B2026.07 | 58.2 | |
| CODABackbone=LLaMA-3.1-8B, Controller Budget=50%2026.07 | 57.2 | |
| GradNormBackbone=LLaMA-3.1-8B, Controller Budget=50%2026.07 | 56 | |
| Full dataBackbone=LLaMA-3.1-8B2026.07 | 55.4 |