Accuracy on PiQA
76.56AccuracyCoA-LoRA
Evaluation Results
| Method | Links | |
|---|---|---|
| CoA-LoRAModel=Llama-2-7B, Average Bit Budget=3-bit, Zero-shot=true2025.09 | 76.56 | |
| Base ModelBackbone=LLaMA-DCLM, Reweighting Space=Data sources2025.07 | 75.84 | |
| Base ModelBackbone=LLaMA-Nemo, Reweighting Space=Data sources2025.07 | 75.57 | |
| LQ-LoRAModel=Llama-2-7B, Average Bit Budget=3-bit, Zero-shot=true2025.09 | 75 | |
| DataAgent_RLBackbone=LLaMA-DCLM, Reweighting Space=Data sources2025.07 | 74.85 | |
| DataAgent_SFTBackbone=LLaMA-FWE, Reweighting Space=Data sources2025.07 | 74.6 | |
| DataAgent_RLBackbone=LLaMA-Nemo, Reweighting Space=Data sources2025.07 | 74.49 | |
| Shared-LoRAModel=Llama-2-7B, Average Bit Budget=3-bit, Zero-shot=true2025.09 | 74.22 | |
| Base ModelBackbone=LLaMA-FWE, Reweighting Space=Data sources2025.07 | 74.21 | |
| DataAgent_SFTBackbone=LLaMA-Nemo, Reweighting Space=Data sources2025.07 | 74.17 | |
| RegMixBackbone=LLaMA-DCLM, Reweighting Space=Data sources2025.07 | 73.88 | |
| QLoRAModel=Llama-2-7B, Average Bit Budget=3-bit, Zero-shot=true2025.09 | 73.44 | |
| Apertus-8BModel Category=Fully open models, Instruction-tuned=true2026.03 | 73.4 | |
| DataAgent_SFTBackbone=LLaMA-DCLM, Reweighting Space=Data sources2025.07 | 73.28 | |
| DataAgent_RLBackbone=LLaMA-FWE, Reweighting Space=Data sources2025.07 | 73.12 | |
| RegMixBackbone=LLaMA-Nemo, Reweighting Space=Data sources2025.07 | 72.85 | |
| AMALIA-9B-DPOModel Category=Fully open models, Training=DPO, Instruction-tuned=true2026.03 | 72.5 | |
| DBLBackbone=LLaMA-DCLM, Reweighting Space=Data sources2025.07 | 72.5 | |
| Shared-LoRAModel=Qwen2.5-3B, Average Bit Budget=3-bit, Zero-shot=true2025.09 | 71.88 | |
| RegMixBackbone=LLaMA-FWE, Reweighting Space=Data sources2025.07 | 71.72 | |
| EuroLLM-9BModel Category=Fully open models, Instruction-tuned=true2026.03 | 71.7 | |
| AMALIA-9B-SFTModel Category=Fully open models, Training=SFT, Instruction-tuned=true2026.03 | 71.7 | |
| DBLBackbone=LLaMA-FWE, Reweighting Space=Data sources2025.07 | 71.18 | |
| Base ModelBackbone=Pythia-1.4B, Reweighting Space=Data sources2025.07 | 70.89 | |
| DBLBackbone=LLaMA-Nemo, Reweighting Space=Data sources2025.07 | 70.79 | |
| Ministral-8BModel Category=Open weight models, Instruction-tuned=true2026.03 | 70.7 | |
| Salamandra-7BModel Category=Fully open models, Instruction-tuned=true2026.03 | 70.4 | |
| QLoRAModel=Qwen2.5-3B, Average Bit Budget=3-bit, Zero-shot=true2025.09 | 70.34 | |
| CoA-LoRAModel=Qwen2.5-3B, Average Bit Budget=3-bit, Zero-shot=true2025.09 | 70.31 | |
| Gemma 2-9BModel Category=Open weight models, Instruction-tuned=true2026.03 | 70.3 | |
| Gervasio-8BModel Category=Open weight models, Instruction-tuned=true2026.03 | 69.1 | |
| Gemma 3-12BModel Category=Open weight models, Instruction-tuned=true2026.03 | 69 | |
| LQ-LoRAModel=Qwen2.5-3B, Average Bit Budget=3-bit, Zero-shot=true2025.09 | 68.75 | |
| Llama 3.1-8BModel Category=Open weight models, Instruction-tuned=true2026.03 | 68.5 | |
| Mistral-7BModel Category=Open weight models, Instruction-tuned=true2026.03 | 66.9 | |
| Qwen 2.5-7BModel Category=Open weight models, Instruction-tuned=true2026.03 | 66.6 | |
| RegMixBackbone=Pythia-1.4B, Reweighting Space=Data sources2025.07 | 65.7 | |
| DataAgent_RLBackbone=Pythia-1.4B, Reweighting Space=Data sources2025.07 | 65.54 | |
| Qwen 3-8BModel Category=Open weight models, Instruction-tuned=true2026.03 | 64.7 | |
| DataAgent_SFTBackbone=Pythia-1.4B, Reweighting Space=Data sources2025.07 | 61.94 | |
| Naive TrainingBackbone=LLaMA-FWE, Reweighting Space=Data sources2025.07 | 61.1 | |
| OLMo 2-7BModel Category=Fully open models, Instruction-tuned=true2026.03 | 61 | |
| Naive TrainingBackbone=LLaMA-DCLM, Reweighting Space=Data sources2025.07 | 60.28 | |
| Naive TrainingBackbone=LLaMA-Nemo, Reweighting Space=Data sources2025.07 | 59.74 | |
| Naive TrainingBackbone=Pythia-1.4B, Reweighting Space=Data sources2025.07 | 52.95 |