Question Answering on ARC
94.6AccuracyYi-34B + RTD
Evaluation Results
| Method | Links | |
|---|---|---|
| Yi-34B + RTDevaluation=5-shot2024.09 | 94.6 | |
| Yi-34Bevaluation=5-shot ICL2024.09 | 94 | |
| Yi-34Bevaluation=zero-shot2024.09 | 93.3 | |
| Dense ModelBase Model=Llama3.1-8B, Fine-tuning Protocol=LoRA, Sparsity=0%2026.01 | 93.1 | |
| GradPrunerBase Model=Llama3.1-8B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.01 | 92.3 | |
| LLaMA2-70B + RTDevaluation=5-shot2024.09 | 91.7 | |
| LLaMA2-70Bevaluation=5-shot ICL2024.09 | 91.6 | |
| Dense ModelBase Model=Mistral-7B, Fine-tuning Protocol=LoRA, Sparsity=0%2026.01 | 90.9 | |
| Yi-34B + RTDevaluation=zero-shot2024.09 | 90.7 | |
| Dense ModelBase Model=Mistral-7B, Fine-tuning Protocol=FFT, Sparsity=0%2026.01 | 90.5 | |
| FT(Llama3.2)Base Model=Llama3.2-3B, Fine-tuning Protocol=LoRA, Sparsity=0%2026.01 | 90.2 | |
| GradPrunerBase Model=Mistral-7B, Fine-tuning Protocol=FFT, Sparsity=40%2026.01 | 89.5 | |
| GradPrunerBase Model=Mistral-7B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.01 | 89.3 | |
| APTBase Model=Llama3.1-8B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.01 | 89.1 | |
| Sonnet-3.5Retrieval=None2026.03 | 88.5 | |
| SATBase Model=Llama3.1-8B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.01 | 88.2 | |
| LacoBase Model=Llama3.1-8B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.01 | 87.5 | |
| FT(Llama3.2)Base Model=Llama3.2-3B, Fine-tuning Protocol=FFT, Sparsity=0%2026.01 | 87.4 | |
| LLaMA3-8Bevaluation=5-shot ICL2024.09 | 87.3 | |
| MINITRONBase Model=Llama3.1-8B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.01 | 87.3 | |
| LLaMA3-8B + RTDevaluation=5-shot2024.09 | 87.1 | |
| LLMPrunerBase Model=Llama3.1-8B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.01 | 87 | |
| LLMPrunerBase Model=Mistral-7B, Fine-tuning Protocol=FFT, Sparsity=40%2026.01 | 86.7 | |
| SATBase Model=Mistral-7B, Fine-tuning Protocol=FFT, Sparsity=40%2026.01 | 86.7 | |
| APTBase Model=Mistral-7B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.01 | 86.6 | |
| Dense ModelBase Model=Llama3.1-8B, Fine-tuning Protocol=FFT, Sparsity=0%2026.01 | 86.5 | |
| LacoBase Model=Mistral-7B, Fine-tuning Protocol=FFT, Sparsity=40%2026.01 | 86.4 | |
| Qwen3-32B+Hit-RAGFramework=Hit-RAG2026.03 | 86.2 | |
| LLaMA2-70B + RTDevaluation=zero-shot2024.09 | 86.1 | |
| SATBase Model=Mistral-7B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.01 | 85.7 | |
| MINITRONBase Model=Mistral-7B, Fine-tuning Protocol=FFT, Sparsity=40%2026.01 | 85.1 | |
| LacoBase Model=Mistral-7B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.01 | 85.1 | |
| Llama3.1-70B+R-InsRetrieval=Yes2026.03 | 85.1 | |
| GradPrunerBase Model=Llama3.1-8B, Fine-tuning Protocol=FFT, Sparsity=40%2026.01 | 84.9 | |
| Llama3.1-70B+Hit-RAGFramework=Hit-RAG2026.03 | 84.8 | |
| LLMPrunerBase Model=Mistral-7B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.01 | 84 | |
| MINITRONBase Model=Mistral-7B, Fine-tuning Protocol=LoRA, Sparsity=40%2026.01 | 84 | |
| LLaMA3-8B + RTDevaluation=zero-shot2024.09 | 83.7 | |
| MINITRONBase Model=Llama3.1-8B, Fine-tuning Protocol=FFT, Sparsity=40%2026.01 | 82.6 | |
| LacoBase Model=Llama3.1-8B, Fine-tuning Protocol=FFT, Sparsity=40%2026.01 | 82.4 | |
| SATBase Model=Llama3.1-8B, Fine-tuning Protocol=FFT, Sparsity=40%2026.01 | 82.2 | |
| MetaICLk=40, Backbone=Llama-2-7b-chat-hf2025.01 | 82 | |
| MetaICLk=MAX, Backbone=Llama-2-7b-chat-hf2025.01 | 82 | |
| LLMPrunerBase Model=Llama3.1-8B, Fine-tuning Protocol=FFT, Sparsity=40%2026.01 | 81.7 | |
| Qwen3-4B+Hit-RAGFramework=Hit-RAG2026.03 | 81.4 | |
| Qwen3-8B+Hit-RAGFramework=Hit-RAG2026.03 | 81.3 | |
| DrICLk=5, Backbone=Llama-2-7b-chat-hf2025.01 | 81 | |
| DrICLk=30, Backbone=Llama-2-7b-chat-hf2025.01 | 81 | |
| DrICLk=MAX, Backbone=Llama-2-7b-chat-hf2025.01 | 81 | |
| Llama3.1-8B+Hit-RAGFramework=Hit-RAG2026.03 | 80.2 | |
| Llama3.1-8B+R-InsRetrieval=Yes2026.03 | 79.9 | |
| DrICLk=AVG, Backbone=Llama-2-7b-chat-hf2025.01 | 78 | |
| GLM3-6B + RTDevaluation=5-shot2024.09 | 76.5 | |
| Speculative RAG-7BRetrieval=Yes2026.03 | 76.2 | |
| MetaICLk=AVG, Backbone=Llama-2-7b-chat-hf2025.01 | 76 | |
| GLM3-6Bevaluation=5-shot ICL2024.09 | 75.3 | |
| ChatGPTRetrieval=None2026.03 | 75.3 | |
| Ret-ChatGPTRetrieval=None2026.03 | 75.3 | |
| GLM3-6B + RTDevaluation=zero-shot2024.09 | 75 | |
| Self-RAG-13BRetrieval=Yes2026.03 | 73.1 | |
| RAS-8BRetrieval=Yes2026.03 | 71.4 | |
| LLaMA3-8Bevaluation=zero-shot2024.09 | 71.2 | |
| ITk=0, Backbone=Llama-2-7b-chat-hf2025.01 | 71 | |
| ITk=MAX, Backbone=Llama-2-7b-chat-hf2025.01 | 71 | |
| BaseTraining Stage=SFT-1B, Evaluation Protocol=Zero-shot2025.12 | 69.65 | |
| Qwen3-32BRetrieval=None2026.03 | 69.4 | |
| SOLARTraining Stage=SFT-1B, Evaluation Protocol=Zero-shot2025.12 | 69.28 | |
| MSSRfullBackbone=Llama-3.1-8B2026.03 | 69.2 | |
| SOLARTraining Stage=CPT-1B, Evaluation Protocol=Zero-shot2025.12 | 68.81 | |
| MSSRschBackbone=Llama-3.1-8B2026.03 | 68.8 | |
| BaseTraining Stage=CPT-1B, Evaluation Protocol=Zero-shot2025.12 | 68.69 | |
| RAS-7BRetrieval=Yes2026.03 | 68.5 | |
| Llama ProTraining Stage=SFT-1B, Evaluation Protocol=Zero-shot2025.12 | 67.68 | |
| LLaMA2-70Bevaluation=zero-shot2024.09 | 67.4 | |
| LLaMA2-7B + RTDevaluation=5-shot2024.09 | 67.3 | |
| Self-RAG-7BRetrieval=Yes2026.03 | 67.3 | |
| Avg-DeUSTraining Stage=SFT-1B, Evaluation Protocol=Zero-shot2025.12 | 67.09 | |
| Avg-DeUSTraining Stage=CPT-1B, Evaluation Protocol=Zero-shot2025.12 | 66.84 | |
| UniBiasModel=Llama-2 13b, ICL Setting=1-shot2024.05 | 66.81 | |
| Llama ProTraining Stage=CPT-1B, Evaluation Protocol=Zero-shot2025.12 | 66.75 | |
| OpT-DeUSTraining Stage=SFT-1B, Evaluation Protocol=Zero-shot2025.12 | 66.62 | |
| ICLModel=Llama-2 13b, ICL Setting=1-shot2024.05 | 66.54 | |
| OpT-DeUSTraining Stage=CPT-1B, Evaluation Protocol=Zero-shot2025.12 | 66.46 | |
| LESATraining Stage=CPT-1B, Evaluation Protocol=Zero-shot2025.12 | 66.33 | |
| MIDUS-HMLTraining Stage=SFT-1B, Evaluation Protocol=Zero-shot2025.12 | 66.33 | |
| MIDUS-HMLTraining Stage=CPT-1B, Evaluation Protocol=Zero-shot2025.12 | 66.16 | |
| LESATraining Stage=SFT-1B, Evaluation Protocol=Zero-shot2025.12 | 65.99 | |
| LLaMA2-7Bevaluation=5-shot ICL2024.09 | 65 | |
| NFTk=0, Backbone=Llama-2-7b-chat-hf2025.01 | 65 | |
| NFTk=MAX, Backbone=Llama-2-7b-chat-hf2025.01 | 65 | |
| MSSRsplBackbone=Llama-3.1-8B2026.03 | 65 | |
| DCModel=Llama-2 13b, ICL Setting=1-shot2024.05 | 64.88 | |
| SPACEIteration=Iter22025.12 | 64.85 | |
| SPACEIteration=Iter42025.12 | 64.85 | |
| SPACEIteration=Iter32025.12 | 64.59 | |
| AccuBackbone=Llama-3.1-8B2026.03 | 64.5 | |
| CCModel=Llama-2 13b, ICL Setting=1-shot2024.05 | 64.33 | |
| SPINIteration=Iter12025.12 | 64.33 | |
| SPINIteration=Iter42025.12 | 63.99 | |
| S-IPOIteration=Iter32025.12 | 63.91 |