Question Answering on SQuAD
93.33Exact MatchCortexDebate
Evaluation Results
| Method | Links | |
|---|---|---|
| CortexDebateType=Ours2025.07 | 93.33 | |
| GDType=Part Debate2025.07 | 90.33 | |
| SFTBackbone=Mistral 7B2026.03 | 89.67 | |
| SFTBackbone=Llama3.1 8B2026.03 | 89.49 | |
| CoRectModel=Qwen2.5-7b-instruct2026.02 | 88.93 | |
| COIECDModel=Qwen2.5-7b-instruct2026.02 | 88.9 | |
| RECONCILEType=Full Debate2025.07 | 88.33 | |
| NDType=Part Debate2025.07 | 88.33 | |
| PRDType=Full Debate2025.07 | 87.67 | |
| ChatEvalType=Full Debate2025.07 | 87.33 | |
| SFTBackbone=Qwen3 1.7B2026.03 | 86.64 | |
| MLDType=Full Debate2025.07 | 86.33 | |
| CoABackbone=Llama3.1 8B2026.03 | 86.13 | |
| MaVType=No Debate2025.07 | 85.33 | |
| CADModel=LLaMA3-8b-instruct2026.02 | 84.93 | |
| CoABackbone=Qwen3 1.7B2026.03 | 84.68 | |
| CADModel=Qwen2.5-7b-instruct2026.02 | 84.43 | |
| COIECDModel=LLaMA3-8b-instruct2026.02 | 84.4 | |
| CoRectModel=LLaMA3-8b-instruct2026.02 | 83.7 | |
| HyperMoEArchitecture=Switch Transformer2024.02 | 83.51 | |
| CoABackbone=Mistral 7B2026.03 | 83.15 | |
| MoEArchitecture=Switch Transformer2024.02 | 83.01 | |
| MoE-ShareArchitecture=Switch Transformer2024.02 | 82.87 | |
| GreedyModel=LLaMA3-8b-instruct2026.02 | 81.93 | |
| AdaCADModel=LLaMA3-8b-instruct2026.02 | 81.87 | |
| GreedyModel=Qwen2.5-7b-instruct2026.02 | 81.27 | |
| AdaCADModel=Qwen2.5-7b-instruct2026.02 | 81.2 | |
| T5-baseModel Size=220M, Data=Full, Method=Fine-Tuned2024.03 | 77.3 | |
| GOLDBase Model=LLaMA2 -> T5-base, Model Size=220M, Data=3K2024.03 | 75.2 | |
| T5-baseModel Size=220M, Data=Full, Method=Pre-Trained2024.03 | 74.7 | |
| P2ModelBase Model=LLaMA2 -> T5-base, Model Size=220M, Data=3K2024.03 | 74.4 | |
| CoRectModel=Mistral-7b2026.02 | 74.33 | |
| COIECDModel=Mistral-7b2026.02 | 74.2 | |
| CADModel=Mistral-7b2026.02 | 72.9 | |
| CoRectModel=LLaMA2-13b-chat2026.02 | 70.7 | |
| ZeroGenBase Model=LLaMA2 -> T5-base, Model Size=220M, Data=3K2024.03 | 69.4 | |
| CADModel=LLaMA2-13b-chat2026.02 | 68.97 | |
| sudoLMBackbone=Qwen3 1.7B2026.03 | 68.48 | |
| ProGenBase Model=LLaMA2 -> T5-base, Model Size=220M, Data=3K2024.03 | 68.1 | |
| BEST-ON-VALBackbone=Llama-22024.12 | 66.1 | |
| Self-RAGLLM=Llama-3.1-8B, Write-back=true2026.03 | 65.45 | |
| FLARELLM=Llama-3.1-8B, Write-back=true2026.03 | 64.16 | |
| GreedyModel=Mistral-7b2026.02 | 63.93 | |
| AdaCADModel=Mistral-7b2026.02 | 63.87 | |
| Self-RAGLLM=Llama-3.1-8B, Write-back=false2026.03 | 63.58 | |
| RePlugLLM=Llama-3.1-8B, Write-back=true2026.03 | 63.42 | |
| Naive RAGLLM=Llama-3.1-8B, Write-back=true2026.03 | 63.23 | |
| Self-RAGLLM=Gemma-3-12B, Write-back=true2026.03 | 63.22 | |
| SMOOTHIE-LOCALBackbone=Llama-22024.12 | 63.1 | |
| FLARELLM=Llama-3.1-8B, Write-back=false2026.03 | 62.29 | |
| Naive RAGLLM=Llama-3.1-8B, Write-back=false2026.03 | 62.14 | |
| RePlugLLM=Llama-3.1-8B, Write-back=false2026.03 | 61.83 | |
| FLARELLM=Gemma-3-12B, Write-back=true2026.03 | 61.78 | |
| Self-RAGLLM=Gemma-3-12B, Write-back=false2026.03 | 61.73 | |
| SMOOTHIE-GLOBALBackbone=Llama-22024.12 | 61.4 | |
| RePlugLLM=Gemma-3-12B, Write-back=true2026.03 | 61.39 | |
| Naive RAGLLM=Gemma-3-12B, Write-back=true2026.03 | 61.24 | |
| Naive RAGLLM=Gemma-3-12B, Write-back=false2026.03 | 60.89 | |
| FLARELLM=Gemma-3-12B, Write-back=false2026.03 | 60.55 | |
| RePlugLLM=Gemma-3-12B, Write-back=false2026.03 | 60.25 | |
| COIECDModel=LLaMA2-13b-chat2026.02 | 58.67 | |
| No RetrievalLLM=Llama-3.1-8B2026.03 | 55.18 | |
| LLaMA2Model Size=7B, Method=Few-shot, Prompt=Specific2024.03 | 54.7 | |
| No RetrievalLLM=Gemma-3-12B2026.03 | 54.36 | |
| BaseBackbone=Llama3.1 8B2026.03 | 54.19 | |
| RANDOMBackbone=Llama-22024.12 | 54 | |
| PermLMBackbone=Llama3.1 8B2026.03 | 53.9 | |
| SMOOTHIE-GLOBALBackbone=Falcon2024.12 | 53.3 | |
| SMOOTHIE-LOCALBackbone=Falcon2024.12 | 53.3 | |
| BEST-ON-VALBackbone=Falcon2024.12 | 52.7 | |
| GreedyModel=LLaMA2-13b-chat2026.02 | 52.17 | |
| AdaCADModel=LLaMA2-13b-chat2026.02 | 51.8 | |
| RANDOMBackbone=Falcon2024.12 | 47.3 | |
| dual-debiasing frameworkRetriever=DPP, Noise Type=None, Noise Ratio=0.02025.05 | 37.2 | |
| dual-debiasing frameworkRetriever=Random, Noise Type=Irrelevant, Noise Ratio=0.82025.05 | 35.2 | |
| Naïve ICLRetriever=TopK, Noise Type=Relevant, Noise Ratio=0.22025.05 | 33.47 | |
| BaseBackbone=Qwen3 1.7B2026.03 | 31.95 | |
| PermLMBackbone=Qwen3 1.7B2026.03 | 31.95 | |
| BaseBackbone=Mistral 7B2026.03 | 29.1 | |
| PermLMBackbone=Mistral 7B2026.03 | 29.1 | |
| sudoLMBackbone=Mistral 7B2026.03 | 23.85 | |
| LLaMA2Model Size=7B, Method=Few-shot, Prompt=General2024.03 | 15.2 | |
| sudoLMBackbone=Llama3.1 8B2026.03 | 14.76 |