Question Answering on ComQA
78.03AccuracyCP
Evaluation results
| Method | Links | |
|---|---|---|
| CPModel=GPT-3.5-turbo2026.01 | 78.03 | |
| ACPSModel=GPT-3.5-turbo2026.01 | 74.9 | |
| CoT-SCModel=GPT-3.5-turbo2026.01 | 67.31 | |
| CoTModel=GPT-3.5-turbo2026.01 | 65.66 | |
| SoTModel=GPT-3.5-turbo2026.01 | 64.25 | |
| ACPSModel=LLaMA-32026.01 | 63.64 | |
| CoTModel=LLaMA-32026.01 | 61.73 | |
| SoTModel=LLaMA-32026.01 | 60.76 | |
| CPModel=LLaMA-32026.01 | 60.1 | |
| CoT-SCModel=LLaMA-32026.01 | 57.14 | |
| ACPSModel=Ministral-3B2026.01 | 53.67 | |
| CPModel=Ministral-3B2026.01 | 50 | |
| CoTModel=Ministral-3B2026.01 | 44.44 | |
| SoTModel=Ministral-3B2026.01 | 43.45 | |
| CoT-SCModel=Ministral-3B2026.01 | 38.73 | |
| DenseBase Model=DeepSeek-7B, Sparsity=Dense2025.06 | 36.69 | |
| DenseBase Model=LLaMA-2-7B, Sparsity=Dense2025.06 | 32.92 | |
| ICLModel=GPT-3.5-turbo2026.01 | 32.69 | |
| ICLModel=LLaMA-32026.01 | 28.45 | |
| MaskProBase Model=DeepSeek-7B, Sparsity=2:42025.06 | 23.18 | |
| SparsegptBase Model=DeepSeek-7B, Sparsity=2:42025.06 | 23.1 | |
| Pruner-ZBase Model=DeepSeek-7B, Sparsity=2:42025.06 | 22.95 | |
| MaskProBase Model=LLaMA-2-7B, Sparsity=2:42025.06 | 22.03 | |
| SparsegptBase Model=LLaMA-2-7B, Sparsity=2:42025.06 | 20.8 | |
| Pruner-ZBase Model=LLaMA-2-7B, Sparsity=2:42025.06 | 20.08 | |
| ICLModel=Ministral-3B2026.01 | 20 |