Question Answering on NQ-Open (val)
49.62AccuracyNWCAD
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| NWCADModel=Llama-3.1-70B2026.04 | 49.62 | — | — | |
| AdaCADModel=Llama-3.1-70B2026.04 | 49.5 | — | — | |
| NWCADModel=Llama-3.1-8B2026.04 | 48.6 | — | — | |
| AdaCADModel=Llama-3.1-8B2026.04 | 45 | — | — | |
| AdaCADModel=Ministral-3-8B2026.04 | 45 | — | — | |
| NWCADModel=Ministral-3-8B2026.04 | 44.6 | — | — | |
| CoCoAModel=Ministral-3-8B2026.04 | 43.8 | — | — | |
| CoCoAModel=Llama-3.1-70B2026.04 | 43 | — | — | |
| CoCoAModel=Llama-3.1-8B2026.04 | 42.6 | — | — | |
| With-contextModel=Llama-3.1-70B2026.04 | 42.25 | — | — | |
| CADModel=Ministral-3-8B2026.04 | 38.4 | — | — | |
| With-contextModel=Ministral-3-8B2026.04 | 37.6 | — | — | |
| With-contextModel=Llama-3.1-8B2026.04 | 35.2 | — | — | |
| CADModel=Llama-3.1-8B2026.04 | 35.2 | — | — | |
| BaselineBackbone=Llama-2-13b, Param Ratio=1.00, Fine-tuning=None2025.12 | 30.7 | — | — | |
| ESMASize=7B2026.02 | 29 | 0.68 | 56.95 | |
| LLRCBackbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=None2025.12 | 26.5 | — | — | |
| BaselineBackbone=Llama-2-7b, Param Ratio=1.00, Fine-tuning=None2025.12 | 26 | — | — | |
| CADModel=Llama-3.1-70B2026.04 | 23.25 | — | — | |
| ESMASize=3B2026.02 | 22.6 | 0.84 | 62.44 | |
| LLRCBackbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=None2025.12 | 22.1 | — | — | |
| LLM-Pruner+FinetuneBackbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=Alpaca2025.12 | 22.1 | — | — | |
| OriginalSize=7B2026.02 | 21.91 | 0.53 | 63.46 | |
| LLM-PrunerBackbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=None2025.12 | 21.2 | — | — | |
| SVD-LLM+FinetuneBackbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=Alpaca2025.12 | 20.7 | — | — | |
| OriginalSize=1.5B2026.02 | 19.47 | 0.19 | 54.46 | |
| LLRCBackbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=None2025.12 | 18.9 | — | — | |
| SVD-LLM (w)Backbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=None2025.12 | 18.3 | — | — | |
| ESMASize=1.5B2026.02 | 17.95 | 0.79 | 74.21 | |
| LLM-Pruner+FinetuneBackbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=Alpaca2025.12 | 17.9 | — | — | |
| SVD-LLM+FinetuneBackbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=Alpaca2025.12 | 17.6 | — | — | |
| BaselineModel=Llama-3.1-70B2026.04 | 16.62 | — | — | |
| BaselineModel=Llama-3.1-8B2026.04 | 16.4 | — | — | |
| LLM-Pruner+FinetuneBackbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=Alpaca2025.12 | 16.2 | — | — | |
| LLM-PrunerBackbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=None2025.12 | 15.5 | — | — | |
| SVD-LLM+FinetuneBackbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=Alpaca2025.12 | 14.9 | — | — | |
| LLRCBackbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=None2025.12 | 13.5 | — | — | |
| SVD-LLM (w)Backbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=None2025.12 | 12.9 | — | — | |
| LLM-PrunerBackbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=None2025.12 | 12.6 | — | — | |
| OriginalSize=3B2026.02 | 11.86 | 0.34 | 82.77 | |
| SVD-LLM+FinetuneBackbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=Alpaca2025.12 | 11.8 | — | — | |
| LLM-Pruner+FinetuneBackbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=Alpaca2025.12 | 11.1 | — | — | |
| BaselineModel=Ministral-3-8B2026.04 | 11 | — | — | |
| SVD-LLM (w)Backbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=None2025.12 | 10.8 | — | — | |
| LLM-PrunerBackbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=None2025.12 | 7.8 | — | — | |
| SVD-LLM (w)Backbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=None2025.12 | 5.87 | — | — |