List your company
ResearchFormerly WizWand

Question Answering on NQ-Open (val)

49.62AccuracyNWCAD
4.1215.932527.74539.5575Dec 14, 2025Jan 3, 2026Jan 24, 2026Feb 14, 2026Mar 6, 2026Mar 27, 2026Apr 17, 2026
Updated 6mo ago

Evaluation results

MethodLinks
NWCADModel=Llama-3.1-70B2026.0449.62——
AdaCADModel=Llama-3.1-70B2026.0449.5——
NWCADModel=Llama-3.1-8B2026.0448.6——
AdaCADModel=Llama-3.1-8B2026.0445——
AdaCADModel=Ministral-3-8B2026.0445——
NWCADModel=Ministral-3-8B2026.0444.6——
CoCoAModel=Ministral-3-8B2026.0443.8——
CoCoAModel=Llama-3.1-70B2026.0443——
CoCoAModel=Llama-3.1-8B2026.0442.6——
With-contextModel=Llama-3.1-70B2026.0442.25——
CADModel=Ministral-3-8B2026.0438.4——
With-contextModel=Ministral-3-8B2026.0437.6——
With-contextModel=Llama-3.1-8B2026.0435.2——
CADModel=Llama-3.1-8B2026.0435.2——
BaselineBackbone=Llama-2-13b, Param Ratio=1.00, Fine-tuning=None2025.1230.7——
ESMASize=7B2026.02290.6856.95
LLRCBackbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=None2025.1226.5——
BaselineBackbone=Llama-2-7b, Param Ratio=1.00, Fine-tuning=None2025.1226——
CADModel=Llama-3.1-70B2026.0423.25——
ESMASize=3B2026.0222.60.8462.44
LLRCBackbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=None2025.1222.1——
LLM-Pruner+FinetuneBackbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=Alpaca2025.1222.1——
OriginalSize=7B2026.0221.910.5363.46
LLM-PrunerBackbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=None2025.1221.2——
SVD-LLM+FinetuneBackbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=Alpaca2025.1220.7——
OriginalSize=1.5B2026.0219.470.1954.46
LLRCBackbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=None2025.1218.9——
SVD-LLM (w)Backbone=Llama-2-13b, Param Ratio=0.90, Fine-tuning=None2025.1218.3——
ESMASize=1.5B2026.0217.950.7974.21
LLM-Pruner+FinetuneBackbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=Alpaca2025.1217.9——
SVD-LLM+FinetuneBackbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=Alpaca2025.1217.6——
BaselineModel=Llama-3.1-70B2026.0416.62——
BaselineModel=Llama-3.1-8B2026.0416.4——
LLM-Pruner+FinetuneBackbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=Alpaca2025.1216.2——
LLM-PrunerBackbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=None2025.1215.5——
SVD-LLM+FinetuneBackbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=Alpaca2025.1214.9——
LLRCBackbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=None2025.1213.5——
SVD-LLM (w)Backbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=None2025.1212.9——
LLM-PrunerBackbone=Llama-2-13b, Param Ratio=0.80, Fine-tuning=None2025.1212.6——
OriginalSize=3B2026.0211.860.3482.77
SVD-LLM+FinetuneBackbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=Alpaca2025.1211.8——
LLM-Pruner+FinetuneBackbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=Alpaca2025.1211.1——
BaselineModel=Ministral-3-8B2026.0411——
SVD-LLM (w)Backbone=Llama-2-7b, Param Ratio=0.90, Fine-tuning=None2025.1210.8——
LLM-PrunerBackbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=None2025.127.8——
SVD-LLM (w)Backbone=Llama-2-7b, Param Ratio=0.80, Fine-tuning=None2025.125.87——