List your company
ResearchFormerly WizWand

Question Answering on NQ (recall)

90.6NQ Recall (%)AGDLRPc
38.80852.25465.779.146Sep 30, 2025
Updated 7mo ago

Evaluation results

MethodLinks
AGDLRPcModel=Qwen 2.5 (7B), Setting=Open-book2025.0990.6
CADModel=Qwen 2.5 (7B), Setting=Open-book2025.0990
AGDI×GhModel=Qwen 2.5 (7B), Setting=Open-book2025.0990
AGDLRPhModel=Qwen 2.5 (7B), Setting=Open-book2025.0989.7
GreedyModel=Qwen 2.5 (7B), Setting=Open-book2025.0989
NucleusModel=Qwen 2.5 (7B), Setting=Open-book2025.0988.7
AGDI×GcModel=Qwen 2.5 (7B), Setting=Open-book2025.0988.6
AGDLRPcModel=Llama 3.1 (8B), Setting=Open-book2025.0987.9
AGDLRPhModel=Llama 3.1 (8B), Setting=Open-book2025.0987
AGDI×GhModel=Llama 3.1 (8B), Setting=Open-book2025.0985.7
CADModel=Llama 3.1 (8B), Setting=Open-book2025.0984.6
GreedyModel=Llama 3.1 (8B), Setting=Open-book2025.0983.5
AGDI×GcModel=Llama 3.1 (8B), Setting=Open-book2025.0983.5
NucleusModel=Llama 3.1 (8B), Setting=Open-book2025.0983.3
AGDLRPhModel=Gemma 3 (4B), Setting=Open-book2025.0983
AGDLRPcModel=Gemma 3 (4B), Setting=Open-book2025.0983
AGDI×GhModel=Gemma 3 (4B), Setting=Open-book2025.0982.5
AGDI×GcModel=Gemma 3 (4B), Setting=Open-book2025.0982.3
GreedyModel=Gemma 3 (4B), Setting=Open-book2025.0982
NucleusModel=Gemma 3 (4B), Setting=Open-book2025.0982
CADModel=Gemma 3 (4B), Setting=Open-book2025.0975.7
DoLAModel=Llama 3.1 (8B), Setting=Closed-book2025.0963.8
GreedyModel=Llama 3.1 (8B), Setting=Closed-book2025.0963.6
AGDI×GhModel=Llama 3.1 (8B), Setting=Closed-book2025.0963
AGDLRPhModel=Llama 3.1 (8B), Setting=Closed-book2025.0963
NucleusModel=Llama 3.1 (8B), Setting=Closed-book2025.0959.9
GreedyModel=Qwen 2.5 (7B), Setting=Closed-book2025.0947.8
AGDI×GhModel=Qwen 2.5 (7B), Setting=Closed-book2025.0947.1
AGDLRPhModel=Qwen 2.5 (7B), Setting=Closed-book2025.0946.9
NucleusModel=Qwen 2.5 (7B), Setting=Closed-book2025.0945.4
DoLAModel=Qwen 2.5 (7B), Setting=Closed-book2025.0944.3
AGDI×GhModel=Gemma 3 (4B), Setting=Closed-book2025.0942.1
AGDLRPhModel=Gemma 3 (4B), Setting=Closed-book2025.0941.9
GreedyModel=Gemma 3 (4B), Setting=Closed-book2025.0941.6
NucleusModel=Gemma 3 (4B), Setting=Closed-book2025.0941.2
DoLAModel=Gemma 3 (4B), Setting=Closed-book2025.0940.8