List your company
ResearchFormerly WizWand

Short-form Question Answering on SimpleQA

7.9ECEDINCO
6.02818.66431.343.936Sep 29, 2025
Updated 8mo ago

Evaluation results

MethodLinks
DINCOModel=Gemini-2.5-Flash, Logit access=Black-box2025.097.919.969.7
DINCOModel=Gemini-2.5-Flash, Logit access=White-box2025.098.817.476.2
DINCOModel=GPT-4.1, Logit access=White-box2025.098.918.378.6
MSPModel=Gemini-2.5-Flash, Logit access=White-box2025.099.817.777.3
NVCModel=Gemini-2.5-Flash, Logit access=White-box2025.0910.519.966.2
DINCOModel=GPT-4.1, Logit access=Black-box2025.0916.125.160.5
NVCModel=GPT-4.1, Logit access=White-box2025.0916.422.272.9
SCModel=Gemini-2.5-Flash, Logit access=White-box2025.091721.274.8
SC-VCModel=Gemini-2.5-Flash, Logit access=White-box2025.0918.622.175.5
NVCModel=Gemini-2.5-Flash, Logit access=Black-box2025.0920.826.259.5
NVCModel=GPT-4.1, Logit access=Black-box2025.0921.32760.7
SCModel=GPT-4.1, Logit access=White-box2025.092225.275
SC-VCModel=GPT-4.1, Logit access=White-box2025.0922.325.276.1
MSPModel=GPT-4.1, Logit access=White-box2025.0926.325.580
K-VCModel=GPT-4.1, Logit access=White-box2025.0933.833.763.2
VCModel=Gemini-2.5-Flash, Logit access=White-box2025.0940.939.361.7
K-VCModel=Gemini-2.5-Flash, Logit access=White-box2025.0953.551.156.6
VCModel=GPT-4.1, Logit access=White-box2025.0954.754.964.4