List your company
ResearchFormerly WizWand

Question Answering on SimpleQA (Accuracy, Conditional Accuracy)

73.1AccuracyFrontier
-2.50817.12136.7556.379Nov 10, 2025
Updated 4mo ago

Evaluation results

MethodLinks
FrontierModel=Gemini 3.1 Pro2025.1173.1—
ReasonerModel=Gemini 3.1 Pro2025.1165.7—
ConvFillBase Model=SmolLM2 1.7B, Talker=Gemini 3.1 Pro2025.1165.198.6
ConvFillBase Model=Qwen3 0.6B, Talker=Gemini 3.1 Pro2025.1164.898.5
ConvFillBase Model=Gemma 3 1B, Talker=Gemini 3.1 Pro2025.1164.397.6
ConvFillBase Model=Llama 3.2 1B, Talker=Gemini 3.1 Pro2025.1163.796.5
ConvFillBase Model=SmolLM2 360M, Talker=Gemini 3.1 Pro2025.1162.894.8
FrontierModel=GPT-5.52025.1162.7—
ConvFillBase Model=Gemma 3 270M, Talker=Gemini 3.1 Pro2025.1161.993.6
ReasonerModel=GPT-5.52025.1161.3—
ConvFillBase Model=SmolLM2 1.7B, Talker=GPT-5.52025.116198.7
ConvFillBase Model=SmolLM2 135M, Talker=Gemini 3.1 Pro2025.1160.791.9
ConvFillBase Model=Qwen3 0.6B, Talker=GPT-5.52025.1160.397.6
ConvFillBase Model=Gemma 3 1B, Talker=GPT-5.52025.1159.596.2
ConvFillBase Model=SmolLM2 360M, Talker=GPT-5.52025.1157.793.3
ConvFillBase Model=Llama 3.2 1B, Talker=GPT-5.52025.1157.793.5
ConvFillBase Model=Gemma 3 270M, Talker=GPT-5.52025.1156.691.2
ConvFillBase Model=SmolLM2 135M, Talker=GPT-5.52025.1155.289.1
FrontierModel=Claude Opus 4.72025.1144.9—
ReasonerModel=Claude Opus 4.72025.1142.9—
ConvFillBase Model=SmolLM2 1.7B, Talker=Claude Opus 4.72025.1142.597.2
ConvFillBase Model=Qwen3 0.6B, Talker=Claude Opus 4.72025.1142.497.2
ConvFillBase Model=Gemma 3 1B, Talker=Claude Opus 4.72025.1141.596
ConvFillBase Model=Llama 3.2 1B, Talker=Claude Opus 4.72025.1141.394.9
ConvFillBase Model=SmolLM2 360M, Talker=Claude Opus 4.72025.1141.294.2
ConvFillBase Model=Gemma 3 270M, Talker=Claude Opus 4.72025.1140.693
ConvFillBase Model=SmolLM2 135M, Talker=Claude Opus 4.72025.113887.4
Base SLMModel=SmolLM2 1.7B2025.112.5—
Base SLMModel=Gemma 3 1B2025.112.2—
Base SLMModel=Qwen3 0.6B2025.111.4—
Base SLMModel=SmolLM2 360M2025.111.3—
Base SLMModel=Gemma 3 270M2025.110.9—
Base SLMModel=Llama 3.2 1B2025.110.5—
Base SLMModel=SmolLM2 135M2025.110.4—