List your company
ResearchFormerly WizWand

Question Answering on LLAMA 1

88AccuracyFrontier
32.56846.95961.3575.741Nov 10, 2025
Updated 4mo ago

Evaluation results

MethodLinks
FrontierModel=Claude Opus 4.72025.1188—
ReasonerModel=Gemini 3.1 Pro2025.1187—
FrontierModel=Gemini 3.1 Pro2025.1186.3—
ReasonerModel=GPT-5.52025.1186.3—
ConvFillBase Model=SmolLM2 1.7B, Talker=GPT-5.52025.118698.5
ReasonerModel=Claude Opus 4.72025.1185.7—
ConvFillBase Model=SmolLM2 135M, Talker=Gemini 3.1 Pro2025.1185.797.7
ConvFillBase Model=Qwen3 0.6B, Talker=Gemini 3.1 Pro2025.1185.797.3
ConvFillBase Model=Gemma 3 1B, Talker=Claude Opus 4.72025.1185.797.3
ConvFillBase Model=SmolLM2 360M, Talker=Gemini 3.1 Pro2025.1185.397.7
FrontierModel=GPT-5.52025.1185—
ConvFillBase Model=SmolLM2 360M, Talker=GPT-5.52025.118597.7
ConvFillBase Model=SmolLM2 1.7B, Talker=Claude Opus 4.72025.118597.7
ConvFillBase Model=Qwen3 0.6B, Talker=Claude Opus 4.72025.1184.796.9
ConvFillBase Model=Gemma 3 1B, Talker=GPT-5.52025.1184.796.9
ConvFillBase Model=Gemma 3 1B, Talker=Gemini 3.1 Pro2025.1184.796.2
ConvFillBase Model=Llama 3.2 1B, Talker=Claude Opus 4.72025.1184.796.9
ConvFillBase Model=SmolLM2 1.7B, Talker=Gemini 3.1 Pro2025.1184.796.2
ConvFillBase Model=SmolLM2 360M, Talker=Claude Opus 4.72025.1184.397.7
ConvFillBase Model=Qwen3 0.6B, Talker=GPT-5.52025.118496.1
ConvFillBase Model=Llama 3.2 1B, Talker=Gemini 3.1 Pro2025.118495.8
ConvFillBase Model=SmolLM2 135M, Talker=Claude Opus 4.72025.1183.795.7
ConvFillBase Model=Llama 3.2 1B, Talker=GPT-5.52025.1183.395.4
ConvFillBase Model=SmolLM2 135M, Talker=GPT-5.52025.1182.795.4
ConvFillBase Model=Gemma 3 270M, Talker=Gemini 3.1 Pro2025.1181.792.7
ConvFillBase Model=Gemma 3 270M, Talker=GPT-5.52025.1181.393.1
ConvFillBase Model=Gemma 3 270M, Talker=Claude Opus 4.72025.1180.791.4
Base SLMModel=Llama 3.2 1B2025.1172—
Base SLMModel=SmolLM2 1.7B2025.1172—
Base SLMModel=Gemma 3 1B2025.1163—
Base SLMModel=SmolLM2 360M2025.1151.3—
Base SLMModel=Qwen3 0.6B2025.1141.3—
Base SLMModel=Gemma 3 270M2025.1140.7—
Base SLMModel=SmolLM2 135M2025.1134.7—