Web-based Question Answering on WebQA (200 held-out questions)
62.7AccuracyMAGE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MAGEBackbone=Qwen3-8B, Judge=Claude Sonnet 4.6, MAGE Executor Model=Opus2026.05 | 62.7 | 7.7 | |
| MAGEBackbone=Qwen3-8B, Judge=Claude Sonnet 4.6, MAGE Executor Model=Sonnet2026.05 | 59.6 | 7.7 | |
| 0-shot CoTBackbone=Qwen3-8B, Judge=Claude Sonnet 4.6, Prompting Scaffold=0-shot CoT2026.05 | 55 | — | |
| SC10Backbone=Qwen3-8B, Judge=Claude Sonnet 4.6, Prompting Scaffold=SC10, Samples=102026.05 | 46.5 | — | |
| 8-shotBackbone=Qwen3-8B, Judge=Claude Sonnet 4.6, Prompting Scaffold=8-shot2026.05 | 42 | — | |
| ReActBackbone=Qwen3-8B, Judge=Claude Sonnet 4.6, Prompting Scaffold=ReAct2026.05 | 35.5 | — | |
| ReflexionBackbone=Qwen3-8B, Judge=Claude Sonnet 4.6, Prompting Scaffold=Reflexion2026.05 | 34.5 | — |