Information Retrieval on WideSearch 2025
67.81Item F1 Avg@4A-MAPREDUCE
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| A-MAPREDUCEBackbone=GPT-5-mini2026.02 | 67.81 | 75.03 | 45.23 | 56.24 | 7.5 | 12 | |
| MASBackbone=Claude Sonnet 4, Thinking Mode=Thinking2026.02 | 62.17 | 73.13 | 38.49 | 52.19 | 3.62 | 6.5 | |
| MASBackbone=Kimi K22026.02 | 61.15 | 70.72 | 36.22 | 49.6 | 3 | 6.5 | |
| Gemini 2.5 ProSystem Category=End-to-End System2026.02 | 59.05 | 67.17 | 36.63 | 45.41 | 4.25 | 8 | |
| Claude Sonnet 4System Category=Single Agent, Thinking Mode=Thinking2026.02 | 57.89 | 66.73 | 31.69 | 41.9 | 2.25 | 5 | |
| MASBackbone=Gemini 2.5 Pro2026.02 | 57.42 | 66.31 | 33.47 | 44.64 | 2 | 6.5 | |
| MASBackbone=OpenAI o32026.02 | 57.31 | 68.93 | 37.8 | 50.52 | 5.12 | 9.5 | |
| Flash-searcherBackbone=GPT-5-mini2026.02 | 54.99 | 67.49 | 34.42 | 47.18 | 6.4 | 10 | |
| MASBackbone=Doubao-Seed-1.6, Thinking Mode=Thinking2026.02 | 54.59 | 69.65 | 33.98 | 48.93 | 2.5 | 5.5 | |
| Kimi K2System Category=Single Agent2026.02 | 54.36 | 65.08 | 29.67 | 41.35 | 1.12 | 3.5 | |
| MASBackbone=Doubao-Seed-1.6, Thinking Mode=Non-Thinking2026.02 | 52.75 | 65.13 | 29.65 | 42.65 | 2.12 | 4.5 | |
| OpenAI o3-highSystem Category=Single Agent2026.02 | 52.61 | 62.27 | 34 | 44.07 | 4.5 | 9 | |
| SmolagentsBackbone=GPT-5-mini2026.02 | 51.31 | 57.68 | 23.04 | 30.57 | 4 | 5 | |
| Gemini 2.5 ProSystem Category=Single Agent2026.02 | 50.98 | 63.62 | 30 | 41.39 | 1.5 | 5 | |
| Doubao-Seed-1.6System Category=Single Agent, Thinking Mode=Non-Thinking2026.02 | 48.97 | 61.98 | 27.21 | 39.86 | 1 | 3.5 | |
| Claude Sonnet 4System Category=End-to-End System, Thinking Mode=Thinking2026.02 | 48.4 | 58.47 | 24.11 | 33.49 | 2.5 | 5 | |
| Doubao-Seed-1.6System Category=Single Agent, Thinking Mode=Thinking2026.02 | 48.27 | 63.86 | 29.9 | 44.12 | 2.63 | 5 | |
| OpenAI o3System Category=End-to-End System2026.02 | 45.52 | 56.49 | 23.91 | 36.03 | 3 | 5.5 | |
| MASBackbone=DeepSeek-R12026.02 | 44.28 | 60.34 | 22.87 | 36.59 | 0.75 | 3 | |
| DeepSeek-R1System Category=Single Agent2026.02 | 41.26 | 55.09 | 20.66 | 31.69 | 0.37 | 1.5 |