Probabilistic Forecasting on Prophet-Arena Weekly Performance Comparison
0.17W1Qwen Deep Research
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Qwen Deep ResearchFoundation Model=GPT-4.1-mini2026.02 | 0.17 | 0.22 | 0.23 | 0.15 | 0.22 | 0.22 | 0.21 | 0.19 | 0.2 | 0.13 | 0.2 | |
| GPT-4.1-miniFoundation Model=GPT-4.1-mini2026.02 | 0.18 | 0.2 | 0.31 | 0.18 | 0.24 | 0.26 | 0.23 | 0.25 | 0.23 | 0.15 | 0.22 | |
| Live-Evo (w/o Experience)Foundation Model=GPT-4.1-mini, evolution=false2026.02 | 0.18 | 0.24 | 0.2 | 0.13 | 0.27 | 0.19 | 0.22 | 0.22 | 0.13 | 0.11 | 0.19 | |
| ReMemFoundation Model=GPT-4.1-mini2026.02 | 0.19 | 0.23 | 0.14 | 0.11 | 0.21 | 0.18 | 0.19 | 0.17 | 0.15 | 0.11 | 0.16 | |
| Live-EvoFoundation Model=GPT-4.1-mini2026.02 | 0.19 | 0.17 | 0.16 | 0.1 | 0.17 | 0.12 | 0.19 | 0.15 | 0.13 | 0.1 | 0.14 | |
| MiroFlowFoundation Model=GPT-4.1-mini2026.02 | 0.28 | 0.08 | 0.53 | 0.44 | 0.4 | 0.43 | 0.27 | 0.33 | 0.26 | 0.22 | 0.32 |