Simulator selection on COVID-19
1.65Top-1 RegretMechSim
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MechSimLLM Backbone=Qwen3-235B2026.06 | 1.65 | 1.68 | |
| MechSimLLM=Qwen3-235B2026.06 | 1.65 | 1.68 | |
| Graph of ThoughtsLLM Backbone=Qwen3-235B2026.06 | 1.76 | 1.7 | |
| GoTLLM=Qwen3-235B2026.06 | 1.76 | 1.7 | |
| Logic-LMLLM Backbone=Qwen3-235B2026.06 | 1.78 | 1.85 | |
| Logic-LMLLM=Qwen3-235B2026.06 | 1.78 | 1.85 | |
| Causal-CopilotLLM Backbone=Qwen3-235B2026.06 | 1.79 | 1.7 | |
| Causal-CopilotLLM=Qwen3-235B2026.06 | 1.79 | 1.7 | |
| MechSimLLM Backbone=Claude Sonnet 4.62026.06 | 2.04 | 2.29 | |
| MechSimLLM=Claude Sonnet 4.62026.06 | 2.04 | 2.29 | |
| MechSimLLM Backbone=DeepSeek V3.22026.06 | 2.16 | 2.11 | |
| MechSimLLM=DeepSeek V32026.06 | 2.16 | 2.11 | |
| Causal-CopilotLLM Backbone=DeepSeek V3.22026.06 | 2.38 | 2.1 | |
| Causal-CopilotLLM=DeepSeek V32026.06 | 2.38 | 2.1 | |
| Graph of ThoughtsLLM Backbone=DeepSeek V3.22026.06 | 2.47 | 2.18 | |
| GoTLLM=DeepSeek V32026.06 | 2.47 | 2.18 | |
| Causal-CopilotLLM Backbone=Claude Sonnet 4.62026.06 | 2.59 | 2.6 | |
| Causal-CopilotLLM=Claude Sonnet 4.62026.06 | 2.59 | 2.6 | |
| Logic-LMLLM Backbone=DeepSeek V3.22026.06 | 2.7 | 2.14 | |
| Logic-LMLLM=DeepSeek V32026.06 | 2.7 | 2.14 | |
| Graph of ThoughtsLLM Backbone=Claude Sonnet 4.62026.06 | 3.8 | 2.53 | |
| GoTLLM=Claude Sonnet 4.62026.06 | 3.8 | 2.53 | |
| Logic-LMLLM Backbone=Claude Sonnet 4.62026.06 | 3.91 | 2.41 | |
| Logic-LMLLM=Claude Sonnet 4.62026.06 | 3.91 | 2.41 |