Action Selection on AdaptSim
66.5Win RateBaseCRS (GPT-4o-mini) VS BaseCRS (3.5-turbo)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| BaseCRS (GPT-4o-mini) VS BaseCRS (3.5-turbo)Simulator Backbone=GPT-4.1-mini2026.06 | 66.5 | 27.2 | 6.2 | |
| BaseCRS (GPT-4o-mini) VS BaseCRS (3.5-turbo)Simulator Backbone=GPT-4.1-mini2026.06 | 65 | 27.5 | 7.5 | |
| BaseCRS (GPT-4o-mini) VS BaseCRS (3.5-turbo)Simulator Backbone=Qwen3-8B2026.06 | 64.8 | 24.8 | 10.5 | |
| BaseCRS (GPT-4o-mini) VS BaseCRS (3.5-turbo)Simulator Backbone=Qwen3-8B2026.06 | 63.8 | 28.2 | 8 | |
| BaseCRS (GPT-4o-mini) VS AgentCRS (GPT-4o-mini)Simulator Backbone=Qwen3-8B2026.06 | 61.5 | 28 | 10.5 | |
| BaseCRS (GPT-4o-mini) VS BaseCRS (3.5-turbo)Simulator Backbone=GPT-4o-mini2026.06 | 59.8 | 29.6 | 10.6 | |
| AgentCRS (GPT-4o-mini) VS AgentCRS (GPT-3.5-turbo)Simulator Backbone=GPT-4.1-mini2026.06 | 59 | 22.8 | 18.2 | |
| AgentCRS (GPT-4o-mini) VS AgentCRS (GPT-3.5-turbo)Simulator Backbone=GPT-4.1-mini2026.06 | 57.5 | 23.5 | 19 | |
| BaseCRS (GPT-4o-mini) VS BaseCRS (3.5-turbo)Simulator Backbone=GPT-4o-mini2026.06 | 57 | 33 | 10 | |
| BaseCRS (GPT-4o-mini) VS AgentCRS (GPT-4o-mini)Simulator Backbone=Qwen3-8B2026.06 | 56.8 | 27 | 16.2 | |
| BaseCRS (GPT-4o-mini) VS AgentCRS (GPT-4o-mini)Simulator Backbone=GPT-4o-mini2026.06 | 52.5 | 37.5 | 10 | |
| AgentCRS (GPT-4o-mini) VS AgentCRS (GPT-3.5-turbo)Simulator Backbone=GPT-4o-mini2026.06 | 52.5 | 22.2 | 25.2 | |
| AgentCRS (GPT-4o-mini) VS AgentCRS (GPT-3.5-turbo)Simulator Backbone=GPT-4o-mini2026.06 | 52.2 | 26 | 21.8 | |
| AgentCRS (GPT-4o-mini) VS AgentCRS (GPT-3.5-turbo)Simulator Backbone=Qwen3-8B2026.06 | 51.5 | 22.8 | 25.8 | |
| AgentCRS (GPT-4o-mini) VS AgentCRS (GPT-3.5-turbo)Simulator Backbone=Qwen3-8B2026.06 | 50.8 | 23.2 | 26 | |
| BaseCRS (GPT-4o-mini) VS AgentCRS (GPT-4o-mini)Simulator Backbone=GPT-4o-mini2026.06 | 48.5 | 35.5 | 16 | |
| BaseCRS (GPT-4o-mini) VS AgentCRS (GPT-4o-mini)Simulator Backbone=GPT-4.1-mini2026.06 | 43.5 | 38.2 | 18.2 | |
| BaseCRS (GPT-4o-mini) VS AgentCRS (GPT-4o-mini)Simulator Backbone=GPT-4.1-mini2026.06 | 40.5 | 47.5 | 12 |