System-level data generation on LOB
1.242MarginalDS-Agent
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| DS-AgentLLM Backbone=Claude2026.05 | 1.242 | 0.352 | 0.273 | 0.321 | 100 | |
| DS-AgentLLM Backbone=Nova2026.05 | 1.2 | 0.305 | 0.271 | 0.326 | 20 | |
| DS-AgentLLM Backbone=GPT-5.42026.05 | 1.187 | 0.646 | 0.492 | 0.333 | 60 | |
| TS-AgentLLM Backbone=GPT-5.42026.05 | 1.18 | 0.472 | 0.477 | 0.332 | 100 | |
| DS-AgentLLM Backbone=GPT-4o2026.05 | 1.167 | 0.308 | 0.317 | 0.328 | 40 | |
| Optuna2026.05 | 0.824 | 0.711 | 0.527 | 0.21 | 100 | |
| TS-AgentLLM Backbone=Nova2026.05 | 0.822 | 0.233 | 0.254 | 0.221 | 100 | |
| ResearchAgentLLM Backbone=Claude2026.05 | 0.814 | 0.138 | 0.244 | 0.136 | 100 | |
| ResearchAgentLLM Backbone=GPT-5.42026.05 | 0.802 | 0.632 | 0.611 | 0.34 | 80 | |
| TS-AgentLLM Backbone=Claude2026.05 | 0.767 | 0.235 | 0.215 | 0.234 | 100 | |
| TS-AgentLLM Backbone=GPT-4o2026.05 | 0.713 | 0.243 | 0.234 | 0.234 | 100 | |
| MOSAICLLM Backbone=Nova2026.05 | 0.626 | 0.239 | 0.228 | 0.192 | 100 | |
| ResearchAgentLLM Backbone=GPT-4o2026.05 | 0.619 | 0.241 | 0.24 | 0.239 | 80 | |
| ResearchAgentLLM Backbone=Nova2026.05 | 0.617 | 0.243 | 0.243 | 0.341 | 20 | |
| MOSAICLLM Backbone=GPT-4o2026.05 | 0.59 | 0.216 | 0.199 | 0.181 | 100 | |
| MOSAICLLM Backbone=GPT-5.42026.05 | 0.579 | 0.182 | 0.247 | 0.177 | 100 | |
| MOSAICLLM Backbone=Claude2026.05 | 0.554 | 0.225 | 0.193 | 0.188 | 100 |