Causal Discovery on AutoMPG
88F1 ScoreMATMCD
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MATMCDLLM=GPT-4o mini, Top-K Guess Reasoning=K=12024.12 | 88 | 100 | 0 | 1 | 0.04 | |
| MATMCD (MAS)Time (s)=1852, Cost ($)=2.792026.04 | 73.7 | — | — | — | — | |
| MAS CompilerTime (s)=149, Cost ($)=1.462026.04 | 69.7 | — | — | — | — | |
| Claude Code RawTime (s)=186, Cost ($)=2.222026.04 | 67 | — | — | — | — | |
| SCD-LLMLLM=GPT-4o mini2024.12 | 66 | 57 | 15 | 3 | 0.12 | |
| LLM-KBCILLM=GPT-4o mini2024.12 | 66 | 57 | 15 | 3 | 0.12 | |
| MATMCD-RELLM=GPT-4o mini, Top-K Guess Reasoning=K=22024.12 | 66 | 57 | 15 | 3 | 0.12 | |
| Auto Opt. (Ours)Time (s)=169, Cost ($)=2.32, Description=Stage 2 result after automatic skill iteration2026.04 | 65.2 | — | — | — | — | |
| Adaptive Skill (Ours)Time (s)=137, Cost ($)=1.772026.04 | 63.2 | — | — | — | — | |
| LLM-KBCI-RELLM=GPT-4o mini, Top-K Guess Reasoning=K=22024.12 | 61 | 50 | 20 | 4 | 0.16 | |
| LLM-KBCI-RALLM=GPT-4o mini, Framework=ReAct2024.12 | 55 | 57 | 15 | 3 | 0.12 | |
| ReActLLM=GPT-4o mini2024.12 | 54 | 50 | 15 | 4 | 0.16 | |
| Efficient-CDLMsLLM=GPT-4o mini2024.12 | 50 | 66 | 5 | 4 | 0.16 | |
| Exact Search2024.12 | 30 | 25 | 30 | 6 | 0.24 | |
| PC2024.12 | 14 | 11 | 40 | 8 | 0.32 | |
| DirectLiNGAM2024.12 | 14 | 11 | 40 | 8 | 0.32 | |
| MAC2024.12 | — | — | — | 4 | 0.16 |