Causal Variable Identification on COCO
73.6F1 (X)Llama4-M
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Llama4-MSetting=Decompositional Framework, Model Variant=Llama-4-Maverick-17B-128E2025.05 | 73.6 | 71.7 | 67.4 | 73.5 | |
| GPT-o4Setting=Decompositional Framework, Model Variant=GPT-o4-mini-high2025.05 | 73.2 | 71.1 | 68 | 74.4 | |
| GPT-5Setting=Decompositional Framework2025.05 | 72.8 | 70.2 | 67.3 | 73.4 | |
| Llama4-SSetting=Decompositional Framework, Model Variant=Llama-4-Scout-17B2025.05 | 72.5 | 70.8 | 66.2 | 72.1 | |
| Qwen3Setting=Decompositional Framework, Model Variant=Qwen3-VL-235B-A22B Thinking2025.05 | 67.2 | 65.4 | 54.2 | 61.8 | |
| DeepSeekSetting=Decompositional Framework, Model Variant=DeepSeek-VL2025.05 | 65.9 | 63.2 | 55.7 | 62.6 | |
| Gemini2.5Setting=Decompositional Framework, Model Variant=Gemini2.5-Pro2025.05 | 62.6 | 60.9 | 52.8 | 58.3 |