Causal Variable Identification on Open-Critic
71.7F1 (X)GPT-5
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| GPT-5Setting=Decompositional Framework2025.05 | 71.7 | 69.4 | 66.3 | 70.6 | |
| GPT-o4Setting=Decompositional Framework, Model Variant=GPT-o4-mini-high2025.05 | 70.1 | 67.3 | 64.1 | 68.9 | |
| Llama4-MSetting=Decompositional Framework, Model Variant=Llama-4-Maverick-17B-128E2025.05 | 67.6 | 65.8 | 65.6 | 70 | |
| Llama4-SSetting=Decompositional Framework, Model Variant=Llama-4-Scout-17B2025.05 | 66.5 | 64.7 | 64.7 | 69 | |
| Qwen3Setting=Decompositional Framework, Model Variant=Qwen3-VL-235B-A22B Thinking2025.05 | 61.8 | 59.7 | 49.7 | 57.2 | |
| DeepSeekSetting=Decompositional Framework, Model Variant=DeepSeek-VL2025.05 | 60.4 | 58.1 | 51.3 | 58.7 | |
| Gemini2.5Setting=Decompositional Framework, Model Variant=Gemini2.5-Pro2025.05 | 57.3 | 55.9 | 47.3 | 54.8 |