Structural Graph Extraction on EmpiriGraph-Psy (test)
76.7PrecisionGPT-5.2 + GPT-5.4
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-5.2 + GPT-5.4Prompting Strategy=Staged Pipeline, Reasoning Level=low, Verbosity=low2026.06 | 76.7 | 77.1 | 73.6 | |
| Deepseek V4 ProPrompting Strategy=Staged Pipeline, Reasoning Level=low, Verbosity=low2026.06 | 75.7 | 61.9 | 64.1 | |
| GPT-5.4Prompting Strategy=Staged Pipeline, Reasoning Level=low, Verbosity=low2026.06 | 75.4 | 71.4 | 69.4 | |
| GPT-4oPrompting Strategy=Staged Pipeline, Reasoning Level=low, Verbosity=low2026.06 | 73.8 | 50.8 | 55.1 | |
| GPT-5.2Prompting Strategy=Staged Pipeline, Reasoning Level=low, Verbosity=low2026.06 | 70 | 72.6 | 67.9 | |
| Claude Opus 4.7Prompting Strategy=Staged Pipeline, Reasoning Level=low, Verbosity=low2026.06 | 70 | 65.1 | 63.5 | |
| GPT-5.4 (Single Step CoT)Prompting Strategy=Single Step CoT, Reasoning Level=low, Verbosity=low2026.06 | 69.1 | 69.8 | 65.8 | |
| Claude Sonnet 4.6Prompting Strategy=Staged Pipeline, Reasoning Level=low, Verbosity=low2026.06 | 66 | 73.6 | 65.2 | |
| GPT-5.4 (Direct Prompt)Prompting Strategy=Direct Prompt, Reasoning Level=low, Verbosity=low2026.06 | 56.6 | 60.6 | 52.8 | |
| Gemini 3 FlashPrompting Strategy=Staged Pipeline, Reasoning Level=low, Verbosity=low2026.06 | 53.6 | 78.2 | 59.8 |