Constraint Extraction on 720 gold constraints (test)
98.4PrecisionLLM+DPO
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| LLM+DPOtraining=DPO2026.06 | 98.4 | 99.7 | 99 | 2 | |
| LLMtraining=SFT-only2026.06 | 94.7 | 86.9 | 90.7 | 94 | |
| SRL-based2026.06 | 60.3 | 43.6 | 50.6 | 403 | |
| OpenIE-based2026.06 | 46.5 | 69.9 | 55.9 | 215 | |
| spaCy-based2026.06 | 40.6 | 52.4 | 45.8 | 340 |