Relational Fact Extraction on WebNLG (test)
77Partial PrecisionKRPO
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| KRPOLLM=Deepseek-V32026.01 | 77 | — | — | — | 77.5 | 77.1 | 74.1 | 74.6 | 74.3 | 75 | 75.4 | 75.2 | |
| KRPOLLM=GPT-52026.01 | 77 | — | — | — | 79.2 | 77.7 | 71.5 | 73 | 72 | 73.6 | 75.2 | 74.2 | |
| EDCLLM=Deepseek-V32026.01 | 75.6 | — | — | — | 78.5 | 76.7 | 69.2 | 71.2 | 70 | 71.9 | 73.9 | 72.7 | |
| REGEN2026.01 | 75.5 | — | — | — | 78.8 | 76.7 | 71.3 | 73.5 | 72 | 71.4 | 73.8 | 72.3 | |
| KRPOLLM=Qwen3-32B2026.01 | 74.3 | — | — | — | 75.6 | 74.7 | 69.7 | 70.7 | 70.1 | 71.5 | 72.4 | 71.8 | |
| KRPOLLM=GPT-4o-mini2026.01 | 73.9 | — | — | — | 75.5 | 74.4 | 68.6 | 69.7 | 69 | 70.8 | 71.9 | 71.2 | |
| EDCLLM=GPT-52026.01 | 73.4 | — | — | — | 77.2 | 74.8 | 68.2 | 70.7 | 69.1 | 69.9 | 72.6 | 70.9 | |
| KRPOLLM=Mistral-7B2026.01 | 70 | — | — | — | 71.7 | 70.6 | 65 | 66.2 | 65.4 | 66.8 | 68 | 67.2 | |
| EDCLLM=GPT-4o-mini2026.01 | 69.5 | — | — | — | 73.3 | 70.8 | 62.5 | 65 | 63.4 | 65 | 67.7 | 66 | |
| EDCLLM=Qwen3-32B2026.01 | 65.4 | — | — | — | 70.4 | 67.2 | 58 | 61.4 | 59.2 | 60.2 | 63.7 | 61.4 | |
| EDCLLM=Mistral-7B2026.01 | 62.4 | — | — | — | 67.2 | 64.1 | 54.8 | 58.3 | 56.1 | 57.4 | 60.9 | 58.7 | |
| CasRelCategory=Adjacency List (Partially)2021.06 | — | 93.4 | 90.1 | 91.8 | — | — | — | — | — | — | — | — | |
| CopyRE_mulCategory=Edge List2021.06 | — | 37.7 | 36.4 | 37.1 | — | — | — | — | — | — | — | — | |
| CopyRE_oneCategory=Edge List2021.06 | — | 32.2 | 28.9 | 30.5 | — | — | — | — | — | — | — | — | |
| CopyRLCategory=Edge List2021.06 | — | 63.3 | 59.9 | 61.6 | — | — | — | — | — | — | — | — | |
| DIRECTCategory=Adjacency List (Fully)2021.06 | — | 93.6 | 92.7 | 93.2 | — | — | — | — | — | — | — | — | |
| GraphRel_1pCategory=Adjacency Matrices2021.06 | — | 42.3 | 39.2 | 40.7 | — | — | — | — | — | — | — | — | |
| GraphRel_2pCategory=Adjacency Matrices2021.06 | — | 44.7 | 41.1 | 42.9 | — | — | — | — | — | — | — | — | |
| NovelTaggingCategory=Edge List2021.06 | — | 52.5 | 19.3 | 28.3 | — | — | — | — | — | — | — | — |