Relation Extraction on NYT29 One-shot
0.6334PrecisionCOGRE After RL
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| COGRE After RLBackbone=Qwen2.5-14B-Instruct, Reward Type=HIT@DICT + Acc2025.10 | 0.6334 | 0.3878 | 0.4811 | |
| Direct MatchingBackbone=Qwen2.5-14B-Instruct2025.10 | 0.4873 | 0.1363 | 0.2131 | |
| COGRE After RLBackbone=Phi-4, Reward Type=HIT@DICT + Acc2025.10 | 0.4514 | 0.4489 | 0.4501 | |
| COGRE After RLBackbone=Qwen2.5-14B-Instruct, Reward Type=Acc2025.10 | 0.2617 | 0.294 | 0.2769 | |
| Semantic Rule MatcherMethod Category=Baseline2025.10 | 0.2223 | 0.1345 | 0.1676 | |
| COGRE After RLBackbone=Phi-4, Reward Type=Acc2025.10 | 0.2045 | 0.4 | 0.4102 | |
| COGREBackbone=Qwen2.5-14B-Instruct, RL Training=None2025.10 | 0.2018 | 0.3167 | 0.2465 | |
| COGREBackbone=Phi-4, RL Training=None2025.10 | 0.1203 | 0.3068 | 0.1728 | |
| Simple ReasoningBackbone=Qwen2.5-14B-Instruct2025.10 | 0.1185 | 0.3423 | 0.1761 | |
| SUMASKBackbone=Phi-42025.10 | 0.1096 | 0.2613 | 0.1544 | |
| Direct MatchingBackbone=Phi-42025.10 | 0.0904 | 0.2315 | 0.13 | |
| Simple ReasoningBackbone=Phi-42025.10 | 0.0871 | 0.3068 | 0.1357 |