Relation Extraction on TACRED One-shot
32.45PrecisionSemantic Rule Matcher
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| Semantic Rule MatcherMethod Category=Baseline2025.10 | 32.45 | 19.72 | 24.52 | |
| COGREBackbone=Qwen2.5-14B-Instruct, RL Training=None2025.10 | 29.49 | 28.05 | 28.75 | |
| COGRE After RLBackbone=Phi-4, Reward Type=Acc2025.10 | 26.9 | 47.56 | 34.36 | |
| COGRE After RLBackbone=Phi-4, Reward Type=HIT@DICT + Acc2025.10 | 26.88 | 60.98 | 37.31 | |
| COGRE After RLBackbone=Qwen2.5-14B-Instruct, Reward Type=Acc2025.10 | 26.83 | 40.24 | 32.2 | |
| COGREBackbone=Phi-4, RL Training=None2025.10 | 22.53 | 50 | 31.06 | |
| COGRE After RLBackbone=Qwen2.5-14B-Instruct, Reward Type=HIT@DICT + Acc2025.10 | 22.08 | 62.2 | 32.58 | |
| Direct MatchingBackbone=Qwen2.5-14B-Instruct2025.10 | 13.33 | 2.44 | 4.12 | |
| Simple ReasoningBackbone=Phi-42025.10 | 5.69 | 58.54 | 10.38 | |
| Simple ReasoningBackbone=Qwen2.5-14B-Instruct2025.10 | 5.67 | 34.15 | 9.72 | |
| Direct MatchingBackbone=Phi-42025.10 | 5.43 | 26.83 | 9.03 | |
| SUMASKBackbone=Phi-42025.10 | 4.44 | 31.71 | 7.78 |