Relation Extraction on COAE2016 and SKE2020 (test)
54.26COAE2016 PerformanceSCIR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SCIRBackbone=LLama3.12025.12 | 54.26 | 67.68 | 60.97 | |
| SCIRBackbone=DeepSeek-R12025.12 | 52.45 | 74.48 | 63.47 | |
| SCIRBackbone=OneKE2025.12 | 51.05 | 73.81 | 62.43 | |
| OneKEType=Domain-specific model2025.12 | 49.83 | 72.61 | 61.22 | |
| ChunkUIEType=Domain-specific model2025.12 | 48.2 | 70.91 | 59.56 | |
| SCIRBackbone=Qwen32025.12 | 46.96 | 66.51 | 56.74 | |
| IEPile-LLama2Type=Domain-specific model2025.12 | 46.7 | 72.18 | 59.44 | |
| DeepSeek-R1Type=Untuned LLM2025.12 | 32.69 | 45.32 | 39 | |
| LLama3.1Type=Untuned LLM2025.12 | 28.66 | 34.74 | 31.7 | |
| Qwen3Type=Untuned LLM2025.12 | 25.49 | 36.73 | 31.11 | |
| YAYI-UIEType=Domain-specific model2025.12 | 19.97 | 70.8 | 45.39 |