Event Extraction on CCF Law and FewFC (test)
67.01CCF Law ScoreSCIR
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| SCIRBackbone=OneKE2025.12 | 67.01 | 85.1 | 76.05 | |
| SCIRBackbone=Qwen32025.12 | 65.86 | 77.42 | 71.64 | |
| SCIRBackbone=DeepSeek-R12025.12 | 62.45 | 68.2 | 65.32 | |
| OneKEType=Domain-specific model2025.12 | 62.19 | 80.11 | 71.15 | |
| ChunkUIEType=Domain-specific model2025.12 | 61.41 | 79.75 | 70.58 | |
| SCIRBackbone=LLama3.12025.12 | 60.99 | 63.75 | 62.37 | |
| IEPile-LLama2Type=Domain-specific model, Backbone=LLaMA2-13B2025.12 | 59.9 | 70.1 | 65 | |
| DeepSeek-R1Type=Untuned LLM, Base Model=DeepSeek-R1-Distill-Qwen3-8B2025.12 | 38.79 | 40.81 | 39.8 | |
| Qwen3Type=Untuned LLM, Parameters=8B2025.12 | 34.99 | 41.29 | 38.14 | |
| LLama3.1Type=Untuned LLM, Parameters=8B2025.12 | 31.57 | 32.52 | 32.05 | |
| YAYI-UIEType=Domain-specific model2025.12 | 12.87 | 81.28 | 47.08 |