Relation Extraction on ADE
83.9Relation Strict F1ALBERT XXL (Avg. Aggr.), PFN
Evaluation results
| Method | Links | |
|---|---|---|
| ALBERT XXL (Avg. Aggr.), PFNBackbone=ALBERT XXL, Aggregation=Average Aggregation2023.03 | 83.9 | |
| UniEXNumber of Parameters=132M, Backbone=RoBERTa-base2023.05 | 83.81 | |
| Yan et al.2023.03 | 83.2 | |
| Zhao et al.2023.03 | 81.1 | |
| TANLNumber of Parameters=220M, Backbone=T5-base2023.05 | 80.6 | |
| Wang and Lu (2020)2023.03 | 80.1 | |
| Theodoropoulos et al. (2021)2023.03 | 80 | |
| Eberts and Ulges (2020)2023.03 | 79.2 | |
| Rainbow CuckooShots=4, Evaluation Protocol=In-domain Transfer2025.02 | 76.05 | |
| CuckooShots=4, Evaluation Protocol=Few-shot2025.02 | 71.7 | |
| Cuckoo (Only Post-train)Shots=4, Evaluation Protocol=Few-shot2025.02 | 69.75 | |
| Cuckoo (Only Pre-train)Shots=4, Evaluation Protocol=Few-shot2025.02 | 69.39 | |
| MRQAShots=4, Evaluation Protocol=Few-shot2025.02 | 67.44 | |
| MetaIE+Shots=4, Evaluation Protocol=Few-shot2025.02 | 64.4 | |
| NuNER+Shots=4, Evaluation Protocol=Few-shot2025.02 | 63.71 | |
| Rainbow CuckooShots=0, Evaluation Protocol=Zero-shot2025.02 | 62.01 | |
| LC-ICLParadigm=ICL, Backbone=Llama-3.3-70B-Instruct2026.06 | 54.13 | |
| PEParadigm=ICL, Backbone=Llama-3.3-70B-Instruct2026.06 | 49.62 | |
| OPT-C4-TuluV3Shots=4, Evaluation Protocol=Few-shot2025.02 | 45.66 | |
| MultiNERD+Shots=4, Evaluation Protocol=Few-shot2025.02 | 45.1 | |
| CuckooShots=0, Evaluation Protocol=Zero-shot2025.02 | 34.67 | |
| LC-ICLParadigm=ICL, Backbone=Llama-3.1-8B-Instruct2026.06 | 18.1 | |
| PEParadigm=ICL, Backbone=Llama-3.1-8B-Instruct2026.06 | 13.6 | |
| ROBERTaShots=4, Evaluation Protocol=Few-shot2025.02 | 2.15 | |
| DIParadigm=w/o ICL, Backbone=Llama-3.1-8B-Instruct2026.06 | 0.79 | |
| DIParadigm=w/o ICL, Backbone=Llama-3.3-70B-Instruct2026.06 | 0.68 |