Argument Identification and Classification on ERE-EN (test)
78.8Arg-I PerformanceAMPERE (AMRBART)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| AMPERE (AMRBART)Data Proportion=100%2023.05 | 78.8 | — | — | — | 75.4 | |
| AMPERE (ROBERTa)Data Proportion=100%2023.05 | 78.4 | — | — | — | 75 | |
| DEGREEData Proportion=100%2023.05 | 78.2 | — | — | — | 74.9 | |
| DEGREEData Proportion=50%2023.05 | 77.4 | — | — | — | 73.3 | |
| AMPERE (AMRBART)Data Proportion=50%2023.05 | 77.1 | — | — | — | 72.5 | |
| AMR-IEData Proportion=100%2023.05 | 76.5 | — | — | — | 71.5 | |
| AMPERE (AMRBART)Data Proportion=30%2023.05 | 75.7 | — | — | — | 71.3 | |
| AMPERE (ROBERTa)Data Proportion=30%2023.05 | 75.4 | — | — | — | 70.5 | |
| AMPERE (ROBERTa)Data Proportion=50%2023.05 | 75.4 | — | — | — | 70.5 | |
| OneIEData Proportion=100%2023.05 | 75.2 | — | — | — | 70.1 | |
| DEGREEData Proportion=30%2023.05 | 74.1 | — | — | — | 69.1 | |
| AMR-IEData Proportion=50%2023.05 | 73.9 | — | — | — | 68.8 | |
| AMPERE (ROBERTa)Data Proportion=10%2023.05 | 73.8 | — | — | — | 67.7 | |
| AMPERE (AMRBART)Data Proportion=10%2023.05 | 73.7 | — | — | — | 66.7 | |
| AMPERE (ROBERTa)Data Proportion=20%2023.05 | 73.6 | — | — | — | 68.4 | |
| AMPERE (AMRBART)Data Proportion=20%2023.05 | 73.1 | — | — | — | 68.5 | |
| OneIEData Proportion=50%2023.05 | 72.3 | — | — | — | 67.7 | |
| DEGREEData Proportion=20%2023.05 | 72.3 | — | — | — | 67.4 | |
| OneIEData Proportion=30%2023.05 | 71.9 | — | — | — | 66.1 | |
| AMR-IEData Proportion=30%2023.05 | 71.4 | — | — | — | 65.7 | |
| AMPERE (ROBERTa)Data Proportion=5%2023.05 | 71.4 | — | — | — | 63.2 | |
| AMPERE (AMRBART)Data Proportion=5%2023.05 | 71.3 | — | — | — | 62.9 | |
| DEGREEData Proportion=10%2023.05 | 71.2 | — | — | — | 63.9 | |
| Query and ExtractData Proportion=100%2023.05 | 70.4 | — | — | — | 64.3 | |
| OneIEData Proportion=20%2023.05 | 67.9 | — | — | — | 62.3 | |
| DEGREEData Proportion=5%2023.05 | 66.4 | — | — | — | 57.5 | |
| AMR-IEData Proportion=20%2023.05 | 65.8 | — | — | — | 60.4 | |
| Query and ExtractData Proportion=50%2023.05 | 64.5 | — | — | — | 57.7 | |
| DyGIE++Data Proportion=100%2023.05 | 63.4 | — | — | — | 56 | |
| OneIEData Proportion=10%2023.05 | 62.1 | — | — | — | 56.1 | |
| DyGIE++Data Proportion=50%2023.05 | 60.5 | — | — | — | 53.7 | |
| DyGIE++Data Proportion=30%2023.05 | 59.1 | — | — | — | 52 | |
| AMR-IEData Proportion=10%2023.05 | 59.1 | — | — | — | 53.7 | |
| Query and ExtractData Proportion=30%2023.05 | 57.7 | — | — | — | 50.1 | |
| DyGIE++Data Proportion=20%2023.05 | 55.9 | — | — | — | 49.5 | |
| OneIEData Proportion=5%2023.05 | 55.5 | — | — | — | 49.5 | |
| DyGIE++Data Proportion=5%2023.05 | 53.3 | — | — | — | 40 | |
| DyGIE++Data Proportion=10%2023.05 | 52.9 | — | — | — | 44.6 | |
| Query and ExtractData Proportion=20%2023.05 | 52.1 | — | — | — | 42.4 | |
| AMR-IEData Proportion=5%2023.05 | 47.8 | — | — | — | 44.1 | |
| Query and ExtractData Proportion=10%2023.05 | 46.7 | — | — | — | 34 | |
| Query and ExtractData Proportion=5%2023.05 | 35.1 | — | — | — | 19.7 | |
| OneIEAnnotation Type=Token + Entity Annotation2021.06 | — | 51.9 | 47.8 | 49.8 | — | |
| TEXT2EVENTAnnotation Type=Parallel Text-Record Annotation2021.06 | — | 49.4 | 47.2 | 48.3 | — |