Argument Classification on ACE05-E (test)
74.2F1 ScoreAMPERE (ROBERTa)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| AMPERE (ROBERTa)Type=Generation, Training Data Proportion=100%2023.05 | 74.2 | — | — | |
| AMPERE (AMRBART)Type=Generation, Training Data Proportion=100%2023.05 | 73.4 | — | — | |
| DEGREEType=Generation, Training Data Proportion=100%2023.05 | 73 | — | — | |
| PAIEType=Generation, Training Data Proportion=100%2023.05 | 72.1 | — | — | |
| AMPERE (ROBERTa)Type=Generation, Training Data Proportion=50%2023.05 | 71.9 | — | — | |
| AMPERE (AMRBART)Type=Generation, Training Data Proportion=50%2023.05 | 71.1 | — | — | |
| OneIEType=Classification, Training Data Proportion=100%2023.05 | 70.6 | — | — | |
| AMR-IEType=Classification, Training Data Proportion=100%2023.05 | 70.3 | — | — | |
| AMPERE (AMRBART)Type=Generation, Training Data Proportion=30%2023.05 | 69.7 | — | — | |
| AMPERE (ROBERTa)Type=Generation, Training Data Proportion=30%2023.05 | 69.5 | — | — | |
| PAIEType=Generation, Training Data Proportion=50%2023.05 | 69.1 | — | — | |
| OneIEType=Classification, Training Data Proportion=50%2023.05 | 68.4 | — | — | |
| DEGREEType=Generation, Training Data Proportion=50%2023.05 | 68.2 | — | — | |
| AMPERE (AMRBART)Type=Generation, Training Data Proportion=20%2023.05 | 66.4 | — | — | |
| AMPERE (ROBERTa)Type=Generation, Training Data Proportion=20%2023.05 | 66.4 | — | — | |
| AMR-IEType=Classification, Training Data Proportion=50%2023.05 | 66.1 | — | — | |
| PAIEType=Generation, Training Data Proportion=30%2023.05 | 65.8 | — | — | |
| DEGREEType=Generation, Training Data Proportion=30%2023.05 | 65.8 | — | — | |
| OneIEType=Classification, Training Data Proportion=30%2023.05 | 63 | — | — | |
| PAIEType=Generation, Training Data Proportion=20%2023.05 | 62.8 | — | — | |
| AMR-IEType=Classification, Training Data Proportion=30%2023.05 | 62.6 | — | — | |
| AMPERE (ROBERTa)Type=Generation, Training Data Proportion=10%2023.05 | 61.7 | — | — | |
| AMPERE (AMRBART)Type=Generation, Training Data Proportion=10%2023.05 | 61 | — | — | |
| OneIEType=Classification, Training Data Proportion=20%2023.05 | 59.6 | — | — | |
| Query and ExtractType=Classification, Training Data Proportion=100%2023.05 | 59.1 | — | — | |
| DEGREEType=Generation, Training Data Proportion=20%2023.05 | 58.9 | — | — | |
| AMR-IEType=Classification, Training Data Proportion=20%2023.05 | 58.3 | — | — | |
| DEGREEType=Generation, Training Data Proportion=10%2023.05 | 57.7 | — | — | |
| DyGIE++Type=Classification, Training Data Proportion=100%2023.05 | 57.4 | — | — | |
| ONEIEMethodology Category=classification-based, Learning Setting=supervised2022.05 | 56.8 | — | — | |
| DAEE2023.05 | 56.3 | 58.5 | 54.4 | |
| PAIEType=Generation, Training Data Proportion=10%2023.05 | 56.3 | — | — | |
| GTEE-DYNPREFMethodology Category=generation-based, Learning Setting=supervised2022.05 | 55.8 | 49 | 64.8 | |
| MQAEEMethodology Category=classification-based, Learning Setting=supervised2022.05 | 55.4 | — | — | |
| DEGREE-E2E2023.05 | 55 | — | — | |
| ONEIE2023.05 | 54.8 | 55.4 | 54.3 | |
| GTEE-DYNPREF2023.05 | 54.7 | 49.8 | 60.7 | |
| DyGIE++Type=Classification, Training Data Proportion=50%2023.05 | 54.5 | — | — | |
| DEGREE-E2EMethodology Category=generation-based, Learning Setting=supervised2022.05 | 54.4 | — | — | |
| TEXT2EVENT2023.05 | 54.4 | 54 | 54.8 | |
| BART-GENMethodology Category=generation-based, Learning Setting=supervised2022.05 | 53.7 | 56 | 51.6 | |
| AMPERE (ROBERTa)Type=Generation, Training Data Proportion=5%2023.05 | 53.4 | — | — | |
| BERT_QAMethodology Category=classification-based, Learning Setting=supervised2022.05 | 53.3 | 56.8 | 50.2 | |
| DyGIE++Type=Classification, Training Data Proportion=30%2023.05 | 53.2 | — | — | |
| GAILMethodology Category=classification-based, Learning Setting=supervised2022.05 | 52.4 | 61.6 | 45.7 | |
| AMPERE (AMRBART)Type=Generation, Training Data Proportion=5%2023.05 | 52.4 | — | — | |
| OneIEType=Classification, Training Data Proportion=10%2023.05 | 50 | — | — | |
| TEXT2EVENTMethodology Category=generation-based, Learning Setting=supervised2022.05 | 49.8 | 46.7 | 53.4 | |
| Query and ExtractType=Classification, Training Data Proportion=50%2023.05 | 49.6 | — | — | |
| DyGIE++Type=Classification, Training Data Proportion=20%2023.05 | 49.5 | — | — | |
| DYGIE++Methodology Category=classification-based, Learning Setting=supervised2022.05 | 48.8 | — | — | |
| TANLMethodology Category=generation-based, Learning Setting=supervised2022.05 | 48.5 | — | — | |
| AMR-IEType=Classification, Training Data Proportion=10%2023.05 | 48.5 | — | — | |
| PAIEType=Generation, Training Data Proportion=5%2023.05 | 46.3 | — | — | |
| Query and ExtractType=Classification, Training Data Proportion=30%2023.05 | 44.3 | — | — | |
| DyGIE++Type=Classification, Training Data Proportion=10%2023.05 | 42.4 | — | — | |
| DEGREEType=Generation, Training Data Proportion=5%2023.05 | 41.7 | — | — | |
| AMR-IEType=Classification, Training Data Proportion=5%2023.05 | 36.8 | — | — | |
| OneIEType=Classification, Training Data Proportion=5%2023.05 | 34.6 | — | — | |
| Query and ExtractType=Classification, Training Data Proportion=20%2023.05 | 34.3 | — | — | |
| DyGIE++Type=Classification, Training Data Proportion=5%2023.05 | 29.3 | — | — | |
| Query and ExtractType=Classification, Training Data Proportion=10%2023.05 | 20.9 | — | — | |
| Query and ExtractType=Classification, Training Data Proportion=5%2023.05 | 11 | — | — |