Cross-Document Event Coreference Resolution on ECB+
89.4MUC RecallOur method
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Our method2024.06 | 89.4 | 87.1 | 88.2 | 89.1 | 86.5 | 87.8 | 82.7 | 85.5 | 84.1 | 86.7 | 79.7 | 78.5 | 79.3 | |
| Chen et al.2024.06 | 88.6 | 85.9 | 87.2 | 87.8 | 85.4 | 86.6 | 82.8 | 83.7 | 83.2 | 85.7 | — | — | — | |
| Yu et al.2024.06 | 88.1 | 85.1 | 86.6 | 86.1 | 84.7 | 85.4 | 79.6 | 83.1 | 81.3 | 84.4 | — | — | — | |
| Hsu and Horwood2024.06 | 87.8 | 82.9 | 85.3 | 86.5 | 83.1 | 84.8 | 76.9 | 82.8 | 79.7 | 83.3 | 74.4 | 74 | 74.2 | |
| Caciularu et al.2024.06 | 87.1 | 89.2 | 88.1 | 84.9 | 87.9 | 86.4 | 83.3 | 81.2 | 82.2 | 85.6 | 76.7 | 77.2 | 76.9 | |
| Held et al.2024.06 | 87 | 88.1 | 87.5 | 85.6 | 87.7 | 86.6 | 80.3 | 85.8 | 82.9 | 85.7 | 74.9 | 73.2 | 74 | |
| Our baselinereplication_of=Held et al. (2021), hyper-parameters=advanced2024.06 | 86.6 | 86.8 | 86.7 | 87.1 | 86 | 86.5 | 82.6 | 82.5 | 82.5 | 85.2 | 77.8 | 76.6 | 77.2 | |
| Cattan et al.2024.06 | 85.1 | 81.9 | 83.5 | 82.1 | 82.7 | 82.4 | 75.2 | 78.9 | 77 | 81 | — | — | — | |
| Ahmed et al.2024.06 | 80 | 87.3 | 83.5 | 79.6 | 85.4 | 82.4 | 83.1 | 75.5 | 79.1 | 81.7 | 70.5 | 73.3 | 71.9 | |
| GPT-4mode=few-shot learning, context=limited context2024.06 | 79.8 | 78 | 78.9 | 76.3 | 78.1 | 77.2 | 73.3 | 75.6 | 74.4 | 76.8 | 65 | 70 | 67.4 | |
| Barhom et al.2024.06 | 77.6 | 84.5 | 80.9 | 76.1 | 85.1 | 80.3 | 81 | 73.8 | 77.3 | 79.5 | — | — | — | |
| Bugert et al.2024.06 | 76 | 76.1 | 76.1 | 71.8 | 81.2 | 76.2 | 72.2 | 72.1 | 72.2 | 74.8 | 55.1 | 67.9 | 60.8 |