Cross-Document Event Coreference Resolution on GVC
87B3 RecallOur method
Evaluation Results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Our method2024.06 | 87 | 92.4 | 93.2 | 92.8 | 87.4 | 87.2 | 83.6 | 80.7 | 82.1 | 87.4 | 83.4 | 83 | 83.2 | |
| Our baselinereplication_of=Held et al. (2021), hyper-parameters=advanced2024.06 | 86.2 | 91.3 | 92 | 91.7 | 83.8 | 84.9 | 78.7 | 76.5 | 77.6 | 84.7 | 82 | 78.4 | 80.2 | |
| Held et al.2024.06 | 82.2 | 91.8 | 91.2 | 91.5 | 83.8 | 83 | 75.5 | 77.9 | 76.7 | 83.7 | 79 | 82.3 | 80.6 | |
| Barhom et al.2024.06 | 81 | — | — | — | 66 | 72.7 | — | — | — | — | — | — | — | |
| Ahmed et al.2024.06 | 79 | 84 | 91.1 | 87.4 | 76.4 | 77.7 | 69.6 | 52.5 | 59.9 | 75 | 74.1 | 63.9 | 68.6 | |
| Bugert et al.2024.06 | 49.9 | 66.3 | 78.1 | 71.7 | 73.6 | 59.5 | 60.9 | 38.2 | 47 | 59.4 | 38.2 | 56.5 | 45.6 | |
| GPT-4mode=few-shot learning, context=limited context2024.06 | 5.5 | 7.6 | 54.9 | 13.4 | 34.6 | 9.6 | 4.2 | 42.8 | 7.6 | 10.2 | 4.4 | 28 | 7.6 |