Cross-Document Event Coreference Resolution on FCC
74.5B3 RecallOur method
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Our method2024.06 | 74.5 | 85.3 | 90.6 | 87.8 | 82.5 | 78.3 | 80.9 | 61.5 | 69.8 | 78.7 | 69.7 | 73.5 | 71.5 | |
| Bugert et al.2024.06 | 70.8 | 82.7 | 78.3 | 80.4 | 38.3 | 49.2 | 28.2 | 40.4 | 33.2 | 54.3 | 60.4 | 30.4 | 39.8 | |
| Our baselinereplication_of=Held et al. (2021), hyper-parameters=advanced2024.06 | 69.4 | 81.1 | 89 | 85.1 | 66.6 | 68 | 76.1 | 52.2 | 62 | 71.7 | 63.5 | 54.6 | 58.7 | |
| Held et al.2024.06 | 61.6 | 86.4 | 75.7 | 80.7 | 65.4 | 63.5 | 39.1 | 65.3 | 48.9 | 64.4 | 47.2 | 57 | 51.6 | |
| Barhom et al.2024.06 | 36 | — | — | — | 83 | 50.2 | — | — | — | — | — | — | — | |
| GPT-4mode=few-shot learning, context=limited context2024.06 | 2.3 | 0.1 | 1 | 0.2 | 99.4 | 4.5 | 14.1 | 13.1 | 13.6 | 6.1 | 0 | 1.1 | 0 |