Coreference Resolution on English OntoNotes 5.0 (test)
88.6MUC Precisioncorefqa
Evaluation results
| Method | Links | ||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| corefqaLM calls=O(n²), params.=340M, Link compl.=/2023.10 | 88.6 | 87.4 | 88 | 82.4 | 82 | 82.2 | 79.9 | 78.3 | 79.1 | 83.1 | — | — | — | — | |
| LINGMESS2022.05 | 88.1 | 85.1 | 86.6 | 82.7 | 78.3 | 80.5 | 78.5 | 76.1 | 77.3 | 81.4 | — | 76.3 | 80.9 | 78.5 | |
| link-appendLM calls=O(n), params.=13B, Link compl.=/2023.10 | 87.4 | 88.3 | 87.8 | 81.8 | 83.4 | 82.6 | 79.1 | 79.9 | 79.5 | 83.3 | — | — | — | — | |
| s2e2022.05 | 86.6 | 85.2 | 85.9 | 80.3 | 77.9 | 79.1 | 76.8 | 75.4 | 76.1 | 80.3 | — | 75.8 | 78.3 | 77 | |
| s2e + Longformer-LargeArchitecture=s2e, Backbone=Longformer-Large2021.01 | 86.5 | 85.1 | 85.8 | 80.3 | 77.9 | 79.1 | 76.8 | 75.4 | 76.1 | 80.3 | — | — | — | — | |
| Kirstain et al.year=20212021.09 | 86.5 | 85.1 | 85.8 | 80.3 | 77.9 | 79.1 | 76.8 | 75.4 | 76.1 | 80.3 | — | — | — | — | |
| ASPLM calls=O(n), params.=11B, Link compl.=/2023.10 | 86.1 | 88.4 | 87.2 | 80.2 | 83.2 | 81.7 | 78.9 | 78.3 | 78.6 | 82.5 | — | — | — | — | |
| c2f + Longformer-LargeArchitecture=c2f, Backbone=Longformer-Large2021.01 | 86 | 83.2 | 84.6 | 78.9 | 75.5 | 77.2 | 76.7 | 68.7 | 72.5 | 78.1 | — | — | — | — | |
| Xu and Choiyear=20202021.09 | 85.9 | 85.5 | 85.7 | 79 | 78.9 | 79 | 76.7 | 75.2 | 75.9 | 80.2 | — | — | — | — | |
| Joshi et al.year=20202021.09 | 85.8 | 84.8 | 85.3 | 78.3 | 77.9 | 78.1 | 76.4 | 74.2 | 75.3 | 79.6 | — | — | — | — | |
| c2f + SpanBERT-LargeArchitecture=c2f, Backbone=SpanBERT-Large2021.01 | 85.7 | 85.3 | 85.5 | 79.5 | 78.7 | 79.1 | 76.8 | 75 | 75.9 | 80.2 | — | — | — | — | |
| JOSHI-REPLICA2021.09 | 85.2 | 85.5 | 85.4 | 78.2 | 78.7 | 78.4 | 75.4 | 75.2 | 75.3 | 79.7 | — | — | — | — | |
| s2eLM calls=1, params.=355M, Link compl.=O(n⁴)2023.10 | 85.2 | 86.6 | 85.9 | 77.9 | 80.3 | 79.1 | 75.4 | 76.8 | 76.1 | 80.3 | — | — | — | — | |
| LingMessLM calls=1, params.=355M, Link compl.=O(n⁴)2023.10 | 85.1 | 88.1 | 86.6 | 78.3 | 82.7 | 80.5 | 76.1 | 78.5 | 77.3 | 81.4 | — | — | — | — | |
| CAW-corefLM calls=1, params.=355M, Link compl.=O(n²)2023.10 | 85.1 | 88.2 | 86.6 | 77 | 78 | 77.5 | 78 | 83.2 | 80.6 | 81.6 | — | — | — | — | |
| c2f + Longformer-BaseArchitecture=c2f, Backbone=Longformer-Base2021.01 | 85 | 85 | 85 | 77.8 | 77.8 | 77.8 | 75.6 | 74.2 | 74.9 | 79.2 | — | — | — | — | |
| wl-corefBackbone=RoBERTa2021.09 | 84.9 | 87.9 | 86.3 | 77.4 | 82.6 | 79.9 | 76.1 | 77.1 | 76.6 | 81 | — | — | — | — | |
| WL+LM calls=1, params.=355M, Link compl.=O(n²)2023.10 | 84.8 | 87.5 | 86.1 | 76.1 | 76.7 | 76.6 | 77.1 | 82.1 | 79.5 | 80.7 | — | — | — | — | |
| Dobrovolskii2022.08 | — | — | — | — | — | — | — | — | — | — | 81 | — | — | — | |
| Joshi et al.2022.08 | — | — | — | — | — | — | — | — | — | — | 79.6 | — | — | — | |
| Kirstain et al.2022.08 | — | — | — | — | — | — | — | — | — | — | 80.3 | — | — | — | |
| LB-MEMmemory cells=5 cells2022.08 | — | — | — | — | — | — | — | — | — | — | 71.8 | — | — | — | |
| LB-MEMmemory cells=10 cells2022.08 | — | — | — | — | — | — | — | — | — | — | 78.5 | — | — | — | |
| LB-MEMmemory cells=20 cells2022.08 | — | — | — | — | — | — | — | — | — | — | 79.9 | — | — | — | |
| RB-MEMmemory cells=5 cells2022.08 | — | — | — | — | — | — | — | — | — | — | 61.4 | — | — | — | |
| RB-MEMmemory cells=10 cells2022.08 | — | — | — | — | — | — | — | — | — | — | 74.3 | — | — | — | |
| RB-MEMmemory cells=20 cells2022.08 | — | — | — | — | — | — | — | — | — | — | 78.8 | — | — | — | |
| Toshniwal et al.2022.08 | — | — | — | — | — | — | — | — | — | — | 79.6 | — | — | — | |
| U-MEM2022.08 | — | — | — | — | — | — | — | — | — | — | 80.9 | — | — | — | |
| Wu et al.2022.08 | — | — | — | — | — | — | — | — | — | — | 83.1 | — | — | — | |
| Xia et al.2022.08 | — | — | — | — | — | — | — | — | — | — | 79.4 | — | — | — | |
| Xu and Choi2022.08 | — | — | — | — | — | — | — | — | — | — | 80.2 | — | — | — |