Coreference Resolution on GAP (test)
89.9Overall F1longdoc
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| longdocTraining=ON + PS 60K, Speaker features (S)=true, Pseudo-singletons (PS)=60K2022.08 | 89.9 | — | — | — | |
| longdocTraining=Joint + PS 60K, Speaker features (S)=true, Pseudo-singletons (PS)=60K2022.08 | 89.8 | — | — | — | |
| LINGMESS2022.05 | 89.6 | — | — | — | |
| longdocTraining=ON2022.08 | 89.4 | — | — | — | |
| longdocTraining=ON, Speaker features (S)=true2022.08 | 89.4 | — | — | — | |
| longdocTraining=Joint, Speaker features (S)=true2022.08 | 89.2 | — | — | — | |
| longdocTraining=ON, Speaker features (S)=true, Genre features (G)=true2022.08 | 89 | — | — | — | |
| s2e2022.05 | 88.3 | — | — | — | |
| longdocTraining=PC2022.08 | 87.9 | — | — | — | |
| Wu et al. (2019)Backbone=BERT_LARGE, Model Variant=SpanBERT2020.05 | 87.5 | — | — | — | |
| Wu et al. (SpanBERT)Backbone=BERT-LARGE2022.08 | 87.5 | — | — | — | |
| longdocTraining=LB02022.08 | 86.5 | — | — | — | |
| PeTraBackbone=BERT_LARGE2020.05 | 85.3 | — | — | — | |
| PeTraBackbone=BERT-LARGE2022.08 | 85.3 | — | — | — | |
| PeTra + Fixed KeyBackbone=BERT_LARGE2020.05 | 85.1 | — | — | — | |
| PeTra + Fixed KeyBackbone=BERT-LARGE2022.08 | 85.1 | — | — | — | |
| BERT-large + c2f-corefBackbone=BERT-large2019.08 | 85 | 86.9 | 83 | 0.95 | |
| Joshi et al. (2019)Backbone=BERT_LARGE2020.05 | 85 | — | — | — | |
| Joshi et al.Backbone=BERT-LARGE2022.08 | 85 | — | — | — | |
| PeTra + Learned Init.Backbone=BERT_LARGE2020.05 | 84.4 | — | — | — | |
| PeTra + Learned Init.Backbone=BERT-LARGE2022.08 | 84.4 | — | — | — | |
| Referential ReaderBackbone=BERT_LARGE2020.05 | 83.7 | — | — | — | |
| Ref. ReaderBackbone=BERT-LARGE2022.08 | 83.7 | — | — | — | |
| BERT-base + c2f-corefBackbone=BERT-base2019.08 | 82.8 | 84.4 | 81.2 | 0.96 | |
| Joshi et al. (2019)Backbone=BERT_BASE2020.05 | 82.8 | — | — | — | |
| Joshi et al.Backbone=BERT-BASE2022.08 | 82.8 | — | — | — | |
| PeTraBackbone=BERT_BASE2020.05 | 81.5 | — | — | — | |
| PeTraBackbone=BERT-BASE2022.08 | 81.5 | — | — | — | |
| PeTra + Fixed KeyBackbone=BERT_BASE2020.05 | 81.1 | — | — | — | |
| PeTra + Fixed KeyBackbone=BERT-BASE2022.08 | 81.1 | — | — | — | |
| PeTra + Learned Init.Backbone=BERT_BASE2020.05 | 80.9 | — | — | — | |
| PeTra + Learned Init.Backbone=BERT-BASE2022.08 | 80.9 | — | — | — | |
| Referential ReaderBackbone=BERT_BASE2020.05 | 78.9 | — | — | — | |
| Ref. ReaderBackbone=BERT-BASE2022.08 | 78.9 | — | — | — | |
| BERT + RRModel=BERT + RR2019.08 | 78.8 | 80.3 | 77.4 | 0.96 | |
| Referential ReaderBackbone=BERT_BASE2020.05 | 78.8 | — | — | — | |
| Ref. ReaderBackbone=BERT-BASE2022.08 | 78.8 | — | — | — | |
| WikiCREMBackbone size=LARGE2020.04 | 78 | — | — | — | |
| BERT-WIKICREM-ALL-GAPSupervision Type=Supervised2021.05 | 78 | 76.7 | 79.4 | 1.04 | |
| RoBERTa-LMBackbone size=LARGE2020.04 | 77.8 | — | — | — | |
| CorefRoBERTaBackbone size=LARGE2020.04 | 77.8 | — | — | — | |
| CorefRoBERTa_LARGESupervision Type=Supervised2021.05 | 77.8 | — | — | — | |
| BERT-WIKICREM-GAPSupervision Type=Supervised2021.05 | 77.4 | 76.4 | 78.4 | 1.03 | |
| CorefBERTBackbone size=LARGE2020.04 | 76.8 | — | — | — | |
| CorefBERT_LARGESupervision Type=Supervised2021.05 | 76.8 | — | — | — | |
| BERT-LMBackbone size=LARGE2020.04 | 76 | — | — | — | |
| CorefBERTBackbone size=BASE2020.04 | 75.7 | — | — | — | |
| BERT-LMBackbone size=BASE2020.04 | 75.3 | — | — | — | |
| BERTSupervision Type=Supervised2021.05 | 75.2 | 75.3 | 75.1 | 1 | |
| c2f-coref2019.08 | 73.5 | 75.8 | 71.1 | 0.94 | |
| MNPPSupervision Type=Fully Un-supervised2021.05 | 73.3 | 71.3 | 75.2 | 1.05 | |
| e2e-coref2019.08 | 64 | 67.7 | 60 | 0.89 | |
| BERT-WIKICREMSupervision Type=Fully Un-supervised2021.05 | 59 | 60.5 | 57.5 | 0.95 |