Coreference Resolution on CRAC 2018 (test)
77.9MUC PrecisionHYBRID
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| HYBRIDSingletons=included, Gold Mentions=false2019.11 | 77.9 | 78.5 | 78.2 | 77.4 | 80.3 | 78.8 | 75.4 | 78.1 | 76.8 | 77.9 | |
| HYBRIDSingletons=excluded, Gold Mentions=false2019.11 | 77.9 | 78.5 | 78.2 | 69.2 | 71.8 | 70.4 | 69.5 | 63.8 | 66.5 | 71.7 | |
| FINE NRSingletons=included, Gold Mentions=false2019.11 | 76.7 | 77.3 | 77 | 76.8 | 79.7 | 78.2 | 74.9 | 78 | 76.4 | 77.2 | |
| FINE NRSingletons=excluded, Gold Mentions=false2019.11 | 76.7 | 77.3 | 77 | 68 | 70.7 | 69.3 | 66.6 | 64.2 | 65.4 | 70.6 | |
| NO NRSingletons=excluded, Gold Mentions=false2019.11 | 76.7 | 77 | 76.8 | 68.7 | 69.7 | 69.2 | 66.1 | 63.8 | 64.9 | 70.3 | |
| PREFILTERINGSingletons=included, Gold Mentions=false2019.11 | 75.5 | 79 | 77.2 | 75.9 | 80.7 | 78.2 | 75.2 | 77.3 | 76.2 | 77.2 | |
| PREFILTERINGSingletons=excluded, Gold Mentions=false2019.11 | 75.5 | 79 | 77.2 | 67 | 73 | 69.9 | 67.1 | 65.1 | 66.1 | 71.1 | |
| Lee et al. (2013)Singletons=excluded, Gold Mentions=true2019.11 | 72.3 | 58.9 | 64.9 | 67.9 | 48.5 | 56.5 | 54.2 | 53 | 53.6 | 58.3 | |
| Lee et al. (2013)Singletons=included, Gold Mentions=true2019.11 | 72.1 | 58.9 | 64.8 | 77.5 | 77.1 | 77.3 | 64.2 | 88.1 | 74.3 | 72.1 |