Pronoun Disambiguation on PDP-60
68.3AccuracyMaximum Attention Score (MAS)
Evaluation results
| Method | Links | |
|---|---|---|
| Maximum Attention Score (MAS)supervision=supervised, backbone=BERT2019.05 | 68.3 | |
| USSM + Supervised Deepnet + 3 Knowledge Basessupervision=supervised, knowledge_base=3 Knowledge Bases2019.05 | 66.7 | |
| Single LM (full)supervision=unsupervised, variant=full2019.05 | 60 | |
| Subword-level Transformer LMsupervision=unsupervised2019.05 | 58.3 | |
| Quan Liusupervision=supervised, competition=WS Challenge 2016 - winner2019.05 | 58.3 | |
| USSM + Cause-Effect + WordNet + ConceptNet KBsupervision=unsupervised, knowledge_base=Cause-Effect, WordNet, ConceptNet2019.05 | 56.7 | |
| USSM + Cause-Effect Knowledge Basesupervision=unsupervised, knowledge_base=Cause-Effect2019.05 | 55 | |
| Single LM (partial)supervision=unsupervised, variant=partial2019.05 | 53.3 | |
| USSM + Supervised Deepnetsupervision=supervised2019.05 | 53.3 | |
| Unsupervised Semantic Similarity Method (USSM)supervision=unsupervised2019.05 | 48.3 | |
| Nicos Issaksupervision=supervised, competition=WS Challenge 20162019.05 | 48.3 | |
| Patric Dhondtsupervision=supervised, competition=WS Challenge 20162019.05 | 45 |