Intra-turn Relation Prediction on CMV (test)
16.7PrecisionIMHO Context Fine-Tuned BERT + RST Ensemble
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| IMHO Context Fine-Tuned BERT + RST EnsemblePremise source=Gold2020.04 | 16.7 | 73 | 27.2 | |
| IMHO Context Fine-Tuned BERT + RST EnsemblePremise source=Predicted2020.04 | 15.5 | 70.2 | 25.4 | |
| IMHO Context Fine-Tuned BERTPremise source=Gold2020.04 | 14.3 | 69 | 23.7 | |
| IMHO Context Fine-Tuned BERTPremise source=Predicted2020.04 | 13.2 | 65 | 21.8 | |
| BERT (Devlin et al. 2019)Premise source=Gold2020.04 | 12 | 67 | 20.3 | |
| BERT (Devlin et al. 2019)Premise source=Predicted2020.04 | 11 | 60 | 18.5 | |
| Morio and Fujita (2018)Premise source=Gold2020.04 | 10 | 48.8 | 16.6 | |
| Menini et al. (2018) + RST FeaturesPremise source=Gold2020.04 | 7.4 | 83 | 13.7 | |
| Menini et al. (2018)Premise source=Gold2020.04 | 7 | 82 | 13 | |
| RST FeaturesPremise source=Gold2020.04 | 6.3 | 79.5 | 11.8 | |
| Menini et al. (2018) + RST FeaturesPremise source=Predicted2020.04 | 6.1 | 81 | 11.4 | |
| Menini et al. (2018)Premise source=Predicted2020.04 | 5.9 | 80 | 11 | |
| RST FeaturesPremise source=Predicted2020.04 | 5.7 | 77 | 10.6 | |
| All relationsPremise source=Gold2020.04 | 5 | 100 | 9 |