Implicit Discourse Relation Recognition on PDTB 2.0
69.6Top-level Macro F1GOLF
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GOLFEmbedding=ROBERTa, Model size=large2022.11 | 69.6 | 74.67 | 47.91 | 63.91 | 14.59 | 42.35 | |
| GOLFEmbedding=ROBERTa, Model size=base2022.11 | 65.76 | 72.52 | 41.74 | 61.16 | 11.79 | 32.85 | |
| LDSGMEmbedding=ROBERTa2022.11 | 63.73 | 71.18 | 40.49 | 60.33 | 10.68 | 32.2 | |
| BMGF-ROBERTaEmbedding=ROBERTa2022.11 | 63.39 | 69.06 | — | 58.13 | — | — | |
| ROBERTaEmbedding=ROBERTa, Mode=Fine-tuning2022.11 | 62.96 | 69.98 | 40.34 | 59.87 | 10.06 | 31.45 | |
| BERT-FTEmbedding=BERT2022.11 | 58.48 | 65.26 | — | 54.32 | — | — | |
| HierMTN-CRFEmbedding=BERT2022.11 | 55.72 | 65.26 | 33.91 | 53.34 | 10.37 | 30 | |
| MTL-MLossEmbedding=ELMo2022.11 | 53 | — | — | 49.95 | — | — | |
| IDRR-C&EEmbedding=ELMo2022.11 | 52.89 | 59.66 | 33.41 | 48.23 | — | — | |
| PDRREmbedding=word2vec2022.11 | 48.82 | 57.44 | — | — | — | — | |
| KANNEmbedding=GloVe2022.11 | 47.9 | 57.25 | — | — | — | — | |
| IDRR-ConEmbedding=word2vec2022.11 | 46.4 | 61.42 | — | 47.83 | — | — | |
| NNMAEmbedding=GloVe2022.11 | 46.29 | 57.57 | — | — | — | — | |
| ChatGPT2022.11 | 36.11 | 44.18 | 16.2 | 24.54 | — | — |