Coherence Classification on GCDC
61.17Coherence Score (Clinton)ENSEMBLE
Evaluation Results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| ENSEMBLETree structure (T)=true, Nucleus/satellite properties (NS)=true, Connective relations (R)=true, EDU embeddings (E)=true, Ensembling with ParSeq=true2020.09 | 61.17 | 53.99 | 53.99 | 52.4 | 55.39 | — | — | — | — | — | |
| ENSEMBLETree structure (T)=true, Nucleus/satellite properties (NS)=false, Connective relations (R)=false, EDU embeddings (E)=false, Ensembling with ParSeq=true2020.09 | 61.12 | 54.2 | 52.87 | 51.52 | 54.93 | — | — | — | — | — | |
| PARSEQ2020.09 | 61.05 | 54.23 | 53.29 | 51.76 | 55.09 | — | — | — | — | — | |
| ENSEMBLETree structure (T)=true, Nucleus/satellite properties (NS)=true, Connective relations (R)=false, EDU embeddings (E)=false, Ensembling with ParSeq=true2020.09 | 60.82 | 54.01 | 52.92 | 51.63 | 54.85 | — | — | — | — | — | |
| RST-RECTree structure (T)=true, Nucleus/satellite properties (NS)=true, Connective relations (R)=true, EDU embeddings (E)=true2020.09 | 55.7 | 53.86 | 50.92 | 51.7 | 53.04 | — | — | — | — | — | |
| MAJORITY2020.09 | 55.33 | 44.39 | 38.02 | 54.82 | 48.14 | — | — | — | — | — | |
| RST-RECTree structure (T)=true, Nucleus/satellite properties (NS)=false, Connective relations (R)=false, EDU embeddings (E)=false2020.09 | 55.33 | 44.39 | 38.02 | 54.82 | 48.14 | — | — | — | — | — | |
| RST-RECTree structure (T)=true, Nucleus/satellite properties (NS)=true, Connective relations (R)=true, EDU embeddings (E)=false2020.09 | 54.07 | 43.99 | 49.39 | 54.39 | 50.46 | — | — | — | — | — | |
| RST-RECTree structure (T)=true, Nucleus/satellite properties (NS)=true, Connective relations (R)=false, EDU embeddings (E)=false2020.09 | 53.74 | 44.67 | 44.61 | 53.76 | 49.2 | — | — | — | — | — | |
| Jeon and Strube (2020a)Backbone=XLNet2023.06 | — | — | — | — | — | 56.75 | 62.15 | 54.6 | 56.45 | 57.49 | |
| Jeon and Strube (2020b)Backbone=XLNet2023.06 | — | — | — | — | — | 57.3 | 61.7 | 54.5 | 56.9 | 57.6 | |
| Lai and TetreaultBackbone=Embeddings2023.06 | — | — | — | — | — | 54.9 | 60.2 | 53.2 | 54.4 | 55.7 | |
| Li and JurafskyBackbone=Embeddings2023.06 | — | — | — | — | — | 53.5 | 61 | 54.4 | 49.1 | 54.5 | |
| Mesgar and StrubeBackbone=Embeddings2023.06 | — | — | — | — | — | 47.3 | 57.7 | 50.6 | 54.6 | 52.55 | |
| Mesgar and StrubeBackbone=XLNet2023.06 | — | — | — | — | — | 61.3 | 64.6 | 55.74 | 56.7 | 59.59 | |
| Moon et al.Backbone=XLNet2023.06 | — | — | — | — | — | 56.8 | 60.65 | 54.1 | 55.85 | 56.85 | |
| StruSimBackbone=XLNet2023.06 | — | — | — | — | — | 63.65 | 66.2 | 57 | 58.05 | 61.23 | |
| XLNet+DNNBackbone=XLNet2023.06 | — | — | — | — | — | 60.7 | 64 | 55.15 | 56.45 | 59.1 |