Cross-domain classification on MDS (Multi-Domain Sentiment) 2007 (test)
91.5Accuracy (Books to DVD)CST
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| CSTBackbone=BERT2021.03 | 91.5 | 92.9 | 92.6 | 91.9 | 92.6 | 93.5 | 90.2 | 89.4 | 93.8 | 87.9 | 88.3 | 93.5 | 91.5 | |
| VATBackbone=BERT2021.03 | 90.6 | 91 | 91.7 | 90.8 | 90.8 | 92 | 87.2 | 86.9 | 92.6 | 86.9 | 87.7 | 92.9 | 90.1 | |
| VAT+EntropyBackbone=BERT2021.03 | 90.4 | 91.3 | 91.5 | 91 | 91.1 | 92.4 | 87.5 | 86.3 | 92.4 | 86.5 | 87.5 | 93.1 | 90.1 | |
| MDDBackbone=BERT2021.03 | 90.4 | 90.4 | 91.8 | 90.2 | 90.9 | 91 | 87.5 | 86.3 | 92.5 | 89 | 87.9 | 92.1 | 90 | |
| DANNBackbone=BERT2021.03 | 90.2 | 89.5 | 90.9 | 91 | 90.6 | 90.2 | 87.1 | 87.5 | 92.8 | 87.8 | 87.6 | 93.2 | 89.9 | |
| Source-onlyBackbone=BERT2021.03 | 89.7 | 88.4 | 90.9 | 90.1 | 88.5 | 90.2 | 86.9 | 88.5 | 91.5 | 87.6 | 87.3 | 91.2 | 89.2 | |
| Upper BaselineProtocol=Direct train on target, test on target2018.10 | 85 | 87.1 | 90.7 | 83.9 | 87.1 | 90.7 | 83.9 | 85 | 90.7 | 83.9 | 85 | 87.1 | 86.7 | |
| SDA2018.10 | 84.4 | — | — | — | — | — | — | — | 90.2 | — | — | 87.2 | — | |
| PyDCIDCF=Cosine2018.10 | 82.3 | 83.7 | 84.3 | 83.5 | 85.5 | 85.6 | 80 | 80.1 | 87.8 | 80.7 | 80.6 | 86 | 83.3 | |
| JaDCIDCF=Cosine2018.10 | 81.7 | 82.2 | 83.5 | 82.4 | 82.4 | 86.4 | 76.4 | 77.4 | 86.8 | 79 | 79.9 | 85.8 | 82 | |
| JaDCIDCF=Linear2018.10 | 80.8 | 81 | 83.4 | 82.5 | 82.2 | 85.8 | 76.6 | 76.8 | 86.4 | 78.3 | 78.8 | 85.5 | 81.5 | |
| Lower BaselineProtocol=Direct train on source, test on target2018.10 | 80.7 | 73.4 | 77.4 | 79 | 75.7 | 77.8 | 71.6 | 74.5 | 85.9 | 73.7 | 74.6 | 84 | 77.3 | |
| PyDCIDCF=Linear2018.10 | 80.3 | 83.7 | 85.1 | 83.2 | 83.9 | 85.3 | 79.6 | 78.7 | 87.1 | 77.9 | 79.5 | 85.3 | 82.5 | |
| AMN2018.10 | — | 80.8 | — | — | — | — | 78 | — | — | 79.3 | — | — | 81.4 | |
| CDFL2018.10 | — | — | — | — | 80.9 | — | — | — | — | — | 87.6 | — | — | |
| DANN2018.10 | — | — | 84.3 | 82.5 | — | 84.9 | — | 78.1 | — | — | — | — | — |