Three-way polarity classification on TeachScope (val)
81.22Professionalism AccTeachPro
Evaluation Results
| Method | Links | ||||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| TeachProepoch=last, batch size=64, hidden dimensionality=768, dropout=0.12026.01 | 81.22 | 80.83 | 0.8117 | 0.0634 | 79.55 | 77.68 | 0.8278 | 0.0483 | 76.73 | 75.4 | 0.7758 | 0.0591 | 85.55 | 75.56 | 0.8479 | 0.032 | 79.39 | 74.11 | 0.6772 | 0.0408 | 80.49 | 76.72 | 0.7881 | 0.0487 | |
| TextCNNepoch=last, batch size=642026.01 | 72.4 | 72.17 | 0.6916 | 0.1598 | 71.99 | 68.7 | 0.738 | 0.1649 | 66.04 | 65.36 | 0.6687 | 0.1588 | 79.03 | 63.92 | 0.7196 | 0.1136 | 73.29 | 67.63 | 0.6017 | 0.1256 | 72.55 | 67.55 | 0.6839 | 0.1445 | |
| TinyBERTepoch=last, batch size=64, hidden dimensionality=7682026.01 | 63.12 | 64.55 | 0.5788 | 0.1289 | 71.62 | 68.05 | 0.7333 | 0.1911 | 60.3 | 51.82 | 0.5481 | 0.0698 | 79.03 | 54.88 | 0.6525 | 0.0368 | 73.6 | 65.93 | 0.5766 | 0.1212 | 69.54 | 61.05 | 0.6179 | 0.1096 | |
| LSTMepoch=last, batch size=642026.01 | 47.37 | 21.43 | 0.0003 | 0.0066 | 51.64 | 22.71 | 0.0005 | 0.0291 | 47.31 | 21.53 | 0.0012 | 0.0278 | 68.13 | 27.01 | 0 | 0.014 | 59.68 | 24.92 | 0 | 0.0151 | 54.83 | 23.52 | 0.0003 | 0.0185 | |
| BERTepoch=last, batch size=64, hidden dimensionality=7682026.01 | 47.37 | 21.43 | 0 | 0.0058 | 51.7 | 22.72 | 0 | 0.0264 | 47.26 | 21.4 | 0 | 0.0344 | 68.13 | 27.01 | 0 | 0.015 | 59.68 | 24.92 | 0 | 0.0348 | 54.83 | 23.49 | 0 | 0.0233 | |
| DistilBERTepoch=last, batch size=64, hidden dimensionality=7682026.01 | 47.37 | 21.43 | 0 | 0.0035 | 51.7 | 22.72 | 0 | 0.0022 | 47.26 | 21.4 | 0 | 0.0323 | 68.13 | 27.01 | 0 | 0.007 | 59.68 | 24.92 | 0 | 0.0176 | 54.83 | 23.49 | 0 | 0.0125 | |
| RoBERTaepoch=last, batch size=64, hidden dimensionality=7682026.01 | 47.37 | 21.43 | 0 | 0.0181 | 51.7 | 22.72 | 0 | 0.01 | 47.26 | 21.4 | 0 | 0.0418 | 68.13 | 27.01 | 0 | 0.0148 | 59.68 | 24.92 | 0 | 0.0356 | 54.83 | 23.49 | 0 | 0.0241 | |
| SpanBERTepoch=last, batch size=64, hidden dimensionality=7682026.01 | 47.37 | 21.43 | 0 | 0.002 | 51.7 | 22.72 | 0 | 0.0062 | 47.26 | 21.4 | 0 | 0.0239 | 68.13 | 27.01 | 0 | 0.0254 | 59.68 | 24.92 | 0 | 0.027 | 54.83 | 23.49 | 0 | 0.0169 | |
| StructBERTepoch=last, batch size=64, hidden dimensionality=7682026.01 | 47.37 | 21.43 | 0 | 0.0221 | 51.7 | 22.72 | 0 | 0.0301 | 47.26 | 21.4 | 0 | 0.0348 | 68.13 | 27.01 | 0 | 0.0043 | 59.68 | 24.92 | 0 | 0.0009 | 54.83 | 23.49 | 0 | 0.0184 | |
| ELECTRAepoch=last, batch size=64, hidden dimensionality=7682026.01 | 47.37 | 21.43 | 0 | 0.0047 | 51.7 | 22.72 | 0 | 0.0402 | 47.26 | 21.4 | 0 | 0.0011 | 68.13 | 27.01 | 0 | 0.0209 | 59.68 | 24.92 | 0 | 0.0215 | 54.83 | 23.49 | 0 | 0.0177 | |
| BARTepoch=last, batch size=64, hidden dimensionality=7682026.01 | 47.37 | 21.43 | 0 | 0.0128 | 51.7 | 22.72 | 0 | 0.0097 | 47.26 | 21.4 | 0 | 0.0325 | 68.13 | 27.01 | 0 | 0.0054 | 59.68 | 24.92 | 0 | 0.0198 | 54.83 | 23.49 | 0 | 0.016 |