Intent Classification on ORCAS-I-2M
78.9PrecisionBERT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BERTInput features=query + URL2022.05 | 78.9 | 76.4 | 77.4 | |
| SVMInput features=query + URL2022.05 | 78.2 | 75.9 | 76.7 | |
| xtremedistilInput features=query + URL2022.05 | 78.1 | 76.5 | 77.2 | |
| SnorkelInput features=query + URL2022.05 | 77.9 | 76.4 | 77 | |
| SnorkelInput features=query2022.05 | 77.1 | 64.8 | 66.7 | |
| fastTextInput features=query + URL2022.05 | 76.8 | 75.3 | 75.8 | |
| BERTInput features=query2022.05 | 74.2 | 70.5 | 71.7 | |
| SVMInput features=query2022.05 | 73.5 | 68.9 | 70.3 | |
| xtremedistilInput features=query2022.05 | 72.5 | 69.1 | 69.6 | |
| Logistic regressionInput features=query + URL2022.05 | 71.4 | 68.9 | 70 | |
| Logistic regressionInput features=query2022.05 | 70.1 | 61.1 | 64.3 | |
| fastTextInput features=query2022.05 | 69.4 | 64.3 | 66 |