Multi-class Intent Classification on Intent Semantic Toolkit
28.8Accuracy (0-shot)instructor-large
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| instructor-largeEvaluation Protocol (Shots)=0-shot2024.03 | 28.8 | — | |
| instructor-baseEvaluation Protocol (Shots)=0-shot2024.03 | 26.2 | — | |
| IAEEvaluation Protocol (Shots)=0-shot2024.03 | 25.4 | — | |
| paraphraseEvaluation Protocol (Shots)=0-shot2024.03 | 22.2 | — | |
| IAEEvaluation Protocol (Shots)=10-shot2024.03 | — | 30.1 | |
| instructor-baseEvaluation Protocol (Shots)=10-shot2024.03 | — | 30.9 | |
| instructor-largeEvaluation Protocol (Shots)=10-shot2024.03 | — | 34.3 | |
| paraphraseEvaluation Protocol (Shots)=10-shot2024.03 | — | 28.2 |