Intent Detection on Posts Dataset In-Distribution
76.46F1 Score (Validation)BERT
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| BERTUser Model=Llama-3.12026.05 | 76.46 | 81.03 | 66.78 | |
| BOT-MODUser Model=Llama-3.12026.05 | 72.98 | 78.25 | 62.05 | |
| self-consistencyUser Model=Llama-3.12026.05 | 70.87 | 75.51 | 61.13 | |
| BOT-MODUser Model=Mistral-7B2026.05 | 70.56 | 79.53 | 53.37 | |
| BERTUser Model=Mistral-7B2026.05 | 69.92 | 76.76 | 56.25 | |
| BOT-MODUser Model=Qwen32026.05 | 69.87 | 73.18 | 62.75 | |
| self-consistencyUser Model=Mistral-7B2026.05 | 69.07 | 72.05 | 62.59 | |
| zero-shotUser Model=Llama-3.12026.05 | 68.59 | 75 | 55.86 | |
| zero-shotUser Model=Mistral-7B2026.05 | 68.36 | 71.72 | 61.13 | |
| zero-shot+User Model=Mistral-7B2026.05 | 68.11 | 72.58 | 58.72 | |
| zero-shot+User Model=Llama-3.12026.05 | 67.21 | 73.43 | 54.66 | |
| BERTUser Model=Qwen32026.05 | 65.31 | 73 | 50.36 | |
| self-refineUser Model=Mistral-7B2026.05 | 64.43 | 69.53 | 54.73 | |
| self-consistencyUser Model=Qwen32026.05 | 60.2 | 62.92 | 54.3 | |
| zero-shotUser Model=Qwen32026.05 | 59.39 | 63.73 | 50.61 | |
| zero-shot+User Model=Qwen32026.05 | 59.38 | 62.1 | 53.49 | |
| self-refineUser Model=Qwen32026.05 | 59.25 | 65.16 | 47.74 | |
| CoTUser Model=Mistral-7B2026.05 | 58.65 | 62.5 | 50.66 | |
| self-refineUser Model=Llama-3.12026.05 | 58.23 | 66.94 | 42.1 | |
| CoTUser Model=Qwen32026.05 | 55.55 | 59.04 | 48.2 | |
| CoTUser Model=Llama-3.12026.05 | 54.49 | 62.2 | 40.05 |