Intent Detection on All Posts and Comment Mean
68.51Mean ScoreBOT-MOD
Evaluation Results
| Method | Links | |
|---|---|---|
| BOT-MODUser Model=Mistral-7B2026.05 | 68.51 | |
| BOT-MODUser Model=Llama-3.12026.05 | 67.69 | |
| zero-shot+User Model=Mistral-7B2026.05 | 66.52 | |
| zero-shot+User Model=Mistral-7B2026.05 | 64.94 | |
| BOT-MODUser Model=Llama-3.12026.05 | 64.44 | |
| BOT-MODUser Model=Mistral-7B2026.05 | 64.31 | |
| BOT-MODUser Model=Qwen32026.05 | 63.98 | |
| self-consistencyUser Model=Mistral-7B2026.05 | 63.68 | |
| BOT-MODUser Model=Qwen32026.05 | 63.67 | |
| zero-shotUser Model=Mistral-7B2026.05 | 63.18 | |
| BERTUser Model=Llama-3.12026.05 | 61.96 | |
| BERTUser Model=Mistral-7B2026.05 | 61.92 | |
| self-consistencyUser Model=Llama-3.12026.05 | 61.59 | |
| zero-shotUser Model=Mistral-7B2026.05 | 61.23 | |
| self-consistencyUser Model=Mistral-7B2026.05 | 61.23 | |
| zero-shotUser Model=Llama-3.12026.05 | 61.09 | |
| zero-shot+User Model=Llama-3.12026.05 | 60.88 | |
| self-consistencyUser Model=Llama-3.12026.05 | 60.7 | |
| CoTUser Model=Mistral-7B2026.05 | 60.52 | |
| self-consistencyUser Model=Qwen32026.05 | 60.14 | |
| zero-shotUser Model=Qwen32026.05 | 59.49 | |
| zero-shotUser Model=Llama-3.12026.05 | 59.37 | |
| zero-shot+User Model=Llama-3.12026.05 | 59.16 | |
| zero-shot+User Model=Qwen32026.05 | 59.09 | |
| BERTUser Model=Qwen32026.05 | 57.41 | |
| self-refineUser Model=Mistral-7B2026.05 | 56.49 | |
| self-refineUser Model=Llama-3.12026.05 | 55.89 | |
| self-refineUser Model=Mistral-7B2026.05 | 55.81 | |
| zero-shot+User Model=Qwen32026.05 | 55.08 | |
| CoTUser Model=Mistral-7B2026.05 | 54.79 | |
| CoTUser Model=Qwen32026.05 | 54.2 | |
| CoTUser Model=Llama-3.12026.05 | 54.05 | |
| BERTUser Model=Mistral-7B2026.05 | 53.59 | |
| BERTUser Model=Qwen32026.05 | 53.52 | |
| BERTUser Model=Llama-3.12026.05 | 53.32 | |
| self-refineUser Model=Qwen32026.05 | 53.08 | |
| self-consistencyUser Model=Qwen32026.05 | 53.06 | |
| zero-shotUser Model=Qwen32026.05 | 52.77 | |
| self-refineUser Model=Qwen32026.05 | 51.14 | |
| CoTUser Model=Llama-3.12026.05 | 48.88 | |
| self-refineUser Model=Llama-3.12026.05 | 48.8 | |
| CoTUser Model=Qwen32026.05 | 47.59 |