Stance Detection on Weibo-SD
69.8CBMSME
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| MSMEModel=DeepSeek-r1, Category=MSME (ours)2025.12 | 69.8 | 75.9 | 72.2 | 75.5 | 74 | 73.5 | |
| MSMEModel=GPT-4o, Category=MSME (ours)2025.12 | 68.3 | 71.8 | 72.6 | 76.3 | 70.7 | 72 | |
| MSMEModel=QwQ-32b, Category=MSME (ours)2025.12 | 66.1 | 70.5 | 73.2 | 72.8 | 69.6 | 70.4 | |
| MSMEModel=GPT-3.5, Category=MSME (ours)2025.12 | 62.6 | 67.1 | 71.4 | 75.3 | 66.3 | 68.5 | |
| BKELCategory=Zero-shot based on LLMs2025.12 | 58 | 51.3 | 65.6 | 67.6 | 60.4 | 60.6 | |
| COLACategory=Zero-shot based on LLMs2025.12 | 55.8 | 44.6 | 59.6 | 52.5 | 59.2 | 54.3 | |
| Stance ReasonerCategory=Zero-shot based on LLMs2025.12 | 52.5 | 46.1 | 51.5 | 55.7 | 48.3 | 50.8 | |
| BERTCategory=In-target2025.12 | 50.7 | 46.9 | 53.2 | 50.4 | 62.4 | 52.7 | |
| ToCCategory=Zero-shot based on LLMs2025.12 | 47.8 | 48.3 | 69.7 | 54.4 | 57.5 | 55.7 | |
| BaseCategory=Zero-shot based on LLMs2025.12 | 40.1 | 45.2 | 56.9 | 52.2 | 46.9 | 48.3 | |
| CoTCategory=Zero-shot based on LLMs2025.12 | 36.2 | 53.9 | 58.1 | 58.2 | 50.7 | 51.4 |