Stance Detection on MITweet 12 Facets
66.83AccuracyDual-Probe
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Dual-ProbeModel=Llama-3-8B, Setting=Frozen2025.12 | 66.83 | 50.84 | 19.87 | 13.41 | |
| Dual-ProbeModel=Qwen-2.5-7B, Setting=Frozen2025.12 | 65.88 | 48.38 | 20.95 | 11.83 | |
| Full FTModel=BERTweet, Setting=SFT2025.12 | 62.5 | 41.72 | — | — | |
| Full FTModel=RoBERTa-base, Setting=SFT2025.12 | 59.8 | 38.5 | — | — | |
| Few-shot (5-shot)Model=Llama-3-8B, Setting=Frozen2025.12 | 54.35 | 36.98 | 7.39 | -0.45 | |
| Schema-AwareModel=Llama-3-8B, Setting=Frozen2025.12 | 50.82 | 33.02 | 3.86 | -4.41 | |
| Schema-AwareModel=Qwen-2.5-7B, Setting=Frozen2025.12 | 49.25 | 32.18 | 4.32 | -4.37 | |
| Few-shot (5-shot)Model=Qwen-2.5-7B, Setting=Frozen2025.12 | 48.87 | 37.87 | 3.94 | 1.32 | |
| Zero-shotModel=Llama-3-8B, Setting=Frozen2025.12 | 46.96 | 37.43 | — | — | |
| Zero-shotModel=Qwen-2.5-7B, Setting=Frozen2025.12 | 44.93 | 36.55 | — | — |