Political Stance Detection on Forum dataset 200-post (test)
74AccuracyGrok-2-1212B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Grok-2-1212Bcontext=With User Summaries (Enhanced)2026.02 | 74 | 38.5 | |
| Meta-Llama 3.1-70Bcontext=With User Summaries (Enhanced)2026.02 | 72 | 30.5 | |
| Malouf and Mullenapproach=traditional methods using explicit social network information2026.02 | 68.48 | — | |
| Claude 3.7 Sonnetcontext=With User Summaries (Enhanced)2026.02 | 67 | 24.5 | |
| Qwen 2.5-72Bcontext=With User Summaries (Enhanced)2026.02 | 66 | 29 | |
| Mistral Small-24Bcontext=With User Summaries (Enhanced)2026.02 | 63 | 28.5 | |
| GPT-4o Minicontext=With User Summaries (Enhanced)2026.02 | 60 | 26 | |
| google_gemini-2.0-flash-001context=With User Summaries (Enhanced)2026.02 | 53.5 | 17.5 | |
| Claude 3.7 Sonnetcontext=No Context (Baseline)2026.02 | 42.5 | — | |
| Meta-Llama 3.1-70Bcontext=No Context (Baseline)2026.02 | 41.5 | — | |
| Qwen 2.5-72Bcontext=No Context (Baseline)2026.02 | 37 | — | |
| google_gemini-2.0-flash-001context=No Context (Baseline)2026.02 | 36 | — | |
| Grok-2-1212Bcontext=No Context (Baseline)2026.02 | 35.5 | — | |
| Mistral Small-24Bcontext=No Context (Baseline)2026.02 | 34.5 | — | |
| GPT-4o Minicontext=No Context (Baseline)2026.02 | 34 | — |