Stance Classification on Reddit dataset
74.08AccuracyMixtral 8x7B Scoring + Re2
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Mixtral 8x7B Scoring + Re2Backbone=Mixtral 8x7B, Prompting Strategy=Scoring + Re2, Shots=Zero-Shot2025.02 | 74.08 | 73.25 | 73.09 | 72.93 | |
| Mixtral 8x7B Re2 (One-Shot)Backbone=Mixtral 8x7B, Prompting Strategy=Re2, Shots=One-Shot2025.02 | 69.65 | 71.44 | 68.8 | 68.96 | |
| Mixtral 8x7B Re2Backbone=Mixtral 8x7B, Prompting Strategy=Re2, Shots=Zero-Shot2025.02 | 63.74 | 72.46 | 66.34 | 64.32 | |
| Mixtral 8x7B Meta-Prompting (Self-Critique)Backbone=Mixtral 8x7B, Prompting Strategy=Meta-Prompting (Self-Critique), Shots=Zero-Shot2025.02 | 63.57 | 60.86 | 61.38 | 61.01 | |
| LLM Majority VotingEnsemble Components=Gemma 3-4B, Falcon 3-3B, Qwen 3-4B, Strategy=Majority Voting2025.02 | 62.67 | 73.52 | 58.86 | 63.11 | |
| Mixtral 8x7B Context ExtractionBackbone=Mixtral 8x7B, Prompting Strategy=Context Extraction, Shots=Zero-Shot2025.02 | 60.94 | 59.69 | 60 | 59.71 |