Theme Detection on Alberta
82.8Macro F1 ScoreContext-based strategy
Evaluation results
| Method | Links | |
|---|---|---|
| Context-based strategyLLM=Mistral2026.03 | 82.8 | |
| Zero-CoTLLM=Mistral2026.03 | 81 | |
| Context-based strategyLLM=Llama32026.03 | 79.3 | |
| Self-DebiasLLM=Mistral2026.03 | 79.1 | |
| Context-based strategyLLM=Gemma2026.03 | 77 | |
| Self-DebiasLLM=Gemma2026.03 | 76.9 | |
| Self-DebiasLLM=Llama32026.03 | 75.7 | |
| Zero-CoTLLM=Gemma2026.03 | 75.5 | |
| Zero-CoTLLM=Llama32026.03 | 74 |