Article-Bias Classification on Farmer’s Protest INDI-PROP (test)
77.1Micro PrecisionDeBERTa
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| DeBERTa2025.12 | 77.1 | 71.2 | 74 | 75 | 64.2 | 65.8 | 83.1 | 71.2 | 74.9 | |
| FANTABackbone=Mistral2025.12 | 77.1 | 77.1 | 77.1 | 74.3 | 65.4 | 65.2 | 79.3 | 77.1 | 75.1 | |
| DistillBERT2025.12 | 76.1 | 72.9 | 74.5 | 46.2 | 42.8 | 43.2 | 67.8 | 72.9 | 69.1 | |
| BERT2025.12 | 73.8 | 67 | 70.2 | 43.3 | 43.5 | 43.4 | 68.3 | 67 | 67.6 | |
| RoBERTa2025.12 | 73.5 | 70.3 | 71.9 | 43.3 | 46 | 44.6 | 68.1 | 70.3 | 69.1 | |
| FANTABackbone=GPT-4o-mini2025.12 | 73 | 81 | 77 | 65 | 83 | 70 | 78 | 81 | 78 | |
| FANTABackbone=GPT-4o-mini, Variant=Concise2025.12 | 72 | 72 | 72 | 57 | 49 | 50 | 70 | 71 | 68 | |
| GPT-4o-miniPrompt Settings=Zero-Shot2025.12 | 69.5 | 69.5 | 69.5 | 23.2 | 33.3 | 27.3 | 48.3 | 69.5 | 57 | |
| GPT-4o-miniPrompt Settings=Few-Shot2025.12 | 54.2 | 54.2 | 54.2 | 24.8 | 27.8 | 26.2 | 47.7 | 54.2 | 50.7 | |
| FANTABackbone=Gemma2025.12 | 47.4 | 47.4 | 47.4 | 53.1 | 70.4 | 46.7 | 75.9 | 47.4 | 47.5 |