Persuasive Technique Classification on INDI-PROP CAA
76.6Micro PrecisionBERT
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| BERT2025.12 | 76.6 | 62.6 | 68.9 | 73.3 | 58 | 64.1 | 77.7 | 62.6 | 68.5 | |
| DistillBERT2025.12 | 76.6 | 62.6 | 68.9 | 53.2 | 45.7 | 47.5 | 71.5 | 62.6 | 64.5 | |
| RoBERTaBackbone=RoBERTa2025.12 | 74.9 | 32.9 | 45.7 | 20.6 | 11.8 | 14 | 50.9 | 32.9 | 37.6 | |
| DeBERTaBackbone=DeBERTa2025.12 | 73 | 34.2 | 46.6 | 23.5 | 13.4 | 16.2 | 52 | 34.2 | 39.4 | |
| FANTABackbone=Mistral2025.12 | 73 | 73 | 73 | 66 | 64 | 64 | 72 | 73 | 72 | |
| TPTC – GPT-4o-miniFramework=TPTC, Backbone=GPT-4o-mini2025.12 | 72.8 | 72.8 | 72.8 | 21.9 | 23.4 | 21.4 | 84 | 76.6 | 78.4 | |
| DeBERTa2025.12 | 71.3 | 66.4 | 68.8 | 52 | 48.3 | 47.1 | 69.7 | 66.4 | 64 | |
| RoBERTa2025.12 | 70.5 | 71 | 70.7 | 47.5 | 52 | 48.8 | 64.1 | 71 | 66.2 | |
| DistillBERTBackbone=DistillBERT2025.12 | 69.9 | 37.5 | 48.8 | 22.1 | 15.7 | 18.1 | 50.2 | 37.5 | 42.3 | |
| BERTBackbone=BERT2025.12 | 68.9 | 36.4 | 47.6 | 29.4 | 16.6 | 20.1 | 54.5 | 36.4 | 42.3 | |
| FANTABackbone=GPT-4o-mini2025.12 | 67 | 83 | 74 | 59 | 79 | 66 | 70 | 83 | 74 | |
| FANTABackbone=Gemma2025.12 | 53 | 53 | 53 | 63 | 53 | 42 | 73 | 53 | 42 | |
| FANTABackbone=GPT-4o-mini, Variant=Concise2025.12 | 52 | 42 | 41 | 52 | 42 | 41 | 52 | 52 | 48 | |
| GPT-4o-miniPrompt Settings=Zero-Shot2025.12 | 47.3 | 47.3 | 47.3 | 15.8 | 33.3 | 21.4 | 22.4 | 47.3 | 30.4 | |
| TPTC – GemmaFramework=TPTC, Backbone=Gemma2025.12 | 44 | 27 | 33 | 25.9 | 16.9 | 17.4 | 40.1 | 26.8 | 28.3 | |
| GPT-4o-miniPrompt Settings=Few-Shot2025.12 | 37.4 | 37.4 | 37.4 | 19.4 | 34.4 | 24.5 | 23.1 | 37.4 | 28.5 | |
| TPTC – MistralFramework=TPTC, Backbone=Mistral2025.12 | 25 | 29.2 | 26.9 | 24.6 | 23.6 | 20.1 | 45.1 | 29.2 | 30.1 | |
| GPT-4o-miniEvaluation Protocol=Few-Shot, Backbone=GPT-4o-mini2025.12 | 21 | 50 | 30 | 19.8 | 39 | 20 | 27 | 50 | 29.7 | |
| GPT-4o-miniEvaluation Protocol=Zero-Shot, Backbone=GPT-4o-mini2025.12 | 20.8 | 51.7 | 29.7 | 16.7 | 38.5 | 19 | 27.2 | 51.7 | 29.8 |