Binary Persuasion Prediction on CMV (test)
58.8F1 ScorePI-sub
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| PI-subAggregation=Sub2026.06 | 58.8 | 61.1 | 56.7 | 58.5 | |
| PI-meanAggregation=Mean2026.06 | 57.1 | 58.2 | 56.1 | 56 | |
| GPT-4oMode=Zero-shot2026.06 | 49.2 | 56.3 | 43.6 | 52.8 | |
| RoBERTaBackbone=RoBERTa-base, Mode=Fine-tuned2026.06 | 45.9 | 55.9 | 38.9 | 52 | |
| PI-subFeature granularity=55 sub-features, Evaluation protocol=l2-regularized logistic regression, Vector construction=single-argument vectors2026.06 | 0.588 | — | — | — | |
| PI-meanFeature granularity=15 category means, Evaluation protocol=l2-regularized logistic regression, Vector construction=single-argument vectors2026.06 | 0.571 | — | — | — | |
| GPT-4oEvaluation protocol=zero-shot, Vector construction=single-argument vectors2026.06 | 0.492 | — | — | — | |
| RoBERTaEvaluation protocol=fine-tuned, Vector construction=single-argument vectors2026.06 | 0.459 | — | — | — |