Stance Detection on VAST
1.44F1 ScoreHID
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| HIDConfidence Estimator=Sequence Probability, Calibration=Beta2026.06 | 1.44 | — | 6 | |
| WSVConfidence Estimator=Self-Report, Calibration=Beta2026.06 | 1.36 | — | 0.54 | |
| WSVConfidence Estimator=Sequence Probability, Calibration=Beta2026.06 | 1.32 | — | 1.14 | |
| HIDConfidence Estimator=Self-Report, Calibration=Beta2026.06 | 1.21 | — | 8.35 | |
| CGAConfidence Estimator=Sequence Probability, Calibration=Beta2026.06 | 0.44 | — | 7.04 | |
| CGAConfidence Estimator=Self-Report, Calibration=Beta2026.06 | -0.55 | — | 9.58 | |
| MAD-DConfidence Estimator=Sequence Probability, Calibration=Beta2026.06 | -2.21 | — | -4.88 | |
| MAD-DConfidence Estimator=Self-Report, Calibration=Beta2026.06 | -2.21 | — | 0.77 | |
| MADConfidence Estimator=Sequence Probability, Calibration=Beta2026.06 | -6.02 | — | -0.91 | |
| MADConfidence Estimator=Self-Report, Calibration=Beta2026.06 | -6.02 | — | -2.11 | |
| BERT-GCNZero-shot=true2023.10 | — | 68.6 | — | |
| COLAZero-shot=true2023.10 | — | 73 | — | |
| GPT-3.5Zero-shot=true2023.10 | — | 62.3 | — | |
| GPT-3.5Zero-shot=true, Chain-of-Thought=true2023.10 | — | 68.9 | — | |
| JointCLZero-shot=true2023.10 | — | 72.3 | — | |
| PT-HCLZero-shot=true2023.10 | — | 71.6 | — | |
| TGA NetZero-shot=true2023.10 | — | 65.7 | — | |
| TOADZero-shot=true2023.10 | — | 41 | — |