Conversational Derailment Prediction on CGA-CMV-Large (test)
70.9AccuracySOTA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| SOTADecision Mechanism=Standard2026.05 | 70.9 | 34.3 | 69.1 | 76.1 | 72.3 | 3.9 | |
| SOTA + selective deferralDecision Mechanism=Selective Deferral2026.05 | 70.9 | 26.7 | 72.1 | 68.4 | 70.2 | 3.8 | |
| SOTA + simulation (average)Decision Mechanism=Simulation (Average)2026.05 | 70.2 | 36.2 | 68.1 | 76.6 | 72 | 4 | |
| SOTA + simulation (majority)Decision Mechanism=Simulation (Majority)2026.05 | 70 | 36.9 | 67.7 | 76.7 | 71.8 | 4 | |
| SOTA (oracle threshold)Decision Mechanism=Oracle Threshold Selection2026.05 | 70 | 26.7 | 71.5 | 66.8 | 69 | 3.7 | |
| SOTA + random deferralDecision Mechanism=Random Deferral2026.05 | 69.4 | 30.2 | 70 | 69 | 69.2 | 3.8 |