Human Intervention Prediction on COWCORPUS (test)
85.3Step AccuracyAlways No Interv
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Always No Intervtype=Baseline2026.02 | 85.3 | 0 | 92 | 0 | |
| Gemma 27BSFT=true, Source=Ours2026.02 | 85.3 | 30.2 | 91.8 | 0.303 | |
| Llava 8BSFT=true, Source=Ours2026.02 | 81.7 | 29.6 | 89.7 | 0.201 | |
| GPT-4oSource=Closed Source2026.02 | 74.1 | 19.8 | 84.6 | 0.147 | |
| Claude 4 SonnetSource=Closed Source2026.02 | 68.1 | 23.1 | 79.9 | 0.293 | |
| Gemini 2.5 ProSource=Closed Source2026.02 | 68.1 | 28.6 | 79.5 | 0.262 | |
| Gemma 27BSource=Open Source, SFT=false2026.02 | 23.9 | 26.4 | 21.4 | 0.187 | |
| Llava 8BSource=Open Source, SFT=false2026.02 | 18.3 | 0 | 34.3 | 0.017 | |
| Always Intervtype=Baseline2026.02 | 14.7 | 25.7 | 0 | 0.151 |