Misaligned action detection on MISACTBENCH
89.9PrecisionDEACTION
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| DEACTIONBackbone=GPT-5.1 Thinking2026.02 | 89.9 | 76.8 | 85.9 | 82.8 | |
| DEACTIONBackbone=Claude Sonnet 4.52026.02 | 88.2 | 74 | 84.1 | 80.4 | |
| DEACTIONBackbone=Qwen3-VL-32B2026.02 | 80.1 | 63.3 | 76.9 | 70.7 | |
| DEACTIONBackbone=GPT-5.1 Instant2026.02 | 73.4 | 86.4 | 80.2 | 79.4 | |
| Task ShieldBackbone=GPT-5.1 Thinking2026.02 | 61.3 | 73.6 | 67.8 | 66.9 | |
| Task ShieldBackbone=Claude Sonnet 4.52026.02 | 59.5 | 75.8 | 66.5 | 66.6 | |
| InferActBackbone=GPT-5.1 Thinking2026.02 | 56 | 70.1 | 62.5 | 62.3 | |
| Task ShieldBackbone=GPT-5.1 Instant2026.02 | 51.4 | 88.8 | 58 | 65.1 | |
| InferActBackbone=GPT-5.1 Instant2026.02 | 51.4 | 87.3 | 58 | 64.7 | |
| Task ShieldBackbone=Qwen3-VL-32B2026.02 | 50.6 | 69 | 56.6 | 58.4 | |
| InferActBackbone=Claude Sonnet 4.52026.02 | 48.4 | 96 | 53.1 | 64.3 | |
| InferActBackbone=Qwen3-VL-32B2026.02 | 47.1 | 89 | 51.1 | 61.6 |