Mistake detection on Multi-robot dataset Ordering (test)
48.71APTIMID
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| TIMIDEvaluation protocol=trained, Inf.Time (m)=0.022026.03 | 48.71 | 36.89 | 41.98 | |
| Qwen 2.5Evaluation protocol=zero-shot, Inf.Time (m)=403.52026.03 | 28.92 | 7.46 | 11.86 | |
| PEL4VADEvaluation protocol=trained, Inf.Time (m)=0.012026.03 | 24.15 | 15.55 | 18.92 | |
| Qwen 2.5 (ft)Evaluation protocol=fine-tuned, Inf.Time (m)=409.52026.03 | 17.44 | 11.81 | 14.08 | |
| Auto-EncoderEvaluation protocol=semi-supervised, Inf.Time (m)=0.022026.03 | 11.8 | 5.04 | 7.06 |