HOI Semantic Similarity Alignment on HICO-DET (User Study Average)
85.73Agreement ScoreSHOE
Evaluation results
| Method | Links | |
|---|---|---|
| SHOESimilarity metric variant=Standard2026.04 | 85.73 | |
| SHOESimilarity metric variant=Geometric Mean2026.04 | 84.29 | |
| SHOESimilarity metric variant=Minimum2026.04 | 84.01 | |
| DeepSeek-V3-03242026.04 | 83.34 | |
| Llama-4-Mav-17B2026.04 | 82.1 | |
| Qwen3-32B2026.04 | 82.03 | |
| Yi-1.5-34B-Chat2026.04 | 81.55 | |
| Gemini-2.5-Pro2026.04 | 77.52 | |
| CLIP-ViT-BInput representation=gloss2026.04 | 59.11 | |
| CLIP-ViT-BInput representation=pair2026.04 | 58.15 | |
| BGEInput representation=gloss2026.04 | 57.41 | |
| WordNetSimilarity metric variant=WUP2026.04 | 57.09 | |
| BGEInput representation=pair2026.04 | 56.37 | |
| WordNetSimilarity metric variant=LCH2026.04 | 55.69 | |
| SBERTInput representation=gloss2026.04 | 54.09 | |
| SBERTInput representation=pair2026.04 | 52.86 | |
| WordNetSimilarity metric variant=Path2026.04 | 52.47 | |
| direct-matchTask Context=mAP2026.04 | 38.9 |