Retrieval on ATIR IAT→A (test)
74.34R@1ATIR-Qwen-3B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ATIR-Qwen-3BSetting=Interleaved2026.04 | 74.34 | 82.61 | |
| ColQwen-Omni-3BSetting=Fused2026.04 | 68.64 | 80.79 | |
| Omni-Embed-Nemotron-3BSetting=Fused, Note=Finetuned2026.04 | 64.49 | 77.63 | |
| Qwen3-Embedding-4BSetting=Text2026.04 | 63.65 | 73.1 | |
| E5-largeSetting=Text2026.04 | 58.88 | 65.3 | |
| BGE-largeSetting=Text2026.04 | 55.81 | 63.45 | |
| M2D-CLAPSetting=Cross2026.04 | 20.54 | 27.69 | |
| CLAPSetting=Cross2026.04 | 11.13 | 17.79 | |
| LAION-CLAPSetting=Cross2026.04 | 8.89 | 12.27 |