Context-Aware Image Retrieval on DISBench Inter-Event
35.4EMPhotoCraft
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| PhotoCraftBase Model=Claude-Opus-4.5, Embedding Model=Qwen3-VL-Embedding-2B2026.06 | 35.4 | 57 | |
| Claude-Opus-4.5-20251101Framework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-2B2026.02 | 29.2 | 53.4 | |
| PhotoCraftBase Model=Claude-Opus-4.5, Embedding Model=Qwen3-VL-Embedding-8B2026.06 | 29.2 | 53.7 | |
| Claude-Opus-4.5-20251101Framework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-8B2026.02 | 23.1 | 50.7 | |
| PhotoCraftBase Model=Qwen3-VL-32B-Instruct, Embedding Model=Qwen3-VL-Embedding-8B2026.06 | 21.5 | 34 | |
| Gemini-3-Pro-PreviewFramework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-2B2026.02 | 20 | 40.5 | |
| Gemini-3-Pro-PreviewFramework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-8B2026.02 | 20 | 41.5 | |
| PhotoCraftBase Model=Claude-Sonnet-4.5, Embedding Model=Qwen3-VL-Embedding-2B2026.06 | 18.5 | 38 | |
| PhotoCraftBase Model=Claude-Sonnet-4.5, Embedding Model=Qwen3-VL-Embedding-8B2026.06 | 18.5 | 42.7 | |
| Claude-Sonnet-4.5-20250929Framework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-8B2026.02 | 16.9 | 39.6 | |
| PhotoCraftBase Model=GPT-5.2, Embedding Model=Qwen3-VL-Embedding-2B2026.06 | 15.4 | 36.9 | |
| PhotoCraftBase Model=Qwen3-VL-235B-A22B-Instruct, Embedding Model=Qwen3-VL-Embedding-8B2026.06 | 15.4 | 30 | |
| PhotoCraftBase Model=GLM-4.6V, Embedding Model=Qwen3-VL-Embedding-2B2026.06 | 15.4 | 35.3 | |
| PhotoCraftBase Model=GPT-4o, Embedding Model=Qwen3-VL-Embedding-2B2026.06 | 13.8 | 26 | |
| PhotoCraftBase Model=Qwen3-VL-235B-A22B-Instruct, Embedding Model=Qwen3-VL-Embedding-2B2026.06 | 13.8 | 26.4 | |
| PhotoCraftBase Model=Qwen3-VL-32B-Instruct, Embedding Model=Qwen3-VL-Embedding-2B2026.06 | 13.8 | 31.2 | |
| GPT-5.2Framework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-2B2026.02 | 12.3 | 32.6 | |
| Claude-Sonnet-4.5-20250929Framework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-2B2026.02 | 12.3 | 35.4 | |
| PhotoCraftBase Model=Qwen3-VL-235B-A22B-Thinking, Embedding Model=Qwen3-VL-Embedding-2B2026.06 | 12.3 | 24.5 | |
| GLM-4.6VFramework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-2B2026.02 | 10.8 | 27 | |
| PhotoCraftBase Model=GPT-5.2, Embedding Model=Qwen3-VL-Embedding-8B2026.06 | 10.8 | 29.5 | |
| GPT-4oFramework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-2B2026.02 | 9.2 | 24.5 | |
| Gemini-3-Flash-PreviewFramework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-8B2026.02 | 9.2 | 31.9 | |
| Qwen3-VL-235B-A22B-ThinkingFramework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-2B2026.02 | 9.2 | 22.6 | |
| PhotoCraftBase Model=Gemini-3-Flash-Preview, Embedding Model=Qwen3-VL-Embedding-2B2026.06 | 9.2 | 30.7 | |
| PhotoCraftBase Model=Gemini-3-Flash-Preview, Embedding Model=Qwen3-VL-Embedding-8B2026.06 | 9.2 | 32.4 | |
| PhotoCraftBase Model=Qwen3-VL-235B-A22B-Thinking, Embedding Model=Qwen3-VL-Embedding-8B2026.06 | 9.2 | 21.6 | |
| PhotoCraftBase Model=GLM-4.6V, Embedding Model=Qwen3-VL-Embedding-8B2026.06 | 9.2 | 28.3 | |
| GPT-5.2Framework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-8B2026.02 | 7.7 | 27.4 | |
| Gemini-3-Flash-PreviewFramework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-2B2026.02 | 7.7 | 29.2 | |
| PhotoCraftBase Model=GPT-4o, Embedding Model=Qwen3-VL-Embedding-8B2026.06 | 7.7 | 27.2 | |
| GPT-4oFramework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-8B2026.02 | 6.2 | 25.9 | |
| Qwen3-VL-235B-A22B-InstructFramework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-2B2026.02 | 6.2 | 24.6 | |
| Qwen3-VL-235B-A22B-InstructFramework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-8B2026.02 | 6.2 | 22.9 | |
| Qwen3-VL-32B-InstructFramework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-2B2026.02 | 6.2 | 19.6 | |
| GLM-4.6VFramework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-8B2026.02 | 6.2 | 20.8 | |
| Qwen3-VL-235B-A22B-ThinkingFramework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-8B2026.02 | 4.6 | 17.6 | |
| Qwen3-VL-32B-InstructFramework=ImageSeeker, Embedding Model=Qwen3-VL-Embedding-8B2026.02 | 3.1 | 15.5 |