Pairwise relationship classification on Street-view fine-tuning dataset (test)
72F1 Score (Yes)Qwen2-VL
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Qwen2-VLModel Size=7B, Fine-tuning Method=LoRA (rank 64), Fine-tuning Data=61k-Balanced-YN2025.09 | 72 | 70 | 65 | 78 | 79 | 63 | |
| Qwen2-VLModel Size=7B, Fine-tuning Method=LoRA (rank 64), Fine-tuning Data=76k-Unbalanced2025.09 | 70 | 72 | 67 | 75 | 73 | 69 | |
| Qwen2-VLModel Size=7B, Fine-tuning Method=LoRA (rank 64), Fine-tuning Data=61k-Balanced2025.09 | 68 | 62 | 59 | 75 | 80 | 53 | |
| Qwen2-VLModel Size=7B, Fine-tuning Method=LoRA (rank 64), Fine-tuning Data=76k-Unbalanced-YN2025.09 | 68 | 65 | 61 | 75 | 78 | 57 | |
| Qwen2.5-VLModel Size=7B, Fine-tuning Method=LoRA (rank 128), Fine-tuning Data=29k-YN2025.09 | 66 | 39 | 52 | 78 | 91 | 26 | |
| Qwen2.5-VLModel Size=7B, Fine-tuning Method=LoRA (rank 64), Fine-tuning Data=29k-YN2025.09 | 65 | 53 | 55 | 72 | 82 | 42 | |
| Qwen2-VLModel Size=7B, Fine-tuning Method=LoRA (rank 64), Fine-tuning Data=29k-YN2025.09 | 64 | 57 | 56 | 69 | 75 | 49 | |
| Qwen2-VLModel Size=72B, Fine-tuning Method=—, Fine-tuning Data=—2025.09 | 62 | 58 | 56 | 67 | 71 | 51 | |
| Qwen2.5-VLModel Size=72B, Fine-tuning Method=—, Fine-tuning Data=—2025.09 | 59 | 56 | 54 | 64 | 68 | 49 | |
| Phi 3.5Model Size=4.2B, Fine-tuning Method=—, Fine-tuning Data=—2025.09 | 57 | 24 | 45 | 47 | 79 | 16 | |
| Qwen2-VLModel Size=7B, Fine-tuning Method=—, Fine-tuning Data=—2025.09 | 53 | 54 | 50 | 58 | 58 | 50 | |
| PixtralModel Size=12B, Fine-tuning Method=—, Fine-tuning Data=—2025.09 | 52 | 51 | 48 | 56 | 46 | 57 | |
| LLama3.2-VisionModel Size=11B, Fine-tuning Method=—, Fine-tuning Data=—2025.09 | 46 | 30 | 40 | 38 | 55 | 25 | |
| Gemma 3Model Size=24B, Fine-tuning Method=—, Fine-tuning Data=—2025.09 | 27 | 67 | 49 | 54 | 18 | 84 | |
| Claude-SonnetModel Size=—, Fine-tuning Method=—, Fine-tuning Data=—2025.09 | 24 | 66 | 47 | 54 | 16 | 85 | |
| Qwen2.5-VLModel Size=7B, Fine-tuning Method=—, Fine-tuning Data=—2025.09 | 10 | 69 | 57 | 54 | 5 | 97 | |
| GPT 4oModel Size=—, Fine-tuning Method=—, Fine-tuning Data=—2025.09 | 0 | 70 | 0 | 54 | 0 | 100 |