Agricultural Visual Question Answering on AgMMU-MCQs (test)
80.51Disease/Issue ID AccGPT-4o
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| GPT-4oMode=Baseline2026.04 | 80.51 | 84.46 | 86.23 | 90.42 | 84.64 | 85.25 | |
| Gemini 1.5 ProMode=Baseline2026.04 | 76.25 | 79.92 | 81.07 | 88.08 | 76.94 | 80.42 | |
| GPT-5-Nano (Agri-CPJ)Method=+ LLM-as-a-Judge2026.04 | 71.94 | 77.08 | 92.55 | 74.48 | 72.47 | 77.84 | |
| GPT-5-Nano (Agri-CPJ)Method=+ Few-shot2026.04 | 69.78 | 79.86 | 75.17 | 90.06 | 71.35 | 77.31 | |
| GPT-5-Nano (Agri-CPJ)Method=Zero-shot (Caption, Optimized)2026.04 | 68.35 | 77.08 | 88.82 | 73.79 | 70.79 | 75.88 | |
| GPT-5-Nano (Agri-CPJ)Method=Zero-shot (No Caption)2026.04 | 65.47 | 70.14 | 73.79 | 72.67 | 51.69 | 66.23 | |
| LLaMA-3.2Mode=Baseline2026.04 | 65.07 | 69.29 | 75.21 | 78.5 | 78.08 | 73.32 | |
| LLaVA-1.5-13BMode=Baseline2026.04 | 60.18 | 62.76 | 60.71 | 70.78 | 61.63 | 63 | |
| Qwen-VL-7BMode=Baseline2026.04 | 56.24 | 58.31 | 60.65 | 69.64 | 67.7 | 62.34 | |
| Qwen-VL-Chat (Agri-CPJ)Method=+ LLM-as-a-Judge2026.04 | 53.96 | 66.67 | 73.29 | 64.83 | 62.92 | 64.54 | |
| Qwen-VL-Chat (Agri-CPJ)Method=+ Few-shot2026.04 | 52.52 | 65.28 | 64.83 | 72.67 | 64.61 | 64.28 | |
| Qwen-VL-Chat (Agri-CPJ)Method=Zero-shot (Caption, Optimized)2026.04 | 49.64 | 52.78 | 59.31 | 68.32 | 61.24 | 58.67 | |
| Qwen-VL-Chat (Agri-CPJ)Method=Zero-shot (No Caption)2026.04 | 45.71 | 52.78 | 56.85 | 73.01 | 52.51 | 56.48 |