# Crop Disease Knowledge QA on CDDMBench 1.0 (test)

Source: [Crop Disease Knowledge QA on CDDMBench 1.0 (test)](<https://www.sota2.com/research/sota/crop-disease-knowledge-qa-on-cddmbench-1-0-test>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:59:05.758Z

Evaluation of Question Answering performance specifically targeting crop disease knowledge on the test split of CDDMBench version 1.0, measured by QA Score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Crop Disease Knowledge QA |
| Dataset (including any stated split) | CDDMBench 1.0 (test) |
| Metric | QA Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 16 of 16 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [QA Score](<https://www.sota2.com/research/sota/crop-disease-knowledge-qa-on-cddmbench-1-0-test.md?metric=QA%20Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | QA Score | Result date | Report paper |
| --- | --- | --- | --- |
| Gpt-5-Nano | 84.5 | Not recorded | 6955ff9a53fdd5c36173e1c0 |
| Gpt-5-Nano | 84 | Not recorded | 6955ff9a53fdd5c36173e1c0 |
| Gpt-5-Nano | 76 | Not recorded | 6955ff9a53fdd5c36173e1c0 |
| Gpt-5-Nano | 76 | Not recorded | 6955ff9a53fdd5c36173e1c0 |
| Gpt-5-Nano | 75.5 | Not recorded | 6955ff9a53fdd5c36173e1c0 |
| Gpt-5-Nano | 74.5 | Not recorded | 6955ff9a53fdd5c36173e1c0 |
| Gpt-5-Nano | 65 | Not recorded | 6955ff9a53fdd5c36173e1c0 |
| Gpt-5-Nano | 65 | Not recorded | 6955ff9a53fdd5c36173e1c0 |
| Qwen-VL-Chat | 51 | Not recorded | 6955ff9a53fdd5c36173e1c0 |
| Qwen-VL-Chat | 50 | Not recorded | 6955ff9a53fdd5c36173e1c0 |
| Qwen-VL-Chat | 49.5 | Not recorded | 6955ff9a53fdd5c36173e1c0 |
| Qwen-VL-Chat | 49 | Not recorded | 6955ff9a53fdd5c36173e1c0 |
| Qwen-VL-Chat | 46.5 | Not recorded | 6955ff9a53fdd5c36173e1c0 |
| Qwen-VL-Chat | 44 | Not recorded | 6955ff9a53fdd5c36173e1c0 |
| Qwen-VL-Chat | 41.5 | Not recorded | 6955ff9a53fdd5c36173e1c0 |
| Qwen-VL-Chat | 41 | Not recorded | 6955ff9a53fdd5c36173e1c0 |

### Gpt-5-Nano

QA Score: 84.5. Result ID: 6997f84c5698665ec451b72a.

[Reporting paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

Recorded evaluation configuration: {"Generated Explanation Caption Source":"GPT-5-mini","Strategy":"llm-as-a-judge"}. This record does not assert independent reproduction.

### Gpt-5-Nano

QA Score: 84. Result ID: 6997f84c5698665ec451b728.

[Reporting paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

Recorded evaluation configuration: {"Generated Explanation Caption Source":"GPT-5-mini","Strategy":"Explanational Caption"}. This record does not assert independent reproduction.

### Gpt-5-Nano

QA Score: 76. Result ID: 6997f84c5698665ec451b723.

[Reporting paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

Recorded evaluation configuration: {"Generated Explanation Caption Source":"Qwen2.5-VL-72B-Instruct","Strategy":"llm-as-a-judge"}. This record does not assert independent reproduction.

### Gpt-5-Nano

QA Score: 76. Result ID: 6997f84c5698665ec451b729.

[Reporting paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

Recorded evaluation configuration: {"Generated Explanation Caption Source":"GPT-5-mini","Strategy":"few-shot"}. This record does not assert independent reproduction.

### Gpt-5-Nano

QA Score: 75.5. Result ID: 6997f84c5698665ec451b721.

[Reporting paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

Recorded evaluation configuration: {"Generated Explanation Caption Source":"Qwen2.5-VL-72B-Instruct","Strategy":"Explanational Caption"}. This record does not assert independent reproduction.

### Gpt-5-Nano

QA Score: 74.5. Result ID: 6997f84c5698665ec451b722.

[Reporting paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

Recorded evaluation configuration: {"Generated Explanation Caption Source":"Qwen2.5-VL-72B-Instruct","Strategy":"few-shot"}. This record does not assert independent reproduction.

### Gpt-5-Nano

QA Score: 65. Result ID: 6997f84c5698665ec451b720.

[Reporting paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

Recorded evaluation configuration: {"Generated Explanation Caption Source":"Qwen2.5-VL-72B-Instruct","Strategy":"Our Baseline"}. This record does not assert independent reproduction.

### Gpt-5-Nano

QA Score: 65. Result ID: 6997f84c5698665ec451b727.

[Reporting paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

Recorded evaluation configuration: {"Generated Explanation Caption Source":"GPT-5-mini","Strategy":"Our Baseline"}. This record does not assert independent reproduction.

### Qwen-VL-Chat

QA Score: 51. Result ID: 6997f84c5698665ec451b71f.

[Reporting paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

Recorded evaluation configuration: {"Generated Explanation Caption Source":"Qwen2.5-VL-72B-Instruct","Strategy":"llm-as-a-judge"}. This record does not assert independent reproduction.

### Qwen-VL-Chat

QA Score: 50. Result ID: 6997f84c5698665ec451b71e.

[Reporting paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

Recorded evaluation configuration: {"Generated Explanation Caption Source":"Qwen2.5-VL-72B-Instruct","Strategy":"few shot"}. This record does not assert independent reproduction.

### Qwen-VL-Chat

QA Score: 49.5. Result ID: 6997f84c5698665ec451b726.

[Reporting paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

Recorded evaluation configuration: {"Generated Explanation Caption Source":"GPT-5-mini","Strategy":"llm-as-a-judge"}. This record does not assert independent reproduction.

### Qwen-VL-Chat

QA Score: 49. Result ID: 6997f84c5698665ec451b725.

[Reporting paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

Recorded evaluation configuration: {"Generated Explanation Caption Source":"GPT-5-mini","Strategy":"few-shot"}. This record does not assert independent reproduction.

### Qwen-VL-Chat

QA Score: 46.5. Result ID: 6997f84c5698665ec451b71d.

[Reporting paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

Recorded evaluation configuration: {"Generated Explanation Caption Source":"Qwen2.5-VL-72B-Instruct","Strategy":"Explanational Caption"}. This record does not assert independent reproduction.

### Qwen-VL-Chat

QA Score: 44. Result ID: 6997f84c5698665ec451b724.

[Reporting paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

Recorded evaluation configuration: {"Generated Explanation Caption Source":"GPT-5-mini","Strategy":"Explanational Caption"}. This record does not assert independent reproduction.

### Qwen-VL-Chat

QA Score: 41.5. Result ID: 6997f84c5698665ec451b71c.

[Reporting paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

Recorded evaluation configuration: {"Generated Explanation Caption Source":"Qwen2.5-VL-72B-Instruct","Strategy":"Our Baseline"}. This record does not assert independent reproduction.

### Qwen-VL-Chat

QA Score: 41. Result ID: 6997f84c5698665ec451b71b.

[Reporting paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6955ff9a53fdd5c36173e1c0.md>)

Recorded evaluation configuration: {"Generated Explanation Caption Source":"Qwen2.5-VL-72B-Instruct","Strategy":"Liu et al. (2024) Baseline"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
