Open QA (Speech to Text) on AgriBench-Omni 1.0 (test)
100Accuracy (Cn)AgriGPT-Omni
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| AgriGPT-OmniComparison Target=Megrez-Omni-3B2025.12 | 100 | 100 | 95.31 | 100 | 96.97 | 100 | 98.74 | — | |
| AgriGPT-OmniComparison Target=Step-Audio-2-mini2025.12 | 100 | 98.02 | 96.61 | 95.18 | 92.06 | 98.39 | 96.71 | — | |
| AgriGPT-OmniComparison Target=Qwen2-Audio-7B-Instruct2025.12 | 98.89 | 96.21 | 94.44 | 100 | 98.81 | 100 | 97.85 | — | |
| AgriGPT-OmniComparison Target=Qwen2.5-Omni-3B2025.12 | 95.45 | 99.73 | 81.48 | 64.71 | 42.11 | 94.12 | 79.6 | — | |
| AgriGPT-OmniParameters=7B2025.12 | 95 | 91 | 95 | 92 | 93 | 90 | — | 92.67 | |
| Qwen2.5-OmniParameters=7B2025.12 | 88 | 77 | 85 | 87 | 85 | 81 | — | 83.83 | |
| Qwen2.5-OmniParameters=3B2025.12 | 86 | 79 | 84 | 88 | 83 | 82 | — | 83.67 | |
| Qwen2-Audio-InstructParameters=7B2025.12 | 86 | 80 | 85 | 80 | 86 | 73 | — | 81.67 | |
| Step-Audio-2-miniScale=mini2025.12 | 84 | 72 | 83 | 84 | 81 | 75 | — | 80.83 | |
| Megrez-OmniParameters=3B2025.12 | 80 | 61 | 75 | 77 | 79 | 68 | — | 73.33 | |
| AgriGPT-OmniComparison Target=Qwen2.5-Omni-7B2025.12 | 50 | 87.12 | 76.47 | 93.9 | 75 | 72.13 | 75.77 | — |