Open-Ended Question Answering on EO and Earth Sciences Open-Ended QA with Context
81.81Judge ScoreQwen3
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Qwen3Size (B)=30-A3, Evaluation Protocol=0-shot2026.03 | 81.81 | 52.12 | |
| Gemma3Size (B)=27, Evaluation Protocol=0-shot2026.03 | 78.31 | 51.58 | |
| EVE-InstructSize (B)=24, Evaluation Protocol=0-shot2026.03 | 78.28 | — | |
| Mistral Small 3.2Size (B)=24, Evaluation Protocol=0-shot2026.03 | 71.93 | 57.27 | |
| Llama4 ScoutSize (B)=109-A17, Evaluation Protocol=0-shot2026.03 | 71.73 | 58.31 |