Multiple-choice Question Answering on Weather news-driven MCQA
60.46MCQ AccuracyPATRA 7B
Evaluation results
| Method | Links | |
|---|---|---|
| PATRA 7BType=Open-source Models2026.02 | 60.46 | |
| ClaudeType=Proprietary Models2026.02 | 59.78 | |
| GPT-5.2Type=Proprietary Models2026.02 | 59.16 | |
| Qwen2.5-7BType=Open-source Models2026.02 | 59 | |
| Gemini-3-ProType=Proprietary Models2026.02 | 58.74 | |
| ITFormer-7BType=Open-source Models2026.02 | 57.14 | |
| GeminiType=Proprietary Models2026.02 | 56.96 | |
| ChatTS-7BType=Open-source Models2026.02 | 56.21 | |
| DeepSeekType=Proprietary Models2026.02 | 46.7 | |
| GPT-4oType=Proprietary Models2026.02 | 41.7 | |
| TimeOmni-1-7BType=Open-source Models2026.02 | 41.67 |