Question Answering on AstroQA (Total)
79.49AccuracyMistral-7B + AstroRAG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Mistral-7B + AstroRAGBackbone=ViT, Zero-shot=true2026.05 | 79.49 | 79.49 | |
| AstroSage-Llama-3.1-8B + AstroRAGBackbone=MPT, Zero-shot=true2026.05 | 77.49 | 77.59 | |
| Llama 2-Chat + AstroRAGBackbone=MPT, Zero-shot=true2026.05 | 52.2 | 52.78 | |
| AstroSage-Llama-3.1-8BBackbone=MPT, Zero-shot=true2026.05 | 41.71 | 41.45 | |
| Llama 2-ChatBackbone=MPT, Zero-shot=true2026.05 | 28.06 | 23.1 | |
| Mistral-7BBackbone=ViT, Zero-shot=true2026.05 | 21.74 | 9.2 |