Question Answering on AstroRef-QA (Total)
30.17ROUGE-LMistral-7B + AstroRAG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Mistral-7B + AstroRAGBackbone=ViT, Zero-shot=true2026.05 | 30.17 | 42.12 | |
| AstroSage-Llama-3.1-8B + AstroRAGBackbone=MPT, Zero-shot=true2026.05 | 28.51 | 42 | |
| Mistral-7BBackbone=ViT, Zero-shot=true2026.05 | 26.93 | 39.64 | |
| AstroSage-Llama-3.1-8BBackbone=MPT, Zero-shot=true2026.05 | 24.54 | 36.47 |