Multiple Choice Question Answering on DisastQA
0.88AccuracyMistral-7B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Mistral-7BRetrieval Strategy=Vector Retrieval, Configuration=IR200-Rerank5/Rerank102026.04 | 0.88 | 12 | |
| DeepSeek-V3Retrieval Strategy=Hybrid Retrieval, Configuration=IR100-Rerank152026.04 | 0.8 | 16 | |
| Mistral-7BRetrieval=None2026.04 | 0.76 | — | |
| DeepSeek-V3Retrieval=None2026.04 | 0.64 | — | |
| LLaMA-3-8BRetrieval Strategy=Vector Retrieval, Configuration=IR200-Rerank152026.04 | 0.61 | 23 | |
| Qwen-3-8BRetrieval Strategy=Vector Retrieval, Configuration=IR200-Rerank52026.04 | 0.55 | 18 | |
| LLaMA-3-8BRetrieval=None2026.04 | 0.38 | — | |
| Qwen-3-8BRetrieval=None2026.04 | 0.37 | — |