Single-hop Question Answering on Qasper
44.79ScoreLlama-3-8B-Instruct
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| Llama-3-8B-InstructBackbone=Llama-3-8B-Instruct, Context Strategy=None2025.06 | 44.79 | 27.6 | |
| Llama-3-8B-InstructBackbone=Llama-3-8B-Instruct, Context Management=Baseline2025.06 | 44.79 | — | |
| Llama-3-8B-Instruct with DCSBackbone=Llama-3-8B-Instruct, Context Strategy=DCS2025.06 | 44.59 | 35.5 | |
| DCSBackbone=Llama-3-8B-Instruct2025.06 | 44.59 | — | |
| Llama-3-8B-Instruct with InfilmBackbone=Llama-3-8B-Instruct, Context Strategy=Infilm2025.06 | 44.31 | 27.15 | |
| InfLLMBackbone=Llama-3-8B-Instruct2025.06 | 44.31 | — | |
| Llama-3-8B-Instruct with LM-infiniteBackbone=Llama-3-8B-Instruct, Context Strategy=LM-infinite2025.06 | 42.53 | 24.2 | |
| LM-infiniteBackbone=Llama-3-8B-Instruct2025.06 | 42.53 | — | |
| Llama-3-8B-Instruct with StreamingBackbone=Llama-3-8B-Instruct, Context Strategy=Streaming2025.06 | 42.52 | 24.26 | |
| StreamingBackbone=Llama-3-8B-Instruct2025.06 | 42.52 | — | |
| MOICEBackbone=Mistral-7B-Instruct2025.06 | 30.89 | — | |
| DCSBackbone=Mistral-7B-Instruct2025.06 | 30.64 | — | |
| Mistral-7B-InstructBackbone=Mistral-7B-Instruct, Context Management=Baseline2025.06 | 30.19 | — | |
| InfLLMBackbone=Vicuna-7B2025.06 | 24.35 | — | |
| DCSBackbone=Vicuna-7B2025.06 | 23.81 | — | |
| Vicuna-7BBackbone=Vicuna-7B, Context Management=Baseline2025.06 | 23.38 | — | |
| StreamingBackbone=Vicuna-7B2025.06 | 23.38 | — | |
| MOICEBackbone=Vicuna-7B2025.06 | 23.3 | — | |
| LM-InfiniteBackbone=Vicuna-7B2025.06 | 22.94 | — | |
| InfLLMBackbone=Mistral-7B-Instruct2025.06 | 22.08 | — | |
| LM-infiniteBackbone=Mistral-7B-Instruct2025.06 | 17.3 | — | |
| StreamingBackbone=Mistral-7B-Instruct2025.06 | 17.19 | — |