Single-hop Question Answering on LooGLE-SD 16k
45.1ScoreLlama-3-8B-Instruct with DCS
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Llama-3-8B-Instruct with DCSBackbone=Llama-3-8B-Instruct, Context Strategy=DCS2025.06 | 45.1 | 35.5 | |
| Llama-3-8B-InstructBackbone=Llama-3-8B-Instruct, Context Strategy=None2025.06 | 21.25 | 27.6 | |
| Llama-3-8B-Instruct with InfilmBackbone=Llama-3-8B-Instruct, Context Strategy=Infilm2025.06 | 19.5 | 27.15 | |
| Llama-3-8B-Instruct with StreamingBackbone=Llama-3-8B-Instruct, Context Strategy=Streaming2025.06 | 18.51 | 24.26 | |
| Llama-3-8B-Instruct with LM-infiniteBackbone=Llama-3-8B-Instruct, Context Strategy=LM-infinite2025.06 | 18.2 | 24.2 |