Long-context Question Answering on LV-Eval
14.81F1 ScorePANINI
Evaluation results
| Method | Links | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| PANINIRetrieval Category=Proposed Method2026.02 | 14.81 | — | — | — | — | — | — | — | — | — | — | — | — | |
| HippoRAG 2Retrieval Category=Structure-Augmented RAG2026.02 | 14 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-Embedding (8B)Retrieval Category=Dense Retrieval, Reranker=Qwen3-Embedding (8B) + reranker2026.02 | 11.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-Embedding (8B)Retrieval Category=Dense Retrieval, Reranker=None2026.02 | 11.7 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Search-R1Retrieval Category=Agentic Systems2026.02 | 11.5 | — | — | — | — | — | — | — | — | — | — | — | — | |
| GraphRAGRetrieval Category=Structure-Augmented RAG2026.02 | 11 | — | — | — | — | — | — | — | — | — | — | — | — | |
| NV-Embed-v2 (7B)Retrieval Category=Dense Retrieval2026.02 | 10 | — | — | — | — | — | — | — | — | — | — | — | — | |
| RAPTORRetrieval Category=Structure-Augmented RAG2026.02 | 9.2 | — | — | — | — | — | — | — | — | — | — | — | — | |
| IRCoTRetrieval Category=Agentic Systems2026.02 | 9.1 | — | — | — | — | — | — | — | — | — | — | — | — | |
| BM25Retrieval Category=Sparse Retrieval, Reranker=BM25 + reranker2026.02 | 8.1 | — | — | — | — | — | — | — | — | — | — | — | — | |
| BM25Retrieval Category=Sparse Retrieval, Reranker=None2026.02 | 7.8 | — | — | — | — | — | — | — | — | — | — | — | — | |
| HippoRAGRetrieval Category=Structure-Augmented RAG2026.02 | 7.6 | — | — | — | — | — | — | — | — | — | — | — | — | |
| NoneRetrieval Category=No Retrieval2026.02 | 5 | — | — | — | — | — | — | — | — | — | — | — | — | |
| LightRAGRetrieval Category=Structure-Augmented RAG2026.02 | 5 | — | — | — | — | — | — | — | — | — | — | — | — | |
| Qwen3-0.6BAttention=Full attention, Avg. Len.=128k2026.02 | — | 6.31 | 11.18 | 1.67 | 4.49 | 3.19 | 6.44 | 5.24 | 1.42 | 4.87 | 5.53 | 6.44 | 5.16 | |
| Qwen3-0.6B-ALLMEMArchitecture=ALLMEM, Avg. Len.=128k2026.02 | — | 4.89 | 9.56 | 7.5 | 4.8 | 4.96 | 3.64 | 3.26 | 1.22 | 2.34 | 3.73 | 3.79 | 4.52 | |
| Qwen3-0.6B-MambaArchitecture=Hybrid Mamba-2, Avg. Len.=128k2026.02 | — | 5.91 | 9.25 | 1.59 | 3.7 | 3.29 | 4.02 | 3.69 | 1.36 | 2.84 | 4.42 | 3.6 | 3.97 | |
| Qwen3-0.6B-SWA-SinksAttention=sliding-window, Window Length=8k, Attention Sinks=128, Avg. Len.=128k2026.02 | — | 5.45 | 9.33 | 1.1 | 2.91 | 2.24 | 3.66 | 1.7 | 0.88 | 2.56 | 3.06 | 3.06 | 3.27 |