Long-context Question Answering on DetectiveQA-Zh
80AccuracyMiA-RAG
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MiA-RAGRetriever=MiA-Emb (+sig), Generator=DS-V3.2 (+sig)2026.05 | 80 | 42.7 | |
| MiA-EmbRetriever=MiA-Emb (+sig), Generator=DS-V3.22026.05 | 78 | 42.7 | |
| Query-only RAGRetriever=MiA-Emb, Generator=DS-V3.22026.05 | 76 | 42.7 | |
| MiA-RAGRetriever=MiA-Emb (+sig), Generator=MiA-Gen-14B (+sig)2026.05 | 73.3 | 42.7 | |
| Query-only RAGRetriever=Qwen3-Emb, Generator=DS-V3.22026.05 | 68 | 29.3 | |
| Query-only RAGRetriever=Qwen3-Emb, Generator=Qwen-14B2026.05 | 56.7 | 29.3 | |
| MiARetriever=MiA-Emb-8B, +S (Retriever)=true, Generator=Qwen2.5-72B, +S (Generator)=true, top-k=102025.12 | 0.8417 | — | |
| MiARetriever=MiA-Emb-8B, +S (Retriever)=true, Generator=Qwen2.5-72B, +S (Generator)=true, top-k=52025.12 | 0.8317 | — | |
| MiA (Emb-Only)Retriever=MiA-Emb-8B, +S (Retriever)=true, Generator=Qwen2.5-72B, +S (Generator)=false, top-k=102025.12 | 0.8267 | — | |
| MiARetriever=MiA-Emb-8B, +S (Retriever)=true, Generator=Qwen2.5-14B, +S (Generator)=true, top-k=102025.12 | 0.82 | — | |
| MiA-RAGRetriever=MiA-Emb-8B, +S (Retriever)=true, Generator=MiA-Gen-14B, +S (Generator)=true, top-k=102025.12 | 0.8183 | — | |
| MiARetriever=MiA-Emb-8B, +S (Retriever)=true, Generator=Qwen2.5-72B, +S (Generator)=true, top-k=32025.12 | 0.8167 | — | |
| MiA (Gen-Only)Retriever=Qwen3-8B, +S (Retriever)=false, Generator=Qwen2.5-72B, +S (Generator)=true, top-k=102025.12 | 0.8133 | — | |
| MiA (Emb-Only)Retriever=MiA-Emb-8B, +S (Retriever)=true, Generator=Qwen2.5-72B, +S (Generator)=false, top-k=52025.12 | 0.8117 | — | |
| MiA (Emb-Only)Retriever=MiA-Emb-8B, +S (Retriever)=true, Generator=Qwen2.5-14B, +S (Generator)=false, top-k=102025.12 | 0.8083 | — | |
| MiA (Gen-Only)Retriever=Qwen3-8B, +S (Retriever)=false, Generator=Qwen2.5-14B, +S (Generator)=true, top-k=102025.12 | 0.8017 | — | |
| MiA-RAGRetriever=MiA-Emb-8B, +S (Retriever)=true, Generator=MiA-Gen-14B, +S (Generator)=true, top-k=52025.12 | 0.7967 | — | |
| MiA (Gen-Only)Retriever=Qwen3-8B, +S (Retriever)=false, Generator=MiA-Gen-14B, +S (Generator)=true, top-k=102025.12 | 0.795 | — | |
| MiARetriever=MiA-Emb-8B, +S (Retriever)=true, Generator=Qwen2.5-14B, +S (Generator)=true, top-k=52025.12 | 0.79 | — | |
| MiA-RAGRetriever=MiA-Emb-8B, +S (Retriever)=true, Generator=MiA-Gen-14B, +S (Generator)=true, top-k=32025.12 | 0.79 | — | |
| MiA (Gen-Only)Retriever=Qwen3-8B, +S (Retriever)=false, Generator=Qwen2.5-14B, +S (Generator)=true, top-k=52025.12 | 0.7883 | — | |
| MiA (Gen-Only)Retriever=Qwen3-8B, +S (Retriever)=false, Generator=Qwen2.5-72B, +S (Generator)=true, top-k=52025.12 | 0.785 | — | |
| MiA (Gen-Only)Retriever=Qwen3-8B, +S (Retriever)=false, Generator=MiA-Gen-14B, +S (Generator)=true, top-k=52025.12 | 0.785 | — | |
| MiARetriever=MiA-Emb-8B, +S (Retriever)=true, Generator=Qwen2.5-14B, +S (Generator)=true, top-k=32025.12 | 0.7833 | — | |
| VanillaRetriever=Qwen3-8B, +S (Retriever)=false, Generator=Qwen2.5-72B, +S (Generator)=false, top-k=102025.12 | 0.78 | — | |
| MiA (Emb-Only)Retriever=MiA-Emb-8B, +S (Retriever)=true, Generator=Qwen2.5-14B, +S (Generator)=false, top-k=52025.12 | 0.7717 | — | |
| MiA (Emb-Only)Retriever=MiA-Emb-8B, +S (Retriever)=true, Generator=Qwen2.5-72B, +S (Generator)=false, top-k=32025.12 | 0.7617 | — | |
| MiA (Gen-Only)Retriever=Qwen3-8B, +S (Retriever)=false, Generator=MiA-Gen-14B, +S (Generator)=true, top-k=32025.12 | 0.7617 | — | |
| MiA (Gen-Only)Retriever=Qwen3-8B, +S (Retriever)=false, Generator=Qwen2.5-72B, +S (Generator)=true, top-k=32025.12 | 0.76 | — | |
| VanillaRetriever=Qwen3-8B, +S (Retriever)=false, Generator=Qwen2.5-14B, +S (Generator)=false, top-k=102025.12 | 0.7567 | — | |
| MiA (Gen-Only)Retriever=Qwen3-8B, +S (Retriever)=false, Generator=Qwen2.5-14B, +S (Generator)=true, top-k=32025.12 | 0.7533 | — | |
| Summary-OnlyGenerator=Qwen2.5-72B, +S (Generator)=true2025.12 | 0.7367 | — | |
| MiA (Emb-Only)Retriever=MiA-Emb-8B, +S (Retriever)=true, Generator=Qwen2.5-14B, +S (Generator)=false, top-k=32025.12 | 0.73 | — | |
| VanillaRetriever=Qwen3-8B, +S (Retriever)=false, Generator=Qwen2.5-72B, +S (Generator)=false, top-k=52025.12 | 0.7083 | — | |
| Summary-OnlyGenerator=Qwen2.5-14B, +S (Generator)=true2025.12 | 0.705 | — | |
| VanillaRetriever=Qwen3-8B, +S (Retriever)=false, Generator=Qwen2.5-14B, +S (Generator)=false, top-k=52025.12 | 0.685 | — | |
| VanillaRetriever=Qwen3-8B, +S (Retriever)=false, Generator=Qwen2.5-72B, +S (Generator)=false, top-k=32025.12 | 0.6367 | — | |
| VanillaRetriever=Qwen3-8B, +S (Retriever)=false, Generator=Qwen2.5-14B, +S (Generator)=false, top-k=32025.12 | 0.6033 | — |