List your company
ResearchFormerly WizWand

Question Answering on DetectiveQA

67.25AccuracyQRRanker
25.75436.52747.358.073Feb 12, 2026Mar 5, 2026Mar 26, 2026Apr 16, 2026May 7, 2026May 28, 2026Jun 18, 2026
Updated 4mo ago

Evaluation results

MethodLinks
QRRankerMethod Category=QRRanker Series, Generator=Qwen3-8B, Retrieval Context=R@3 retrieved chunks2026.0267.25
QRHeads-4BMethod Category=QRRanker Series, Generator=Qwen3-8B, Retrieval Context=R@3 retrieved chunks2026.0264.75
Qwen3-Reranker-4B (trained)Method Category=Reranking Methods, Generator=Qwen3-8B, Retrieval Context=R@3 retrieved chunks2026.0264.52
SFT-Embedding-8BMethod Category=Embedding Methods, Generator=Qwen3-8B, Retrieval Context=R@3 retrieved chunks2026.0262.85
Qwen3-Reranker-4B (vanilla)Method Category=Reranking Methods, Generator=Qwen3-8B, Retrieval Context=R@3 retrieved chunks2026.0260.93
Qwen3-Embedding-8BMethod Category=Embedding Methods, Generator=Qwen3-8B, Retrieval Context=R@3 retrieved chunks2026.0257.35
Top-downBackbone=Qwen3-235B-A22B-Instruct-2507, Quantization=FP82026.0640.27
Bottom-upBackbone=Qwen3-235B-A22B-Instruct-2507, Quantization=FP82026.0639.6
TOABackbone=Qwen3-235B-A22B-Instruct-2507, Quantization=FP82026.0638.76
Top-downBackbone=Qwen3-30B-A3B-Instruct-2507, Quantization=FP82026.0635.91
Bottom-upBackbone=Qwen3-30B-A3B-Instruct-2507, Quantization=FP82026.0634.06
Zero-shotBackbone=Qwen3-235B-A22B-Instruct-2507, Quantization=FP82026.0633.72
TOABackbone=Qwen3-30B-A3B-Instruct-2507, Quantization=FP82026.0632.72
QwenLong-L1.5Backbone=Qwen3-30B-A3B-Instruct-2507, Quantization=FP82026.0632.21
Zero-shotBackbone=Qwen3-30B-A3B-Instruct-2507, Quantization=FP82026.0630.87
MemAgentBackbone=Qwen3-235B-A22B-Instruct-2507, Quantization=FP82026.0630.03
MemAgentBackbone=Qwen3-30B-A3B-Instruct-2507, Quantization=FP82026.0627.35