Question Answering on Composite-9 n=50
0.01Latency p50 (s)ColBERTv2-only
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ColBERTv2-onlyRetriever=ColBERTv22026.06 | 0.01 | 0.01 | 42 | 0 | |
| BM25-onlyRetriever=BM252026.06 | 0.04 | 0.06 | 42 | 0 | |
| BM25 + QwenRetriever=BM25, LLM=Qwen2026.06 | 1.74 | 4.98 | 74 | 0.06 | |
| ColBERTv2 + QwenRetriever=ColBERTv2, LLM=Qwen2026.06 | 1.8 | 6.95 | 82 | 0.06 | |
| MonolithicSystem type=Single-call2026.06 | 1.94 | 5.43 | 90 | 0.04 | |
| Regex-ScopedSystem type=Single-call scoped2026.06 | 2.64 | 6.85 | 90 | 0.02 | |
| HYBRID-ROUTEDSystem type=Hybrid-routed2026.06 | 2.86 | 7.82 | 85.7 | 0.09 | |
| Custom ReActArchitecture=ReAct2026.06 | 4.48 | 7.37 | 94.4 | 0 | |
| LangChain ReActFramework=LangChain, Architecture=ReAct2026.06 | 12.42 | 33.7 | 48 | 0.1 |