End-to-end RAG Generation on MS MARCO and Natural Questions
50.1F1 (QA)SPI
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SPILatency (ms)=92, Memory (GB)=4.22025.11 | 50.1 | 47.8 | 44.2 | 87.9 | |
| AtlasLatency (ms)=150, Memory (GB)=7.52025.11 | 48.3 | 45.2 | 42.7 | 86 | |
| RetroLatency (ms)=140, Memory (GB)=6.82025.11 | 47.9 | 44.7 | 42.3 | 85.4 | |
| HyDE-RAGLatency (ms)=155, Memory (GB)=6.92025.11 | 47.8 | 44.9 | 42.1 | 85.6 | |
| ColBERTv2-RAGLatency (ms)=128, Memory (GB)=5.82025.11 | 47.2 | 44.3 | 41.8 | 85.2 | |
| SPLADE-RAGLatency (ms)=115, Memory (GB)=5.42025.11 | 46.5 | 43.1 | 40.6 | 84.1 | |
| DPR-RAGLatency (ms)=145, Memory (GB)=7.22025.11 | 44.8 | 41.2 | 38.9 | 82.3 |