ResearchBenchmarksSemantic Caching on PromptBenchFollow1,866.58End-to-End Latency (min)MVR-cache1,823.43522,114.66262,405.892,697.1174May 24, 2026Evaluation ResultsMethodMethodLinksEnd-to-End Latency (min)Internal Processing Time (min)MVR-cache2026.051,866.5827.49vCache2026.051,870.5719.58ColBert2026.052,294.38150.32POQD2026.052,945.2959.6