Time-to-First-Token (TTFT) Latency on Controlled synthetic corpus Config A 1.0 (test)
57.9TTFT p50 LatencyAPC+Optimized
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| APC+OptimizedHardware=RTX 4060 Ti, Model=Qwen2.5-1.5B, Strategy=APC with optimized ordering (CacheWeaver)2026.06 | 57.9 | 161.3 | 68.1 | 18.9 | |
| APC+RetrievalHardware=RTX 4060 Ti, Model=Qwen2.5-1.5B, Strategy=APC with retrieval order2026.06 | 72.5 | 159.9 | 69.9 | 17.9 | |
| APC+SortedHardware=RTX 4060 Ti, Model=Qwen2.5-1.5B, Strategy=APC with lexicographic sorting2026.06 | 108 | 164.9 | 101.7 | 25.3 | |
| No CacheHardware=RTX 4060 Ti, Model=Qwen2.5-1.5B, Strategy=Baseline2026.06 | 158.2 | 161.4 | 158.3 | 0 |