ASR Serving Latency on Synthetic
64P50 TTFT (ms)FCFS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| FCFSRate (req/s)=12026.03 | 64 | 84.8 | 158 | |
| FCFSRate (req/s)=52026.03 | 66 | 117.7 | 242.2 | |
| SJFRate (req/s)=12026.03 | 67.1 | 88.3 | 162.8 | |
| SJFRate (req/s)=52026.03 | 68.4 | 121.1 | 262.9 | |
| HRRNRate (req/s)=12026.03 | 68.6 | 89.9 | 164 | |
| HRRNRate (req/s)=52026.03 | 68.8 | 122.1 | 260.3 | |
| FCFSRate (req/s)=102026.03 | 120.3 | 214.8 | 741.1 | |
| HRRNRate (req/s)=102026.03 | 124.3 | 239.5 | 881.6 | |
| SJFRate (req/s)=102026.03 | 126.8 | 229.3 | 849 | |
| SJFRate (req/s)=152026.03 | 267.1 | 2,287.3 | 8,902.4 | |
| SJFRate (req/s)=202026.03 | 906.7 | 3,079.7 | 22,478.8 | |
| SJFRate (req/s)=252026.03 | 1,574.4 | 3,966.3 | 25,336.7 | |
| HRRNRate (req/s)=152026.03 | 2,263.5 | 4,520.1 | 9,635.5 | |
| FCFSRate (req/s)=152026.03 | 2,654 | 4,788.6 | 7,529.9 | |
| HRRNRate (req/s)=202026.03 | 4,702.7 | 6,939.6 | 16,664.3 | |
| HRRNRate (req/s)=252026.03 | 6,577.1 | 9,340.9 | 22,378.3 | |
| FCFSRate (req/s)=202026.03 | 6,661.2 | 8,686.9 | 14,325.2 | |
| FCFSRate (req/s)=252026.03 | 9,923.9 | 12,123.3 | 19,664.3 |