Inference Speed Benchmark
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Inference Speed Benchmark per-sample
2.28Inference Time (s)
12
Inference Speed Benchmark
12.3Inference Speed (s)
12
Inference Speed Benchmark
5,076Inference FPS
7
Inference Speed Benchmark batch size 16, 1s samples
98.61xRT (GPU)
5