ResearchDatasetsMobile and IoT Device Latency BenchmarkMobile and IoT Device Latency BenchmarkFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsLanguage Model InferenceMobile and IoT Device Latency Benchmark llama.cpp (inference evaluation)4,215Throughput (Sample, tokens/s)16
Language Model InferenceMobile and IoT Device Latency Benchmark llama.cpp (inference evaluation)4,215Throughput (Sample, tokens/s)16