ResearchTasksSecure LLM InferenceSecure LLM InferenceFollowBenchmarksDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyDatasetSOTA methodMetricTrendResultsLast updatedMain prompt lengths 16, 64Bifrost+4.269TTFT12Jun 17, 2026LLaMA 8B 3.1Sigma6,517Sigma (ms)3Jun 9, 2026LLaMA 7BSigma6,053Sigma Latency (ms)3Jun 9, 2026