ResearchDatasetsBERT, GPT-2, and OPT Inference WorkloadBERT, GPT-2, and OPT Inference WorkloadFollowBenchmarksTaskDatasetSOTA methodSortMost resultsRecently updatedMost papersApplyTaskDatasetSOTA resultTrendResultsInference ThroughputBERT, GPT-2, and OPT Inference Workload BS=2, SL=25657,117.4Original Throughput (tokens/s)6
Inference ThroughputBERT, GPT-2, and OPT Inference Workload BS=2, SL=25657,117.4Original Throughput (tokens/s)6