ResearchTasksPretokenization EncodingFollowBenchmarksDataset NameSOTA MethodSortMost resultsRecently updatedMost papersApplyDataset NameSOTA methodMetricTrendResultsLast UpdatedLLaMA-3 Tokenizer Evaluation DataPeek27.006Throughput (Mbps)2Feb 26, 2026