ResearchBenchmarksTokenization Speedup Comparison on WikiText-103Tokenization Speedup Comparison on WikiText-103Follow115Speedup Ratio (GPU-O vs CPU-BPE)GPUTOK-1.916828.436658.7989.1434Mar 3, 2026Evaluation resultsMethodMethodLinksSpeedup Ratio (GPU-O vs CPU-BPE)Speedup Ratio (GPU-O vs tiktoken)Speedup Ratio (GPU-O vs HF GPT2)GPUTOKSequence Length=131KSequence Length=131K2026.031151.6731.3GPUTOKSequence Length=16KSequence Length=16K2026.0331.13.798.34GPUTOKSequence Length=4KSequence Length=4K2026.03131.533.41GPUTOKSequence Length=1KSequence Length=1K2026.035.150.671.35GPUTOKSequence Length=256Sequence Length=2562026.032.580.380.91