Pairwise Tokenizer Comparisons
Benchmarks
TaskDatasetSOTA resultTrendResults
Pairwise Tokenizer Comparisons Average (val)
0.76F1 Score
6
Pairwise Tokenizer Comparisons AYA 23 held-out (val)
92F1 Score
6
Pairwise Tokenizer Comparisons TIKTOKEN held-out (val)
89F1 Score
6
Pairwise Tokenizer Comparisons FALCON held-out (val)
83F1 Score
6
Pairwise Tokenizer Comparisons GPT-NEOX held-out (val)
100F1 Score
6
Pairwise Tokenizer Comparisons GPT-2 held-out (val)
0.67F1 Score
6
Pairwise Tokenizer Comparisons PHI-3-MINI held-out (val)
76F1 Score
6