Tokenization on Korean General
905.82Avg Tokens/SampleQwen3
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen32026.01 | 905.82 | |
| OpenAI o200kVocabulary Size=200k2026.01 | 811.71 | |
| A.X K12026.01 | 526.72 |
Loading the SOTA2 catalog…
| Method | Links | |
|---|---|---|
| Qwen32026.01 | 905.82 | |
| OpenAI o200kVocabulary Size=200k2026.01 | 811.71 | |
| A.X K12026.01 | 526.72 |