Turkish Natural Language Understanding on TabiBench 1.0 (test)
77.58TabiBench ScoreTabiBERT
Evaluation results
| Method | Links | |
|---|---|---|
| TabiBERTNumber of Parameters (M)=149, Data Size (GB)=426, Context Length=8,192, Code & Math=true, Flash Attention=true2025.12 | 77.58 | |
| BERTurkNumber of Parameters (M)=110, Data Size (GB)=35, Context Length=512, Code & Math=false, Flash Attention=false2025.12 | 75.96 | |
| YTU-Cosmos-BERTNumber of Parameters (M)=111, Data Size (GB)=75, Context Length=512, Code & Math=false, Flash Attention=false2025.12 | 72.26 | |
| TurkishBERTweetNumber of Parameters (M)=163, Data Size (GB)=110, Context Length=512, Code & Math=false, Flash Attention=false2025.12 | 67.48 |