Turkish Natural Language Understanding and Retrieval on TabiBench 1.0 (test)
84.25Text Clf F1YTU-Cosmos-BERT
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| YTU-Cosmos-BERT# of params (M)=1112025.12 | 84.25 | 93.6 | 84.68 | 84.16 | 31.5 | 71.78 | 74.29 | 53.8 | 72.26 | |
| TabiBERT# of params (M)=1492025.12 | 83.44 | 93.42 | 84.74 | 84.51 | 69.71 | 72.44 | 75.44 | 56.95 | 77.58 | |
| BERTurk# of params (M)=1102025.12 | 83.42 | 93.67 | 85.33 | 84.33 | 60.16 | 71.4 | 74.84 | 54.54 | 75.96 | |
| mmBERT# of params (M)=3072025.12 | 82.54 | 93.81 | 87.05 | 84.38 | 71.47 | 72.65 | 76.2 | 66.02 | 79.26 | |
| TurkishBERTweet# of params (M)=1632025.12 | 79.71 | 92.02 | 75.86 | 79.1 | 38.13 | 63.12 | 68.4 | 43.49 | 67.48 |