Tulu
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Tulu-3 (dev)
60.85Knowledge Score
35
TULU 3 (dev)
0.109Active KV-cache Memory (GiB)
32
TULU-3 (dev)
13.13Total FLOPs (teraFLOPs)
32
Tulu3 Evaluation Suite pool (test)
92.54ARC
25
Tulu
85Grammar Accuracy
12
Tulu
0.161LDS Correlation
10
Tulu3 SFT (Original)
79.9General Score
8
Tulu3 SFT (Expanded)
65.77SFT Score
8
Tulu3 Mix Aya
68AUROC
8
Tulu 2 DPO 7B
1Similarity Score
7
Tulu-2 13B
1.256HV Score
3