Olmo
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
OLMo-7B
55.3TPR@1%FPR
16
OLMo near-IID Dolma 3 (test)
0.723AUC
13
OLMo-7B memorized sequences
87.9Success Rate (%)
11
OLMo3 Adapt
96GSM8K
10
OLMO initial checkpoint
0.54AUC
8
Olmo public artifacts 3
481Verified Dependency Edges
7
Olmo-7B
98.6Tail-patch (%)
5
OLMo Pretraining Mixture (Temporal held-out)
95.5Web Source Estimate
3
OLMo-1B 24k sequence length
6,161Training Time (ms)
2
OLMo-2 Held-out Evals
24.4AGIEval Score
2
OLMo Benchmarks 2 (dev)
16.1NQ Score
2
OLMo (val)
2.24Base CE
1