Llama
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Llama 8B 3.1
97TPR
2
LLaMA-3 Tokenizer Evaluation Data
7.006Throughput (Mbps)
2
LLaMA 13B
26,214,400Nova Gate Count
1
LLaMA 7B
16,777,216Nova
1
LLaMA 128K context 3.1-8B
72.8Dense Latency (ms)
1
LLaMA 64K context 3.1-8B
62.6Dense Latency (ms)
1
LLaMA 32K context 3.1-8B
61.2Dense Latency (ms)
1
LLaMA 8K context 3.1-8B
60.9Dense Latency (ms)
1
Llama 8B 3.1
0.03ΔPPL
1
LLaMA-7B
0.01Delta Perplexity (ΔPPL)
1
Llama 3.2 3B raw scores (test)
100Exact Match
1
Llama Instruct LLM latent mechanism 3.1
—Primary metric
0