Aggregate NLP Performance on English NLP Benchmark Suite
70.3Avg Task MetricPaLM
Evaluation results
| Method | Links | |
|---|---|---|
| PaLMModel Size (Billions of Parameters)=540, Num Tokens (Billions of Tokens)=780, Training FLOP Count (Zettaflops)=2527.22022.04 | 70.3 | |
| ChinchillaModel Size (Billions of Parameters)=70, Num Tokens (Billions of Tokens)=1400, Training FLOP Count (Zettaflops)=588.02022.04 | 65.2 | |
| PaLMModel Size (Billions of Parameters)=62, Num Tokens (Billions of Tokens)=795, Training FLOP Count (Zettaflops)=295.72022.04 | 64.8 | |
| GopherModel Size (Billions of Parameters)=280, Num Tokens (Billions of Tokens)=300, Training FLOP Count (Zettaflops)=504.02022.04 | 59.5 | |
| PaLMModel Size (Billions of Parameters)=8, Num Tokens (Billions of Tokens)=780, Training FLOP Count (Zettaflops)=37.42022.04 | 51.2 |