List your company

Next Token Prediction on Amber 1.2T tokens

4.28BPDLLAMA2-7B
3.85246.73879.62512.5113Jul 25, 2024

Evaluation results

MethodLinks
LLAMA2-7Bquantization=2-bit post-training QuIP2024.074.280.4750.1256
LLAMA2-13Bquantization=2-bit post-training QuIP2024.074.510.47850.1444
LLaMA2-70Bquantization=2-bit post-training QuIP2024.076.390.58260.2504
Random Guess2024.0714.970.99990.9968