List your company

5-shot Performance on CEval, MMLU, GSM8K, Arc-E, Arc-C (test)

79.86CEvalQwen-14B
60.162465.276270.3975.5038Jul 23, 2024

Evaluation results

MethodLinks
Qwen-14BFew-shot=5-shot, Model Size=14B2024.0779.8666.369.1489.2482.2577.36
DDK (Ours)Few-shot=5-shot, Model Size=1.8B, Strategy=DDK2024.0765.3847.5955.1976.6457.0160.36
Qwen-1.5 (Student) + TEDFew-shot=5-shot, Model Size=1.8B, Strategy=TED2024.0762.1145.4749.4374.9455.4757.48
Qwen-1.5 (Student) + MiniLLMFew-shot=5-shot, Model Size=1.8B, Strategy=MiniLLM2024.0762.0345.4149.2875.0254.8757.32
Qwen-1.5 (Student)Few-shot=5-shot, Model Size=1.8B2024.0761.9645.5938.472.1652.1154.04
Qwen-1.5 (Student) + KDFew-shot=5-shot, Model Size=1.8B, Strategy=KD2024.0761.6644.2850.2673.8754.6956.95
Qwen-1.5 (Student) + CPTFew-shot=5-shot, Model Size=1.8B, Strategy=CPT2024.0760.9245.643.3673.152.2855.05