List your company

Reading Comprehension on C3 (test)

77.38AccuracyQwen-1.5 14B (Teacher)
33.554444.932256.3167.6878Jul 23, 2024

Evaluation results

MethodLinks
Qwen-1.5 14B (Teacher)Model Scale=14B2024.0777.38
Qwen-1.5 1.8B + DDKDistillation=DDK2024.0765.53
Qwen-1.5 1.8B + KDDistillation=KD2024.0763.92
Qwen-1.5 1.8B + MiniLLMDistillation=MiniLLM2024.0763.37
Qwen-1.5 1.8B + TEDDistillation=TED2024.0763.18
Qwen-1.5 1.8B + CPT & DoReMiDistillation=CPT & DoReMi2024.0760.85
Qwen-1.5 1.8B + CPTDistillation=CPT2024.0760.3
Qwen-1.5 1.8B (Student)Model Scale=1.8B2024.0758.27
LLaMA2-13BModel Size=13B, Shots=0-shot2024.0746.03
TinyLLaMA-1.1B + DDKModel Size=1.1B, Shots=0-shot2024.0742.41
TinyLLaMA-1.1B + CPT & DoReMiModel Size=1.1B, Shots=0-shot2024.0739.02
TinyLLaMA-1.1B + CPTModel Size=1.1B, Shots=0-shot2024.0738.91
TinyLLaMA-1.1B + TEDModel Size=1.1B, Shots=0-shot2024.0737.61
TinyLLaMA-1.1B + KDModel Size=1.1B, Shots=0-shot2024.0737.43
TinyLLaMA-1.1B + MiniLLMModel Size=1.1B, Shots=0-shot2024.0737.18
TinyLLaMA-1.1BModel Size=1.1B, Shots=0-shot2024.0735.24