General Knowledge Evaluation on C-Eval (val)
34.32AccuracyLLaMA2-13B
Evaluation Results
| Method | Links | |
|---|---|---|
| LLaMA2-13BModel Size=13B, Shots=0-shot2024.07 | 34.32 | |
| TinyLLaMA-1.1B + DDKModel Size=1.1B, Shots=0-shot2024.07 | 27.86 | |
| TinyLLaMA-1.1B + TEDModel Size=1.1B, Shots=0-shot2024.07 | 27.49 | |
| TinyLLaMA-1.1B + KDModel Size=1.1B, Shots=0-shot2024.07 | 27.12 | |
| TinyLLaMA-1.1B + CPTModel Size=1.1B, Shots=0-shot2024.07 | 26.79 | |
| TinyLLaMA-1.1B + MiniLLMModel Size=1.1B, Shots=0-shot2024.07 | 26.74 | |
| TinyLLaMA-1.1B + CPT & DoReMiModel Size=1.1B, Shots=0-shot2024.07 | 26.37 | |
| MLFiltering Strategy=ML2026.04 | 26.15 | |
| MKC-eFiltering Strategy=MKC-e2026.04 | 25.56 | |
| HQFiltering Strategy=HQ2026.04 | 24.89 | |
| ML (Q3)Filtering Strategy=ML (Q3)2026.04 | 24.67 | |
| HQ seedFiltering Strategy=HQ seed2026.04 | 24.44 | |
| TinyLLaMA-1.1BModel Size=1.1B, Shots=0-shot2024.07 | 23.92 | |
| ML (15%)Filtering Strategy=ML (15%)2026.04 | 23.7 | |
| No filteringFiltering Strategy=No filtering2026.04 | 22.88 |