Common Sense Reasoning on ARC, ARE, HS, OB, PI, RA, WG
39.3ARC ScoreHyLo-Llama-8MLA8GDN
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| HyLo-Llama-8MLA8GDNTeacher=8B, KV cache=7.8%, Training Context Length=8K, Backbone Model=Llama-3.2-1B2026.04 | 39.3 | 67.2 | 59.3 | 37.6 | 72 | 38.4 | 60.1 | 53.4 | |
| Zebra-Llama-1B (4MLA-12M2)Teacher=8B, KV cache=4%, Backbone Model=Llama-3.2-1B2026.04 | 39.1 | 65.4 | 56.9 | 37 | 72.3 | 34.5 | 57.9 | 51.8 | |
| HyLo-Llama-8MLA8M2Teacher=8B, KV cache=7.8%, Training Context Length=8K, Backbone Model=Llama-3.2-1B2026.04 | 38.8 | 66.7 | 58.3 | 37 | 72.3 | 37.4 | 59.7 | 52.9 | |
| HyLo-Llama-4MLA12GDNTeacher=8B, KV cache=3.9%, Training Context Length=8K, Backbone Model=Llama-3.2-1B2026.04 | 38.6 | 66.9 | 59.1 | 37.6 | 72.7 | 36.7 | 60.1 | 53.1 | |
| HyLo-Llama-4MLA12M2Teacher=8B, KV cache=3.9%, Training Context Length=8K, Backbone Model=Llama-3.2-1B2026.04 | 38.1 | 65.7 | 57.6 | 37 | 72.5 | 35.4 | 58.6 | 52.1 | |
| Zebra-Llama-1B (8MLA-8M2)Teacher=8B, KV cache=7.8%, Backbone Model=Llama-3.2-1B2026.04 | 38 | 66.4 | 58.2 | 38 | 72.7 | 36.9 | 61.3 | 53.1 | |
| MambaInLlama-1B-50%Teacher=8B, KV cache=50%, Backbone Model=Llama-3.2-1B2026.04 | 37.7 | 65.5 | 58.2 | 37.6 | 73.2 | 36.5 | 59.3 | 52.6 | |
| Llamba 1BTeacher=1B+70B, KV cache=0%, Backbone Model=Llama-3.2-1B2026.04 | 37.1 | 65.4 | 61.3 | 36.8 | 73.8 | 37.6 | 60.6 | 53.2 | |
| HyLo-Llama-8MLA8GDNTeacher=8B, KV cache=7.8%, Training Context Length=64K, Backbone Model=Llama-3.2-1B2026.04 | 36.4 | 64.4 | 57.2 | 37 | 72.3 | 37.1 | 58.4 | 51.8 | |
| HyLo-Llama-8MLA8M2Teacher=8B, KV cache=7.8%, Training Context Length=64K, Backbone Model=Llama-3.2-1B2026.04 | 36.3 | 63.4 | 56.1 | 35 | 71.2 | 36.6 | 58.6 | 51 | |
| HyLo-Llama-4MLA12GDNTeacher=8B, KV cache=3.9%, Training Context Length=64K, Backbone Model=Llama-3.2-1B2026.04 | 36 | 63.6 | 57.4 | 38.2 | 70.7 | 35.4 | 57.2 | 51.2 | |
| HyLo-Llama-4MLA12M2Teacher=8B, KV cache=3.9%, Training Context Length=64K, Backbone Model=Llama-3.2-1B2026.04 | 35.7 | 63.3 | 55.3 | 34.8 | 71.3 | 34.7 | 56.8 | 50.3 |