Language Model Evaluation on NLP Evaluation Suite (WG, PIQA, BoolQ, ARC-C, ARC-E, OBQA, HS, SciQ, LM, RTE)
60.14WGQK sharing
Evaluation Results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| QK sharingEPAS usage=w/o EPAS, Sharing Configuration=3/22, Implementation Source=Re-implementation of [10]2026.01 | 60.14 | 73.5 | 48.41 | 32.25 | 53.91 | 37.4 | 60.48 | 75.8 | 25 | 23.17 | 47.65 | 48.88 | |
| EPASEPAS usage=w/ EPAS, Sharing Configuration=3/222026.01 | 59.27 | 73.07 | 62.72 | 33.02 | 56.14 | 36.2 | 58.72 | 83.6 | 49.97 | 47.8 | 52.35 | 55.71 | |
| TinyLLaMA (Baseline)EPAS usage=w/o EPAS, Sharing Configuration=No Sharing2026.01 | 59.12 | 73.56 | 56.09 | 32.68 | 55.51 | 36.8 | 61.45 | 84.2 | 56.7 | 50.55 | 57.04 | 56.7 | |
| EPASEPAS usage=w/ EPAS, Sharing Configuration=No Sharing2026.01 | 58.25 | 73.01 | 63.33 | 31.57 | 56.44 | 36.2 | 58.17 | 85.9 | 56.1 | 52.45 | 56.32 | 57.07 | |
| EPASEPAS usage=w/ EPAS, Sharing Configuration=5/222026.01 | 58.02 | 73.18 | 60.7 | 31.23 | 55.85 | 36 | 57.95 | 83.1 | 47.58 | 44.69 | 50.9 | 54.47 | |
| QK sharingEPAS usage=w/o EPAS, Sharing Configuration=5/22, Implementation Source=Re-implementation of [10]2026.01 | 55.64 | 67.03 | 48.41 | 27.13 | 42.55 | 31 | 51.51 | 75.8 | 25 | 23.17 | 47.65 | 44.99 |