Layer Selection Efficiency on Qwen3-1.7B
234Total Tokens ProcessedHALO
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| HALOBackbone=Qwen3-1.7B2026.06 | 234 | 650,000,000,000,000,000 | 15.4 | |
| PostNAS*Backbone=Qwen3-1.7B2026.06 | 50 | 800,000,000,000,000,000,000 | 2,561.3 | |
| KL-LSBackbone=Qwen3-1.7B2026.06 | 20 | 250,000,000,000,000,000,000 | 1,071.8 | |
| FlashMorphBackbone=Qwen3-1.7B2026.06 | 20 | 250,000,000,000,000,000 | 2.1 |