Peak GPU Memory (GB) on QASPER (Question Answering)
0.53Peak GPU Memory (GB)HMT
Evaluation results
| Method | Links | |
|---|---|---|
| HMTModel=SmolLM-135M2026.05 | 0.53 | |
| H²MTModel=SmolLM-135M2026.05 | 0.71 | |
| H²MTModel=Qwen3-4B2026.05 | 10.46 | |
| HMTModel=Qwen3-4B2026.05 | 15.24 | |
| H²MTModel=Qwen2.5-7B2026.05 | 17.46 | |
| H²MTModel=Llama3.1-8B2026.05 | 18.24 | |
| HMTModel=Mistral-7B2026.05 | 27.73 | |
| H²MTModel=Qwen2.5-14B2026.05 | 28.27 | |
| HMTModel=Qwen2.5-7B2026.05 | 28.52 | |
| HMTModel=Llama3.1-8B2026.05 | 29.54 | |
| H²MTModel=Mistral-7B2026.05 | 30.37 | |
| HMTModel=Qwen2.5-14B2026.05 | 54.21 |