GPU Memory Usage on HotpotQA (Question Answering)
0.66Peak GPU Memory (GB)H²MT
Evaluation results
| Method | Links | |
|---|---|---|
| H²MTModel=SmolLM-135M2026.05 | 0.66 | |
| HMTModel=SmolLM-135M2026.05 | 0.95 | |
| HMTModel=Qwen3-4B2026.05 | 12.86 | |
| H²MTModel=Qwen3-4B2026.05 | 15.4 | |
| H²MTModel=Mistral-7B2026.05 | 27.43 | |
| HMTModel=Mistral-7B2026.05 | 28.71 | |
| H²MTModel=Qwen2.5-7B2026.05 | 28.91 | |
| HMTModel=Qwen2.5-7B2026.05 | 30.24 | |
| H²MTModel=Llama3.1-8B2026.05 | 30.41 | |
| HMTModel=Llama3.1-8B2026.05 | 31.45 | |
| H²MTModel=Qwen2.5-14B2026.05 | 55.68 | |
| HMTModel=Qwen2.5-14B2026.05 | 57.09 |