Peak GPU Memory Usage on NarrativeQA (Question Answering)
0.58Peak GPU Memory (GB)H²MT
Evaluation Results
| Method | Links | |
|---|---|---|
| H²MTModel=SmolLM-135M2026.05 | 0.58 | |
| HMTModel=SmolLM-135M2026.05 | 0.97 | |
| HMTModel=Qwen3-4B2026.05 | 13.23 | |
| H²MTModel=Mistral-7B2026.05 | 15.01 | |
| H²MTModel=Qwen3-4B2026.05 | 15.42 | |
| H²MTModel=Qwen2.5-7B2026.05 | 16.86 | |
| H²MTModel=Llama3.1-8B2026.05 | 18.14 | |
| HMTModel=Mistral-7B2026.05 | 28.74 | |
| HMTModel=Qwen2.5-7B2026.05 | 30.31 | |
| HMTModel=Llama3.1-8B2026.05 | 31.52 | |
| H²MTModel=Qwen2.5-14B2026.05 | 31.81 | |
| HMTModel=Qwen2.5-14B2026.05 | 57.12 |