Question Answering on OpenROAD (Peak GPU memory)
0.66Peak GPU memory (GB)H²MT
Evaluation results
| Method | Links | |
|---|---|---|
| H²MTModel=SmolLM-135M2026.05 | 0.66 | |
| HMTModel=SmolLM-135M2026.05 | 0.96 | |
| H²MTModel=Qwen3-4B2026.05 | 17.1 | |
| HMTModel=Qwen3-4B2026.05 | 18.31 | |
| H²MTModel=Mistral-7B2026.05 | 27.92 | |
| H²MTModel=Qwen2.5-7B2026.05 | 29.43 | |
| H²MTModel=Llama3.1-8B2026.05 | 30.53 | |
| HMTModel=Mistral-7B2026.05 | 31.18 | |
| HMTModel=Llama3.1-8B2026.05 | 32.15 | |
| HMTModel=Qwen2.5-7B2026.05 | 32.77 | |
| H²MTModel=Qwen2.5-14B2026.05 | 55.85 | |
| HMTModel=Qwen2.5-14B2026.05 | 58.99 |