Question Answering on HotpotQA (TTFT)
204TTFT (ms)H2MT
Evaluation results
| Method | Links | |
|---|---|---|
| H2MTBackbone=Qwen2.5-7B2026.05 | 204 | |
| H2MTBackbone=SmolLM-135M2026.05 | 221.7 | |
| H2MTBackbone=Qwen3-4B2026.05 | 225.94 | |
| H2MTBackbone=Mistral-7B2026.05 | 253.31 | |
| HMTBackbone=SmolLM-135M2026.05 | 259.75 | |
| H2MTBackbone=Qwen2.5-14B2026.05 | 345.11 | |
| H2MTBackbone=Llama3.1-8B2026.05 | 498.46 | |
| HMTBackbone=Qwen3-4B2026.05 | 614.77 | |
| HMTBackbone=Qwen2.5-7B2026.05 | 893.38 | |
| HMTBackbone=Mistral-7B2026.05 | 966.38 | |
| HMTBackbone=Llama3.1-8B2026.05 | 992.73 | |
| HMTBackbone=Qwen2.5-14B2026.05 | 1,959.66 |