Question Answering on QASPER (Rouge-L)
38.8Rouge-LH2MT
Evaluation Results
| Method | Links | |
|---|---|---|
| H2MTModel=Qwen2.5-14B2026.05 | 38.8 | |
| H2MTModel=Qwen2.5-7B2026.05 | 34.15 | |
| H2MTModel=Qwen3-4B2026.05 | 31.29 | |
| HMTModel=Qwen2.5-14B2026.05 | 29.7 | |
| H2MTModel=Llama3.1-8B2026.05 | 28.72 | |
| H2MTModel=SmolLM-135M2026.05 | 27.3 | |
| HMTModel=Llama3.1-8B2026.05 | 27 | |
| HMTModel=SmolLM-135M2026.05 | 20.3 | |
| BackboneModel=Llama3.1-8B2026.05 | 17.99 | |
| HMTModel=Qwen3-4B2026.05 | 15.74 | |
| HMTModel=Qwen2.5-7B2026.05 | 14.51 | |
| BackboneModel=Qwen2.5-7B2026.05 | 12.08 | |
| BackboneModel=SmolLM-135M2026.05 | 11.54 | |
| BackboneModel=Qwen3-4B2026.05 | 10.92 | |
| BackboneModel=Qwen2.5-14B2026.05 | 10.13 |