Question Answering on OpenROAD (Rouge-L)
33.41Rouge-LHMT
Evaluation Results
| Method | Links | |
|---|---|---|
| HMTModel=Qwen3-4B2026.05 | 33.41 | |
| H2MTModel=Qwen3-4B2026.05 | 32.95 | |
| H2MTModel=Qwen2.5-14B2026.05 | 32.6 | |
| HMTModel=Qwen2.5-14B2026.05 | 32 | |
| H2MTModel=Qwen2.5-7B2026.05 | 30.65 | |
| HMTModel=Llama3.1-8B2026.05 | 29.4 | |
| H2MTModel=Llama3.1-8B2026.05 | 28.8 | |
| BackboneModel=Qwen2.5-7B2026.05 | 27.44 | |
| BackboneModel=Qwen2.5-14B2026.05 | 27.37 | |
| BackboneModel=Llama3.1-8B2026.05 | 27.3 | |
| HMTModel=Qwen2.5-7B2026.05 | 26.09 | |
| BackboneModel=Qwen3-4B2026.05 | 25.13 | |
| H2MTModel=SmolLM-135M2026.05 | 24.4 | |
| HMTModel=SmolLM-135M2026.05 | 22.76 | |
| BackboneModel=SmolLM-135M2026.05 | 18.47 |