Question Answering on 3GPP 10% compressed Baseline Sampling (BS) (test)
77.72AccuracySFT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SFTstatus=Domain-fine-tuned model2025.12 | 77.72 | 8.94 | |
| EDU-32B*fine-tuned in communications=true2025.12 | 64.64 | -3.62 | |
| NTele-R2-8B*fine-tuned in communications=true2025.12 | 58.11 | -2.3 | |
| NTele-Omni-7B*fine-tuned in communications=true2025.12 | 57.87 | -2.71 | |
| Qwen3-1.7Bstatus=Base model2025.12 | 53.03 | -1.8 |