Question Answering on 3GPP 10% compressed SFT Sampling (test)
72.52AccuracySFT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| SFTstatus=Domain-fine-tuned model2025.12 | 72.52 | 1.65 | |
| EDU-32B*fine-tuned in communications=true2025.12 | 67.55 | 0.72 | |
| NTele-R2-8B*fine-tuned in communications=true2025.12 | 59.13 | -0.59 | |
| NTele-Omni-7B*fine-tuned in communications=true2025.12 | 58.89 | -0.99 | |
| Qwen3-1.7Bstatus=Base model2025.12 | 55.05 | 1.94 |