Question Answering on TeleQuAD (IID)
67.6BERTScore F1UB-SMoE
Evaluation results
| Method | Links | |
|---|---|---|
| UB-SMoEBudget=β42026.05 | 67.6 | |
| UB-SMoEBudget=β32026.05 | 65.83 | |
| A3SMoEBudget=β42026.05 | 65.63 | |
| SMoE-LLBBudget=β42026.05 | 65.41 | |
| SMoE-LLBBudget=β32026.05 | 65.09 | |
| A3SMoEBudget=β32026.05 | 65.06 | |
| FlexLoRABudget=β42026.05 | 62.65 | |
| SMoE-LLBBudget=β22026.05 | 61.15 | |
| A3SMoEBudget=β22026.05 | 61.04 | |
| A3SMoEBudget=Average2026.05 | 60.62 | |
| SMoE-LLBBudget=Average2026.05 | 59.99 | |
| UB-SMoEBudget=Average2026.05 | 59.63 | |
| UB-SMoEBudget=β22026.05 | 58.82 | |
| FlexLoRABudget=β32026.05 | 58.68 | |
| HetLoRABudget=β42026.05 | 58.05 | |
| HetLoRABudget=β32026.05 | 54.93 | |
| FlexLoRABudget=Average2026.05 | 51.98 | |
| A3SMoEBudget=β12026.05 | 50.76 | |
| HetLoRABudget=Average2026.05 | 49.3 | |
| SMoE-LLBBudget=β12026.05 | 48.31 | |
| FlexLoRABudget=β22026.05 | 47.58 | |
| UB-SMoEBudget=β12026.05 | 46.25 | |
| HetLoRABudget=β22026.05 | 44.87 | |
| HetLoRABudget=β12026.05 | 39.35 | |
| FlexLoRABudget=β12026.05 | 39.02 |