Summarization on Summary (test)
41.31ScoreSeqTopK
Evaluation Results
| Method | Links | |
|---|---|---|
| SeqTopKBackbone=Qwen1.5-MoE-A2.7B, K=4, Sparsity-Ratio=1/8, Evaluation protocol=0-shot, Training=fine-tuned2025.11 | 41.31 | |
| TopKBackbone=Qwen1.5-MoE-A2.7B, K=4, Sparsity-Ratio=1/8, Evaluation protocol=0-shot, Training=fine-tuned2025.11 | 39.21 | |
| MRL-TopKBackbone=Qwen1.5-MoE-A2.7B, K=4, Sparsity-Ratio=1/8, Evaluation protocol=0-shot, Training=fine-tuned2025.11 | 38.74 | |
| BatchTopKBackbone=Qwen1.5-MoE-A2.7B, K=4, Sparsity-Ratio=1/8, Evaluation protocol=0-shot, Training=fine-tuned2025.11 | 37.1 | |
| BaseBackbone=Qwen1.5-MoE-A2.7B, K=4, Sparsity-Ratio=1/8, Evaluation protocol=0-shot, Training=fine-tuned2025.11 | 28.29 |