Embedding Evaluation on MTEB Clean
51.6Classification ScoreSSMoE
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| SSMoEModel=Qwen-MoE-7B, Evaluation Protocol=In-Context Learning, Prompting Method=PromptEOL2026.05 | 51.6 | 31.1 | 55.4 | 49.1 | 57.9 | 29.6 | 45.8 | |
| SSMoEModel=OLMoE-7B, Evaluation Protocol=In-Context Learning, Prompting Method=PromptEOL2026.05 | 50.6 | 16.4 | 51.2 | 42.4 | 47 | 30.6 | 39.7 | |
| SMoEModel=Qwen-MoE-7B, Evaluation Protocol=In-Context Learning, Prompting Method=PromptEOL2026.05 | 50.3 | 27.4 | 46.9 | 45.3 | 38 | 13.4 | 36.9 | |
| SSMoEModel=DeepSeekMoE-16B, Evaluation Protocol=In-Context Learning, Prompting Method=PromptEOL2026.05 | 48.6 | 21.6 | 51.2 | 44.9 | 50.1 | 29.9 | 41.1 | |
| MoEEModel=Qwen-MoE-7B, Evaluation Protocol=In-Context Learning, Prompting Method=PromptEOL2026.05 | 47.7 | 25.2 | 51.5 | 48.5 | 51.8 | 31.2 | 42.6 | |
| SMoEModel=DeepSeekMoE-16B, Evaluation Protocol=In-Context Learning, Prompting Method=PromptEOL2026.05 | 46.6 | 18.1 | 40.9 | 38.9 | 26.3 | 22 | 32.1 | |
| EVModel=OLMoE-7B, Evaluation Protocol=In-Context Learning, Prompting Method=PromptEOL2026.05 | 45.9 | 14.2 | 59.2 | 41.2 | 55.3 | 29.6 | 40.9 | |
| MoEEModel=DeepSeekMoE-16B, Evaluation Protocol=In-Context Learning, Prompting Method=PromptEOL2026.05 | 44.4 | 17.8 | 46.1 | 42.2 | 40.2 | 24.4 | 35.9 | |
| EVModel=DeepSeekMoE-16B, Evaluation Protocol=In-Context Learning, Prompting Method=PromptEOL2026.05 | 44 | 14.3 | 46.7 | 39.2 | 40 | 28.9 | 35.5 | |
| RouterModel=Qwen-MoE-7B, Evaluation Protocol=In-Context Learning, Prompting Method=PromptEOL2026.05 | 43.8 | 13.6 | 45.9 | 39.6 | 38.8 | 28.3 | 35 | |
| SMoEModel=OLMoE-7B, Evaluation Protocol=In-Context Learning, Prompting Method=PromptEOL2026.05 | 43.4 | 14.7 | 39.1 | 37.4 | 24.1 | 20.9 | 29.9 | |
| EVModel=Qwen-MoE-7B, Evaluation Protocol=In-Context Learning, Prompting Method=PromptEOL2026.05 | 43.4 | 13.7 | 47 | 40.3 | 41.6 | 30.3 | 36 | |
| RouterModel=DeepSeekMoE-16B, Evaluation Protocol=In-Context Learning, Prompting Method=PromptEOL2026.05 | 43.4 | 13.4 | 45.5 | 38.5 | 37.7 | 24.9 | 33.9 | |
| MoEEModel=OLMoE-7B, Evaluation Protocol=In-Context Learning, Prompting Method=PromptEOL2026.05 | 41.8 | 14.5 | 45.7 | 39.5 | 39.9 | 29.8 | 35.2 | |
| RouterModel=OLMoE-7B, Evaluation Protocol=In-Context Learning, Prompting Method=PromptEOL2026.05 | 41.2 | 13.7 | 45.3 | 37.5 | 39.9 | 28.4 | 34.3 |