Qwen Evaluation Suite
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Qwen3-1.7B Evaluation Suite (avg)
58.64Average Performance
38
Qwen3-0.6B Evaluation Suite average
47.8Average Performance
24
Qwen Evaluation Suite Prompt shift Qwen3
100Accuracy
2
Qwen3 Evaluation Suite Verbalizer shift
100Accuracy
1
Qwen3 Evaluation Suite Canonical
100Accuracy
1