List your company
ResearchFormerly WizWand

Question Answering on GPQA Diamond (GPQA metric)

69.19GPQA ScoreOriginal
4.408421.226738.04554.8633Jun 9, 2026
Updated 4mo ago

Evaluation results

MethodLinks
OriginalModel=Seed-OSS-36B-Instruct, MLP Sparsity=0%2026.0669.19
SpenseGPT+Model=Seed-OSS-36B-Instruct, MLP Sparsity=25%2026.0668.18
SpenseGPTModel=Seed-OSS-36B-Instruct, MLP Sparsity=25%2026.0666.84
SpenseGPT+Model=Qwen3-32B, MLP Sparsity=25%2026.0666.83
SpenseGPT+Model=Seed-OSS-36B-Instruct, MLP Sparsity=37.5%2026.0666.5
OriginalModel=Qwen3-32B, MLP Sparsity=0%2026.0665.49
SpenseGPTModel=Seed-OSS-36B-Instruct, MLP Sparsity=37.5%2026.0664.31
SpenseGPTModel=Qwen3-32B, MLP Sparsity=25%2026.0662.46
SpenseGPT+Model=Qwen3-32B, MLP Sparsity=37.5%2026.0661.45
SparseGPTModel=Seed-OSS-36B-Instruct, MLP Sparsity=50%2026.0660.27
SpenseGPTModel=Qwen3-32B, MLP Sparsity=37.5%2026.0659.43
SparseGPTModel=Qwen3-32B, MLP Sparsity=50%2026.0653.71
HyperPruneModel=Qwen3-32B, MLP Sparsity=50%2026.0623.57
WandaModel=Qwen3-32B, MLP Sparsity=50%2026.0615.49
HyperPruneModel=Seed-OSS-36B-Instruct, MLP Sparsity=50%2026.067.58
WandaModel=Seed-OSS-36B-Instruct, MLP Sparsity=50%2026.066.9