List your company

Expert-level Science Question Answering on GPQA diamond (Acc, #Tokens)

47.47AccuracyMUR
32.244436.197240.1544.1028Jul 20, 2025

Evaluation results

MethodLinks
MURBackbone=Qwen3-8B, Search Strategy=phi-Decoding2025.0747.472,359
MURBackbone=Qwen3-4B, Search Strategy=phi-Decoding2025.0741.92944
MURBackbone=Qwen3-1.7B, Search Strategy=Guided search2025.0732.832,005