# Scientific Reasoning on SuperGPQA (test) Source: [Scientific Reasoning on SuperGPQA (test)]() Collection index: [llms.txt]() Data updated: 2026-05-22T08:20:55.450Z Evaluation of model performance on the test set of the SuperGPQA dataset for Scientific Reasoning, measured using Pass@1. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Scientific Reasoning | | Dataset (including any stated split) | SuperGPQA (test) | | Metric | Pass@1 | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 25 of 25 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Pass@1](): Higher is better; unit: PERCENT. ## Recorded results | Method | Pass@1 | Result date | Report paper | | --- | --- | --- | --- | | GPT-5.4-xhigh | 77.7 | Not recorded | 6a0fe32ef984739ed6739f26 | | DeepSeek-V3.2 | 75 | Not recorded | 6a0fe32ef984739ed6739f26 | | MiroThinker-v1.5 | 73.7 | Not recorded | 6a0fe32ef984739ed6739f26 | | GPT-5.4-xhigh | 73.5 | Not recorded | 6a0fe32ef984739ed6739f26 | | SR2AM-v1.0-30B | 73 | Not recorded | 6a0fe32ef984739ed6739f26 | | Kimi-K2.5 | 72.5 | Not recorded | 6a0fe32ef984739ed6739f26 | | DeepSeek-V3.2 | 71.8 | Not recorded | 6a0fe32ef984739ed6739f26 | | GLM-4.6 | 67 | Not recorded | 6a0fe32ef984739ed6739f26 | | Qwen3-235B | 66.3 | Not recorded | 6a0fe32ef984739ed6739f26 | | ASearcher-Web-QWQ-v2 | 65 | Not recorded | 6a0fe32ef984739ed6739f26 | | Qwen3-30B-A3B | 63.1 | Not recorded | 6a0fe32ef984739ed6739f26 | | Qwen3-30B-A3B | 62.4 | Not recorded | 6a0fe32ef984739ed6739f26 | | WebExplorer-8B | 60.3 | Not recorded | 6a0fe32ef984739ed6739f26 | | GPT-OSS-120B-high | 58.6 | Not recorded | 6a0fe32ef984739ed6739f26 | | K2-Think-V2-high | 58 | Not recorded | 6a0fe32ef984739ed6739f26 | | SR2AM-v0.1-8B | 58 | Not recorded | 6a0fe32ef984739ed6739f26 | | A2FM | 55.3 | Not recorded | 6a0fe32ef984739ed6739f26 | | Tongyi-DeepResearch | 54.9 | Not recorded | 6a0fe32ef984739ed6739f26 | | SimpleTIR-32B | 50.5 | Not recorded | 6a0fe32ef984739ed6739f26 | | WebSailor-32B | 47.3 | Not recorded | 6a0fe32ef984739ed6739f26 | | SimpleTIR-7B | 41.7 | Not recorded | 6a0fe32ef984739ed6739f26 | | ASearcher-Web-7B | 35.7 | Not recorded | 6a0fe32ef984739ed6739f26 | | AFM-Web-7B-RL | 32.4 | Not recorded | 6a0fe32ef984739ed6739f26 | | WebSailor-7B | 28 | Not recorded | 6a0fe32ef984739ed6739f26 | | AFM-Code-7B-RL | 23.6 | Not recorded | 6a0fe32ef984739ed6739f26 | ### GPT-5.4-xhigh Pass@1: 77.7. Result ID: 6a1011e2fbc373592c08fa2f. [Reporting paper]() Recorded evaluation configuration: {"Size":"—","# Reas. Tokens":"4821.8","Reasoning Paradigm":"Pretrained LLMs + Tools"}. This record does not assert independent reproduction. ### DeepSeek-V3.2 Pass@1: 75. Result ID: 6a1011e2fbc373592c08fa2d. [Reporting paper]() Recorded evaluation configuration: {"Size":"685B","# Reas. Tokens":"3011.5","Reasoning Paradigm":"Pretrained LLMs + Tools"}. This record does not assert independent reproduction. ### MiroThinker-v1.5 Pass@1: 73.7. Result ID: 6a1011e2fbc373592c08fa38. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Size":"30B","# Reas. Tokens":"11295.2","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### GPT-5.4-xhigh Pass@1: 73.5. Result ID: 6a1011e2fbc373592c08fa28. [Reporting paper]() Recorded evaluation configuration: {"Size":"—","# Reas. Tokens":"8810.3","Reasoning Paradigm":"Reasoning LLMs"}. This record does not assert independent reproduction. ### SR2AM-v1.0-30B Pass@1: 73. Result ID: 6a1011e2fbc373592c08fa3d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Size":"30B","# Reas. Tokens":"5517.7","Reasoning Paradigm":"Self-Regulated Simulative Reasoning"}. This record does not assert independent reproduction. ### Kimi-K2.5 Pass@1: 72.5. Result ID: 6a1011e2fbc373592c08fa2e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Size":"1024B","# Reas. Tokens":"6413.1","Reasoning Paradigm":"Pretrained LLMs + Tools"}. This record does not assert independent reproduction. ### DeepSeek-V3.2 Pass@1: 71.8. Result ID: 6a1011e2fbc373592c08fa27. [Reporting paper]() Recorded evaluation configuration: {"Size":"685B","# Reas. Tokens":"9306.2","Reasoning Paradigm":"Reasoning LLMs"}. This record does not assert independent reproduction. ### GLM-4.6 Pass@1: 67. Result ID: 6a1011e2fbc373592c08fa2c. [Reporting paper]() Recorded evaluation configuration: {"Size":"357B","# Reas. Tokens":"3580.4","Reasoning Paradigm":"Pretrained LLMs + Tools"}. This record does not assert independent reproduction. ### Qwen3-235B Pass@1: 66.3. Result ID: 6a1011e2fbc373592c08fa2b. [Reporting paper]() Recorded evaluation configuration: {"Size":"235B","# Reas. Tokens":"6467.4","Reasoning Paradigm":"Pretrained LLMs + Tools"}. This record does not assert independent reproduction. ### ASearcher-Web-QWQ-v2 Pass@1: 65. Result ID: 6a1011e2fbc373592c08fa36. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"32B","# Reas. Tokens":"116752.9","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### Qwen3-30B-A3B Pass@1: 63.1. Result ID: 6a1011e2fbc373592c08fa25. [Reporting paper]() Recorded evaluation configuration: {"Size":"30B","# Reas. Tokens":"8269.1","Reasoning Paradigm":"Reasoning LLMs"}. This record does not assert independent reproduction. ### Qwen3-30B-A3B Pass@1: 62.4. Result ID: 6a1011e2fbc373592c08fa29. [Reporting paper]() Recorded evaluation configuration: {"Size":"30B","# Reas. Tokens":"5410.1","Reasoning Paradigm":"Pretrained LLMs + Tools"}. This record does not assert independent reproduction. ### WebExplorer-8B Pass@1: 60.3. Result ID: 6a1011e2fbc373592c08fa33. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"8B","# Reas. Tokens":"3616.9","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### GPT-OSS-120B-high Pass@1: 58.6. Result ID: 6a1011e2fbc373592c08fa2a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"120B","# Reas. Tokens":"2700.4","Reasoning Paradigm":"Pretrained LLMs + Tools"}. This record does not assert independent reproduction. ### K2-Think-V2-high Pass@1: 58. Result ID: 6a1011e2fbc373592c08fa26. [Reporting paper]() Recorded evaluation configuration: {"Size":"73B","# Reas. Tokens":"31905.2","Reasoning Paradigm":"Reasoning LLMs"}. This record does not assert independent reproduction. ### SR2AM-v0.1-8B Pass@1: 58. Result ID: 6a1011e2fbc373592c08fa3c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Size":"8B","# Reas. Tokens":"3697.6","Reasoning Paradigm":"Self-Regulated Simulative Reasoning"}. This record does not assert independent reproduction. ### A2FM Pass@1: 55.3. Result ID: 6a1011e2fbc373592c08fa3b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"32B","# Reas. Tokens":"23424.8","Reasoning Paradigm":"Mode Routing"}. This record does not assert independent reproduction. ### Tongyi-DeepResearch Pass@1: 54.9. Result ID: 6a1011e2fbc373592c08fa37. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"30B","# Reas. Tokens":"7431.8","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### SimpleTIR-32B Pass@1: 50.5. Result ID: 6a1011e2fbc373592c08fa34. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"32B","# Reas. Tokens":"5174.8","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### WebSailor-32B Pass@1: 47.3. Result ID: 6a1011e2fbc373592c08fa35. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"32B","# Reas. Tokens":"1055.2","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### SimpleTIR-7B Pass@1: 41.7. Result ID: 6a1011e2fbc373592c08fa31. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"7B","# Reas. Tokens":"3551.7","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### ASearcher-Web-7B Pass@1: 35.7. Result ID: 6a1011e2fbc373592c08fa30. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"7B","# Reas. Tokens":"601.4","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### AFM-Web-7B-RL Pass@1: 32.4. Result ID: 6a1011e2fbc373592c08fa39. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"7B","# Reas. Tokens":"2608.6","Reasoning Paradigm":"Workflow Distillation"}. This record does not assert independent reproduction. ### WebSailor-7B Pass@1: 28. Result ID: 6a1011e2fbc373592c08fa32. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"7B","# Reas. Tokens":"2211.5","Reasoning Paradigm":"Unregulated Deliberation"}. This record does not assert independent reproduction. ### AFM-Code-7B-RL Pass@1: 23.6. Result ID: 6a1011e2fbc373592c08fa3a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Size":"7B","# Reas. Tokens":"11205.5","Reasoning Paradigm":"Workflow Distillation"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.