List your company

General Knowledge on GPQA (EM)

50Exact Match (EM)Nemotron-3-Ultra 550B-A55B-Base
31.092836.001440.9145.8186Jun 12, 2026

Evaluation results

MethodLinks
Nemotron-3-Ultra 550B-A55B-Baseshots=5-shot, reasoning=Chain-of-thought (CoT)2026.0650
Kimi-K2 Baseshots=5-shot, reasoning=Chain-of-thought (CoT)2026.0643.43
Mistral-Large-3 675B-Base-2512shots=5-shot, reasoning=Chain-of-thought (CoT)2026.0634.85
GLM-4.5 Baseshots=5-shot, reasoning=Chain-of-thought (CoT)2026.0634.85
DeepSeek-V3.2 Exp-Baseshots=5-shot, reasoning=Chain-of-thought (CoT)2026.0631.82