List your company
ResearchFormerly WizWand

Code on LiveCodeBench V5-6

50.8AccuracyReasoning Memory
10.55221.00131.4541.899Apr 1, 2026
Updated 7mo ago

Evaluation results

MethodLinks
Reasoning MemoryBackbone=Qwen3-32B, Ret.=Proc., m=302026.0450.8
Reasoning MemoryBackbone=Qwen3-32B, Ret.=Proc., m=82026.0450.3
Length ScalingBackbone=Qwen3-32B, Ret.=N/A, m=302026.0447.6
No RAGBackbone=Qwen3-32B, Ret.=N/A, m=82026.0446.5
Length ScalingBackbone=Qwen3-32B, Ret.=N/A, m=82026.0444.4
Trajectory RAG (Prefix)Backbone=Qwen3-32B, Ret.=Proc., m=82026.0443.2
Document RAG (Google)Backbone=Qwen3-32B, Ret.=Fact., m=82026.0442.6
Trajectory RAG (Summary)Backbone=Qwen3-32B, Ret.=Proc., m=82026.0441.8
Reasoning MemoryBackbone=OpenThinker3-7B, Ret.=Proc., m=302026.0441.2
Reasoning MemoryBackbone=OpenThinker3-7B, Ret.=Proc., m=82026.0439.7
Length ScalingBackbone=OpenThinker3-7B, Ret.=N/A, m=82026.0434.4
Length ScalingBackbone=OpenThinker3-7B, Ret.=N/A, m=302026.0434.3
Template RAG (Self-Discover)Backbone=Qwen3-32B, Ret.=Proc., m=82026.0433.9
Reasoning MemoryBackbone=DeepSeek-R1-Distill-Llama-8B, Ret.=Proc., m=302026.0432.5
Length ScalingBackbone=DeepSeek-R1-Distill-Llama-8B, Ret.=N/A, m=302026.0430.2
Reasoning MemoryBackbone=DeepSeek-R1-Distill-Llama-8B, Ret.=Proc., m=82026.0429.2
Document RAG (CompactDS)Backbone=Qwen3-32B, Ret.=Fact., m=82026.0428.4
Template RAG (Self-Discover)Backbone=OpenThinker3-7B, Ret.=Proc., m=82026.0427.9
Length ScalingBackbone=DeepSeek-R1-Distill-Llama-8B, Ret.=N/A, m=82026.0427.8
Template RAG (ReasonFlux)Backbone=Qwen3-32B, Ret.=Proc., m=82026.0427.8
Template RAG (ReasonFlux)Backbone=OpenThinker3-7B, Ret.=Proc., m=82026.0426.8
No RAGBackbone=OpenThinker3-7B, Ret.=N/A, m=82026.0426.6
Trajectory RAG (Summary)Backbone=OpenThinker3-7B, Ret.=Proc., m=82026.0426
Document RAG (CompactDS)Backbone=OpenThinker3-7B, Ret.=Fact., m=82026.0425.8
Trajectory RAG (Prefix)Backbone=OpenThinker3-7B, Ret.=Proc., m=82026.0424.9
Template RAG (Self-Discover)Backbone=DeepSeek-R1-Distill-Llama-8B, Ret.=Proc., m=82026.0424.7
Document RAG (Google)Backbone=OpenThinker3-7B, Ret.=Fact., m=82026.0423.1
Document RAG (Google)Backbone=DeepSeek-R1-Distill-Llama-8B, Ret.=Fact., m=82026.0422.8
No RAGBackbone=DeepSeek-R1-Distill-Llama-8B, Ret.=N/A, m=82026.0421.1
Template RAG (ReasonFlux)Backbone=DeepSeek-R1-Distill-Llama-8B, Ret.=Proc., m=82026.0421
Document RAG (CompactDS)Backbone=DeepSeek-R1-Distill-Llama-8B, Ret.=Fact., m=82026.0417.2
Trajectory RAG (Prefix)Backbone=DeepSeek-R1-Distill-Llama-8B, Ret.=Proc., m=82026.0412.8
Trajectory RAG (Summary)Backbone=DeepSeek-R1-Distill-Llama-8B, Ret.=Proc., m=82026.0412.1