List your company
ResearchFormerly WizWand

Coding Accuracy on LiveCodeBench V1-4

47.1AccuracyReasoning Memory
16.21224.23132.2540.269Apr 1, 2026
Updated 7mo ago

Evaluation results

MethodLinks
Reasoning MemoryBackbone=Qwen3-32B, Ret.=Proc., m=302026.0447.1
Reasoning MemoryBackbone=Qwen3-32B, Ret.=Proc., m=82026.0446.2
Length ScalingBackbone=Qwen3-32B, Ret.=N/A, m=302026.0440.5
Length ScalingBackbone=Qwen3-32B, Ret.=N/A, m=82026.0439.9
No RAGBackbone=Qwen3-32B, Ret.=N/A, m=82026.0438.7
Document RAG (Google)Backbone=Qwen3-32B, Ret.=Fact., m=82026.0438.2
Reasoning MemoryBackbone=OpenThinker3-7B, Ret.=Proc., m=302026.0438.1
Reasoning MemoryBackbone=OpenThinker3-7B, Ret.=Proc., m=82026.0436.2
Length ScalingBackbone=OpenThinker3-7B, Ret.=N/A, m=302026.0434.5
Length ScalingBackbone=OpenThinker3-7B, Ret.=N/A, m=82026.0433.3
No RAGBackbone=OpenThinker3-7B, Ret.=N/A, m=82026.0431.8
Template RAG (Self-Discover)Backbone=Qwen3-32B, Ret.=Proc., m=82026.0431.2
Reasoning MemoryBackbone=DeepSeek-R1-Distill-Llama-8B, Ret.=Proc., m=302026.0431
Template RAG (ReasonFlux)Backbone=Qwen3-32B, Ret.=Proc., m=82026.0430
Document RAG (CompactDS)Backbone=OpenThinker3-7B, Ret.=Fact., m=82026.0429.2
Length ScalingBackbone=DeepSeek-R1-Distill-Llama-8B, Ret.=N/A, m=302026.0428.2
Reasoning MemoryBackbone=DeepSeek-R1-Distill-Llama-8B, Ret.=Proc., m=82026.0427.8
Template RAG (Self-Discover)Backbone=OpenThinker3-7B, Ret.=Proc., m=82026.0427.6
Trajectory RAG (Summary)Backbone=Qwen3-32B, Ret.=Proc., m=82026.0426.7
Document RAG (CompactDS)Backbone=Qwen3-32B, Ret.=Fact., m=82026.0426.7
Template RAG (ReasonFlux)Backbone=OpenThinker3-7B, Ret.=Proc., m=82026.0426.2
Length ScalingBackbone=DeepSeek-R1-Distill-Llama-8B, Ret.=N/A, m=82026.0425.5
Trajectory RAG (Prefix)Backbone=Qwen3-32B, Ret.=Proc., m=82026.0424.9
Document RAG (Google)Backbone=DeepSeek-R1-Distill-Llama-8B, Ret.=Fact., m=82026.0424.6
Trajectory RAG (Prefix)Backbone=OpenThinker3-7B, Ret.=Proc., m=82026.0424.2
Trajectory RAG (Summary)Backbone=OpenThinker3-7B, Ret.=Proc., m=82026.0424.2
Document RAG (Google)Backbone=OpenThinker3-7B, Ret.=Fact., m=82026.0423.5
No RAGBackbone=DeepSeek-R1-Distill-Llama-8B, Ret.=N/A, m=82026.0422
Template RAG (Self-Discover)Backbone=DeepSeek-R1-Distill-Llama-8B, Ret.=Proc., m=82026.0421.3
Document RAG (CompactDS)Backbone=DeepSeek-R1-Distill-Llama-8B, Ret.=Fact., m=82026.0420.8
Trajectory RAG (Prefix)Backbone=DeepSeek-R1-Distill-Llama-8B, Ret.=Proc., m=82026.0419.5
Trajectory RAG (Summary)Backbone=DeepSeek-R1-Distill-Llama-8B, Ret.=Proc., m=82026.0418.4
Template RAG (ReasonFlux)Backbone=DeepSeek-R1-Distill-Llama-8B, Ret.=Proc., m=82026.0417.4