List your company
ResearchFormerly WizWand

Code Generation on LiveCodeBench v5 (Pass@1)

61.5Pass@1ESamp
7.9421.84535.7549.655Apr 27, 2026May 4, 2026May 11, 2026May 18, 2026May 25, 2026Jun 1, 2026Jun 8, 2026
Updated 4mo ago

Evaluation results

MethodLinks
ESampModel=GPT-OSS-20B, Context Length=163842026.0461.5
OverRIDEModel=GPT-OSS-20B, Context Length=163842026.0457.6
Min-pModel=GPT-OSS-20B, Context Length=163842026.0452.5
VanillaModel=GPT-OSS-20B, Context Length=163842026.0452.2
ESampModel=GPT-OSS-20B, Context Length=40962026.0451.8
FIREModel=GPT-OSS-20B, Context Length=163842026.0451.2
Min-pModel=GPT-OSS-20B, Context Length=40962026.0445.4
FIREModel=GPT-OSS-20B, Context Length=40962026.0445.2
OverRIDEModel=GPT-OSS-20B, Context Length=40962026.0444.6
VanillaModel=GPT-OSS-20B, Context Length=40962026.0443.4
PriFT-massBackbone=Qwen3-4B-Instruct2026.0639.89
PriFT-probBackbone=Qwen3-4B-Instruct2026.0639.32
OriginalBackbone=Qwen3-4B-Instruct2026.0630.45
ASFTBackbone=Qwen3-4B-Instruct2026.0628.64
IDFTBackbone=Qwen3-4B-Instruct2026.0626.14
TALRBackbone=Qwen3-4B-Instruct2026.0625
DFTBackbone=Qwen3-4B-Instruct2026.0624.32
EAFTBackbone=Qwen3-4B-Instruct2026.0623.86
ESampModel=Qwen3-8B, Context Length=163842026.0422.6
SFTBackbone=Qwen3-4B-Instruct2026.0622.39
OverRIDEModel=Qwen3-8B, Context Length=163842026.0420.7
Min-pModel=Qwen3-8B, Context Length=163842026.0419.3
VanillaModel=Qwen3-8B, Context Length=163842026.0419.2
FIREModel=Qwen3-8B, Context Length=163842026.0418.3
OverRIDEModel=Qwen2.5-7B, Context Length=163842026.0413.6
OverRIDEModel=Qwen2.5-7B, Context Length=40962026.0413.6
Min-pModel=Qwen2.5-7B, Context Length=163842026.0413.5
Min-pModel=Qwen2.5-7B, Context Length=40962026.0413.5
ESampModel=Qwen2.5-7B, Context Length=163842026.0413.1
ESampModel=Qwen2.5-7B, Context Length=40962026.0413.1
VanillaModel=Qwen2.5-7B, Context Length=163842026.0413
VanillaModel=Qwen2.5-7B, Context Length=40962026.0413
FIREModel=Qwen2.5-7B, Context Length=163842026.0412.9
FIREModel=Qwen2.5-7B, Context Length=40962026.0412.9
ESampModel=Qwen3-8B, Context Length=40962026.0412
FIREModel=Qwen3-8B, Context Length=40962026.0411
OverRIDEModel=Qwen3-8B, Context Length=40962026.0410.3
VanillaModel=Qwen3-8B, Context Length=40962026.0410
Min-pModel=Qwen3-8B, Context Length=40962026.0410