List your company
ResearchFormerly WizWand

Code Generation on LiveCodeBench (Accuracy)

73.2AccuracyTRICE-30B
-2.92816.83636.656.364Jun 4, 2025Jul 30, 2025Sep 24, 2025Nov 19, 2025Jan 14, 2026Mar 11, 2026May 7, 2026
Updated 5mo ago

Evaluation results

MethodLinks
TRICE-30BUse Tool=true2026.0573.2
CyclicReflexBackbone=Qwen3-14B, Decoding Strategy=CyclicReflex2025.0667
CyclicReflexBackbone=Qwen3-8B, Decoding Strategy=CyclicReflex2025.0663
OriginalBackbone=Qwen3-14B, Decoding Strategy=Original2025.0663
TIPBackbone=Qwen3-14B, Decoding Strategy=TIP2025.0663
Qwen3-30B-A3B-Thinking-2507Use Tool=false2026.0561.5
CyclicReflexBackbone=Qwen3-4B, Decoding Strategy=CyclicReflex2025.0661
TIPBackbone=Qwen3-8B, Decoding Strategy=TIP2025.0660
TIPBackbone=Qwen3-4B, Decoding Strategy=TIP2025.0659
OriginalBackbone=Qwen3-8B, Decoding Strategy=Original2025.0659
OriginalBackbone=Qwen3-4B, Decoding Strategy=Original2025.0658
qwen3-8B2026.0157.29
PASC-GRPObase_model=qwen3-8B-Base2026.0156.12
TRICE-4BUse Tool=true2026.0555.6
BLASSTBackbone=Qwen3-8B, Attention Method=BLASST, Sparsity=~50%, Phase=Decode2025.1254.15
GRP-SFTbase_model=qwen3-8B-Base2026.0153.93
Dense AttentionBackbone=Qwen3-8B, Attention Method=Dense, Phase=Decode2025.1253.83
RocketKVBackbone=Qwen3-8B, Attention Method=RocketKV, Phase=Decode2025.1253.1
QuestBackbone=Qwen3-8B, Attention Method=Quest, Phase=Decode2025.1252.17
Qwen3-4B-Thinking-2507Use Tool=false2026.0551.4
BF16Model=Qwen3-4B, W-Bits=BF162026.0148.38
Reasoning-QATModel=Qwen3-4B, W-Bits=W3G1282026.0138.06
qwen3-8B-Base2026.0129.76
GPTQModel=Qwen3-4B, W-Bits=W3G1282026.0120.77
SKPO (Ours)Base Model=Qwen2.5-Math-7B2026.0419.6
AWQModel=Qwen3-4B, W-Bits=W3G1282026.0119.03
PRIMEBase Model=Qwen2.5-Math-7B2026.0418.9
CISPOBase Model=Qwen2.5-Math-7B2026.0417.4
DAPOBase Model=Qwen2.5-Math-7B2026.0417
SAPOBase Model=Qwen2.5-Math-7B2026.0416.5
GSPOBase Model=Qwen2.5-Math-7B2026.0416.2
BF16Model=R1-Qwen-1.5B, W-Bits=BF162026.0116.04
SPOBase Model=Qwen2.5-Math-7B2026.0415.7
Critique†Base Model=Qwen2.5-Math-7B2026.0415.2
GRPOBase Model=Qwen2.5-Math-7B2026.0414.6
SKPO (Ours)Base Model=Llama-3.2-3B-Instruct2026.0414.1
BaseBase Model=Qwen2.5-Math-7B2026.0413.8
GSPOBase Model=Llama-3.2-3B-Instruct2026.0413.8
PRIMEBase Model=Llama-3.2-3B-Instruct2026.0413.2
GRPOBase Model=Llama-3.2-3B-Instruct2026.0413.1
BF16Model=Qwen3-0.6B, W-Bits=BF162026.0112.94
SPOBase Model=Llama-3.2-3B-Instruct2026.0412.9
DAPOBase Model=Llama-3.2-3B-Instruct2026.0412.7
SAPOBase Model=Llama-3.2-3B-Instruct2026.0412.6
BaseBase Model=Llama-3.2-3B-Instruct2026.0412.4
CISPOBase Model=Llama-3.2-3B-Instruct2026.0412.1
Reasoning-QATModel=R1-Qwen-1.5B, W-Bits=W3G1282026.0110.45
GPTQModel=R1-Qwen-1.5B, W-Bits=W3G1282026.019.33
AWQModel=R1-Qwen-1.5B, W-Bits=W3G1282026.014.85
Reasoning-QATModel=Qwen3-0.6B, W-Bits=W3G1282026.011.87
RTNModel=Qwen3-0.6B, W-Bits=W3G1282026.010
GPTQModel=Qwen3-0.6B, W-Bits=W3G1282026.010
AWQModel=Qwen3-0.6B, W-Bits=W3G1282026.010
GPTQModel=Qwen3-0.6B, W-Bits=W2G1282026.010
AWQModel=Qwen3-0.6B, W-Bits=W2G1282026.010
Reasoning-QATModel=Qwen3-0.6B, W-Bits=W2G1282026.010
RTNModel=R1-Qwen-1.5B, W-Bits=W3G1282026.010
GPTQModel=R1-Qwen-1.5B, W-Bits=W2G1282026.010
AWQModel=R1-Qwen-1.5B, W-Bits=W2G1282026.010
Reasoning-QATModel=R1-Qwen-1.5B, W-Bits=W2G1282026.010
RTNModel=Qwen3-4B, W-Bits=W3G1282026.010
GPTQModel=Qwen3-4B, W-Bits=W2G1282026.010
AWQModel=Qwen3-4B, W-Bits=W2G1282026.010
Reasoning-QATModel=Qwen3-4B, W-Bits=W2G1282026.010