List your company
ResearchFormerly WizWand

Code Generation on ClassEval (Spd, tau)

4.28SpdGOOSE
0.86881.75442.643.5256Apr 2, 2026
Updated 7mo ago

Evaluation results

MethodLinks
GOOSEModel=Qwen2-8B, GPU=NVIDIA A402026.044.285.19
GOOSEModel=Llama-3-8B, GPU=NVIDIA A402026.043.824.89
TRModel=Qwen2-8B, GPU=NVIDIA A402026.043.774.5
GOOSEModel=Vicuna-13B, GPU=NVIDIA A402026.043.684.59
EAGLE-2Model=Vicuna-13B, GPU=NVIDIA A402026.043.626.03
GOOSEModel=Vicuna-7B, GPU=NVIDIA A402026.043.584.64
EAGLE-2Model=Vicuna-7B, GPU=NVIDIA A402026.043.145.5
TRModel=Llama-3-8B, GPU=NVIDIA A402026.042.873.64
GOOSEModel=Vicuna-33B, GPU=NVIDIA A1002026.042.83.69
TRModel=Vicuna-13B, GPU=NVIDIA A402026.042.713.34
TRModel=Vicuna-7B, GPU=NVIDIA A402026.042.583.29
EAGLE-2Model=Llama-3-8B, GPU=NVIDIA A402026.042.585.29
PLDModel=Qwen2-8B, GPU=NVIDIA A402026.042.52.61
LookaheadModel=Qwen2-8B, GPU=NVIDIA A402026.042.422.42
LookaheadModel=Llama-3-8B, GPU=NVIDIA A402026.042.352.57
PLDModel=Vicuna-7B, GPU=NVIDIA A402026.042.342.5
PLDModel=Vicuna-13B, GPU=NVIDIA A402026.042.342.47
PLDModel=Llama-3-8B, GPU=NVIDIA A402026.042.32.49
LookaheadModel=Vicuna-7B, GPU=NVIDIA A402026.042.272.41
LookaheadModel=Vicuna-13B, GPU=NVIDIA A402026.042.142.26
TRModel=Vicuna-33B, GPU=NVIDIA A1002026.041.972.62
LookaheadModel=Vicuna-33B, GPU=NVIDIA A1002026.041.862.02
PLDModel=Vicuna-33B, GPU=NVIDIA A1002026.041.851.99
RESTModel=Vicuna-7B, GPU=NVIDIA A402026.041.681.73
RESTModel=Vicuna-13B, GPU=NVIDIA A402026.041.611.66
RESTModel=Vicuna-33B, GPU=NVIDIA A1002026.041.481.54
RESTModel=Llama-3-8B, GPU=NVIDIA A402026.041.331.35
RESTModel=Qwen2-8B, GPU=NVIDIA A402026.041.221.14
ARModel=Vicuna-7B, GPU=NVIDIA A402026.0411
ARModel=Llama-3-8B, GPU=NVIDIA A402026.0411
ARModel=Qwen2-8B, GPU=NVIDIA A402026.0411
ARModel=Vicuna-13B, GPU=NVIDIA A402026.0411
ARModel=Vicuna-33B, GPU=NVIDIA A1002026.0411