List your company
ResearchFormerly WizWand

Planning-style reasoning on ACP prog-gen

2.74SpeedupFLy
1.2321.62352.0152.4065Nov 28, 2025
Updated 8mo ago

Evaluation results

MethodLinks
FLyModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=12025.112.7415.44
FLyModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=02025.112.7215.08
SpSModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=02025.112.3214.02
FLyModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=02025.112.0212.3
SpSModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=12025.111.9711.7
RESTModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=02025.111.942.09
FLyModel=Llama-3.3-70B-Instruct, Training=Training-free, Temperature=12025.111.8911.02
FLyModel=Llama-3.3-70B-Instruct, Training=Training-free, Temperature=02025.111.8810.95
TokenRecyclingModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=12025.111.834.38
FLyModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=12025.111.8111.69
RESTModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=12025.111.811.95
TokenRecyclingModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=02025.111.764.22
SpSModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=12025.111.7111.28
SpSModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=02025.111.6910.94
TokenRecyclingModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=02025.111.533.52
TokenRecyclingModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=12025.111.533.54
EAGLE-3Model=Llama-3.3-70B-Instruct, Training=Training-based, Temperature=02025.111.523.92
EAGLE-3Model=Llama-3.3-70B-Instruct, Training=Training-based, Temperature=12025.111.433.6
RESTModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=02025.111.351.57
RESTModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=12025.111.291.5