Planning-style reasoning on ACP prog-gen
2.74SpeedupFLy
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| FLyModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=12025.11 | 2.74 | 15.44 | |
| FLyModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=02025.11 | 2.72 | 15.08 | |
| SpSModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=02025.11 | 2.32 | 14.02 | |
| FLyModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=02025.11 | 2.02 | 12.3 | |
| SpSModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=12025.11 | 1.97 | 11.7 | |
| RESTModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=02025.11 | 1.94 | 2.09 | |
| FLyModel=Llama-3.3-70B-Instruct, Training=Training-free, Temperature=12025.11 | 1.89 | 11.02 | |
| FLyModel=Llama-3.3-70B-Instruct, Training=Training-free, Temperature=02025.11 | 1.88 | 10.95 | |
| TokenRecyclingModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=12025.11 | 1.83 | 4.38 | |
| FLyModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=12025.11 | 1.81 | 11.69 | |
| RESTModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=12025.11 | 1.81 | 1.95 | |
| TokenRecyclingModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=02025.11 | 1.76 | 4.22 | |
| SpSModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=12025.11 | 1.71 | 11.28 | |
| SpSModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=02025.11 | 1.69 | 10.94 | |
| TokenRecyclingModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=02025.11 | 1.53 | 3.52 | |
| TokenRecyclingModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=12025.11 | 1.53 | 3.54 | |
| EAGLE-3Model=Llama-3.3-70B-Instruct, Training=Training-based, Temperature=02025.11 | 1.52 | 3.92 | |
| EAGLE-3Model=Llama-3.3-70B-Instruct, Training=Training-based, Temperature=12025.11 | 1.43 | 3.6 | |
| RESTModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=02025.11 | 1.35 | 1.57 | |
| RESTModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=12025.11 | 1.29 | 1.5 |