Long-context retrieval on NIAH multivalue
4.1SpeedupFLy
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| FLyModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=12025.11 | 4.1 | 24.09 | |
| FLyModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=02025.11 | 4.07 | 24.15 | |
| SpSModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=02025.11 | 3.72 | 24.13 | |
| FLyModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=12025.11 | 3.64 | 15.83 | |
| FLyModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=02025.11 | 3.57 | 14.85 | |
| FLyModel=Llama-3.3-70B-Instruct, Training=Training-free, Temperature=12025.11 | 3.37 | 13.78 | |
| FLyModel=Llama-3.3-70B-Instruct, Training=Training-free, Temperature=02025.11 | 3.34 | 13.53 | |
| SpSModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=02025.11 | 3.33 | 15.82 | |
| SpSModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=12025.11 | 3.33 | 15.73 | |
| SpSModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=12025.11 | 3.13 | 20.15 | |
| RESTModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=02025.11 | 2.77 | 3.02 | |
| RESTModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=02025.11 | 2.63 | 3.03 | |
| RESTModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=12025.11 | 2.58 | 2.82 | |
| RESTModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=12025.11 | 2.51 | 2.89 | |
| EAGLE-3Model=Llama-3.3-70B-Instruct, Training=Training-based, Temperature=02025.11 | 2.15 | 2.43 | |
| TokenRecyclingModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=12025.11 | 2.02 | 3.15 | |
| TokenRecyclingModel=Llama-3.1-70B-Instruct, Training=Training-free, Temperature=02025.11 | 1.99 | 3.1 | |
| EAGLE-3Model=Llama-3.3-70B-Instruct, Training=Training-based, Temperature=12025.11 | 1.99 | 2.27 | |
| TokenRecyclingModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=02025.11 | 1.6 | 3.12 | |
| TokenRecyclingModel=Llama-3.1-405B-Instruct, Training=Training-free, Temperature=12025.11 | 1.59 | 3.1 |