LLM Inference Efficiency on Edge Device
43.36Latency (s)RAP
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| RAP2025.05 | 43.36 | 47.23 | |
| DENSE2025.05 | 52.4 | 39.08 | |
| SLICEGPT2025.05 | 64.64 | 31.68 | |
| LLM-PRUNER2025.05 | 83.47 | 24.53 |
Loading the SOTA2 catalog…
| Method | Links | ||
|---|---|---|---|
| RAP2025.05 | 43.36 | 47.23 | |
| DENSE2025.05 | 52.4 | 39.08 | |
| SLICEGPT2025.05 | 64.64 | 31.68 | |
| LLM-PRUNER2025.05 | 83.47 | 24.53 |