Energy Consumption Estimation on OPT 1.3B
55.8Energy (J)ShiftAddLLM (Lat.)
Evaluation results
| Method | Links | |
|---|---|---|
| ShiftAddLLM (Lat.)Bits=22024.06 | 55.8 | |
| ShiftAddLLM (Mixed)Bits=2.22024.06 | 56.43 | |
| ShiftAddLLM (Lat.)Bits=32024.06 | 59.59 | |
| LUT-GEMMBits=22024.06 | 70.9 | |
| OPTQBits=22024.06 | 73.27 | |
| LUT-GEMMBits=32024.06 | 75.73 | |
| OPTQBits=32024.06 | 90.12 | |
| FP16Bits=162024.06 | 310.33 |