Energy Consumption Estimation on OPT-350M
20.17Energy (J)ShiftAddLLM (Lat.)
Evaluation results
| Method | Links | |
|---|---|---|
| ShiftAddLLM (Lat.)Bits=22024.06 | 20.17 | |
| ShiftAddLLM (Mixed)Bits=2.22024.06 | 20.33 | |
| ShiftAddLLM (Lat.)Bits=32024.06 | 21.13 | |
| LUT-GEMMBits=22024.06 | 23.96 | |
| OPTQBits=22024.06 | 24.42 | |
| LUT-GEMMBits=32024.06 | 25.19 | |
| OPTQBits=32024.06 | 28.63 | |
| FP16Bits=162024.06 | 83.72 |