Energy Consumption Estimation on OPT-125M
11.41Energy Consumption (J)ShiftAddLLM (Lat.)
Evaluation Results
| Method | Links | |
|---|---|---|
| ShiftAddLLM (Lat.)Bits=22024.06 | 11.41 | |
| ShiftAddLLM (Mixed)Bits=2.22024.06 | 11.45 | |
| ShiftAddLLM (Lat.)Bits=32024.06 | 11.68 | |
| LUT-GEMMBits=22024.06 | 12.48 | |
| OPTQBits=22024.06 | 12.58 | |
| LUT-GEMMBits=32024.06 | 12.83 | |
| OPTQBits=32024.06 | 13.77 | |
| FP16Bits=162024.06 | 29.26 |