Energy Consumption Estimation on OPT-13B
385.31Energy (J)ShiftAddLLM (Lat.)
Evaluation Results
| Method | Links | |
|---|---|---|
| ShiftAddLLM (Lat.)Bits=22024.06 | 385.31 | |
| ShiftAddLLM (Mixed)Bits=2.22024.06 | 391.86 | |
| ShiftAddLLM (Lat.)Bits=32024.06 | 424.58 | |
| LUT-GEMMBits=22024.06 | 542.28 | |
| OPTQBits=22024.06 | 570.06 | |
| LUT-GEMMBits=32024.06 | 592.31 | |
| OPTQBits=32024.06 | 745.37 | |
| FP16Bits=162024.06 | 3,036.99 |