Energy Consumption Estimation on OPT-2.7B
95.67Energy (J)ShiftAddLLM (Lat.)
Evaluation Results
| Method | Links | |
|---|---|---|
| ShiftAddLLM (Lat.)Bits=22024.06 | 95.67 | |
| ShiftAddLLM (Mixed)Bits=2.22024.06 | 96.98 | |
| ShiftAddLLM (Lat.)Bits=32024.06 | 103.53 | |
| LUT-GEMMBits=22024.06 | 127.07 | |
| OPTQBits=22024.06 | 132.3 | |
| LUT-GEMMBits=32024.06 | 137.08 | |
| OPTQBits=32024.06 | 167.37 | |
| FP16Bits=162024.06 | 625.8 |