Energy Consumption Estimation on OPT-30B
846.54Energy (J)ShiftAddLLM (Lat.)
Evaluation Results
| Method | Links | |
|---|---|---|
| ShiftAddLLM (Lat.)Bits=22024.06 | 846.54 | |
| ShiftAddLLM (Mixed)Bits=2.22024.06 | 861.95 | |
| ShiftAddLLM (Lat.)Bits=32024.06 | 938.98 | |
| LUT-GEMMBits=22024.06 | 1,215.36 | |
| OPTQBits=22024.06 | 1,283.04 | |
| LUT-GEMMBits=32024.06 | 1,332.95 | |
| OPTQBits=32024.06 | 1,695.45 | |
| FP16Bits=162024.06 | 7,088.39 |