Energy Consumption Estimation on OPT-66B
1,786.62Energy (J)ShiftAddLLM (Lat.)
Evaluation Results
| Method | Links | |
|---|---|---|
| ShiftAddLLM (Lat.)Bits=22024.06 | 1,786.62 | |
| ShiftAddLLM (Mixed)Bits=2.22024.06 | 1,820.55 | |
| ShiftAddLLM (Lat.)Bits=32024.06 | 1,990.17 | |
| LUT-GEMMBits=22024.06 | 2,599.77 | |
| OPTQBits=22024.06 | 2,749.32 | |
| LUT-GEMMBits=32024.06 | 2,858.87 | |
| OPTQBits=32024.06 | 3,658.17 | |
| FP16Bits=162024.06 | 15,539.87 |