Energy consumption estimation on LLM Energy Consumption (test)
0.91MAPEMemory and FLOPs based
Evaluation Results
| Method | Links | |
|---|---|---|
| Memory and FLOPs basedTarget LLM=OPT (2.7B), Size Family=S2026.02 | 0.91 | |
| Memory and FLOPs basedTarget LLM=OPT (1.3B), Size Family=XS2026.02 | 0.97 | |
| Memory and FLOPs basedTarget LLM=Granite (3B), Size Family=S2026.02 | 1.08 | |
| FLOPs basedTarget LLM=OPT (1.3B), Size Family=XS2026.02 | 1.29 | |
| Memory and FLOPs basedTarget LLM=Falcon-RW (7.5B), Size Family=M2026.02 | 1.35 | |
| FLOPs basedTarget LLM=OPT (2.7B), Size Family=S2026.02 | 1.47 | |
| FLOPs basedTarget LLM=Falcon-RW (7.5B), Size Family=M2026.02 | 1.48 | |
| Memory and FLOPs basedTarget LLM=Llama 3.2 (1B), Size Family=XS2026.02 | 1.56 | |
| Memory and FLOPs basedTarget LLM=Gemma 2 (2B), Size Family=S2026.02 | 1.66 | |
| Memory and FLOPs basedTarget LLM=Average, Size Family=Aggregate2026.02 | 1.79 | |
| Memory and FLOPs basedTarget LLM=Gemma 2 (9B), Size Family=M2026.02 | 1.81 | |
| FLOPs basedTarget LLM=OPT (6.7B), Size Family=M2026.02 | 1.82 | |
| FLOPs basedTarget LLM=Granite (3B), Size Family=S2026.02 | 1.85 | |
| Memory and FLOPs basedTarget LLM=OPT (6.7B), Size Family=M2026.02 | 1.93 | |
| Memory and FLOPs basedTarget LLM=Qwen 2 (1.5B), Size Family=XS2026.02 | 1.94 | |
| Memory and FLOPs basedTarget LLM=Llama 3.2 (3B), Size Family=S2026.02 | 2.12 | |
| FLOPs basedTarget LLM=Gemma 2 (2B), Size Family=S2026.02 | 2.17 | |
| Memory and FLOPs basedTarget LLM=Granite (8B), Size Family=M2026.02 | 2.24 | |
| FLOPs basedTarget LLM=Average, Size Family=Aggregate2026.02 | 2.27 | |
| FLOPs basedTarget LLM=Llama 3.2 (3B), Size Family=S2026.02 | 2.46 | |
| FLOPs basedTarget LLM=Gemma 2 (9B), Size Family=M2026.02 | 2.49 | |
| FLOPs basedTarget LLM=Qwen 2 (1.5B), Size Family=XS2026.02 | 2.62 | |
| FLOPs basedTarget LLM=Granite (8B), Size Family=M2026.02 | 2.62 | |
| Memory and FLOPs basedTarget LLM=Llama 3.1 (8B), Size Family=M2026.02 | 2.84 | |
| Memory and FLOPs basedTarget LLM=Qwen 2 (7B), Size Family=M2026.02 | 2.88 | |
| FLOPs basedTarget LLM=Llama 3.2 (1B), Size Family=XS2026.02 | 2.95 | |
| FLOPs basedTarget LLM=Llama 3.1 (8B), Size Family=M2026.02 | 3.01 | |
| FLOPs basedTarget LLM=Qwen 2 (7B), Size Family=M2026.02 | 3.24 | |
| Baseline 4Target LLM=Llama 3.2 (1B), Size Family=XS2026.02 | 17.84 | |
| Baseline 3Target LLM=Llama 3.2 (1B), Size Family=XS2026.02 | 93.58 | |
| Baseline 2Target LLM=Llama 3.2 (1B), Size Family=XS2026.02 | 99.45 | |
| Baseline 1Target LLM=Llama 3.2 (1B), Size Family=XS2026.02 | 102.33 | |
| Baseline 1Target LLM=Qwen 2 (1.5B), Size Family=XS2026.02 | 110.71 | |
| Baseline 1Target LLM=Gemma 2 (2B), Size Family=S2026.02 | 111.33 | |
| Baseline 1Target LLM=Llama 3.2 (3B), Size Family=S2026.02 | 117.54 | |
| Baseline 1Target LLM=Llama 3.1 (8B), Size Family=M2026.02 | 123 | |
| Baseline 1Target LLM=Granite (8B), Size Family=M2026.02 | 127.92 | |
| Baseline 1Target LLM=Average, Size Family=Aggregate2026.02 | 130.45 | |
| Baseline 1Target LLM=Gemma 2 (9B), Size Family=M2026.02 | 131.38 | |
| Baseline 1Target LLM=Qwen 2 (7B), Size Family=M2026.02 | 132.26 | |
| Baseline 1Target LLM=OPT (1.3B), Size Family=XS2026.02 | 139.77 | |
| Baseline 1Target LLM=Granite (3B), Size Family=S2026.02 | 144.28 | |
| Baseline 1Target LLM=Falcon-RW (7.5B), Size Family=M2026.02 | 150.8 | |
| Baseline 1Target LLM=OPT (6.7B), Size Family=M2026.02 | 151.27 | |
| Baseline 2Target LLM=OPT (2.7B), Size Family=S2026.02 | 153.59 | |
| Baseline 1Target LLM=OPT (2.7B), Size Family=S2026.02 | 15,329 |