OPT
Benchmarks
TaskDatasetSOTA resultTrendResults
OPT model family
6.2Latency (ms)
79
OPT
4.8Processing Time (s)
46
OPT v1 (train)
0.08Processing Time (min)
23
OPT
92.62Accuracy
22
OPT unseen category
89.1Accuracy
18
OPT-6.7B
12.8TPR @ 1% FPR
16
opt
-0.052Bias
15
OPT 10-shot
92.62Accuracy
13
OPT OpenML-CC18 (test)
78.94Accuracy
13
OPT-1.3B
4.49Memory Footprint (GB)
12
OPT-125M
1.39Memory Cost (GB)
12
OPT Models
0.24GFLOPS
12
OPT-1.3b
0Average KLD
10
OPT-6.7B
11.68Memory Footprint (GB)
10
OPT-66B ZS
74.7RSR
9
OPT-66B
1,786.62Energy (J)
8
OPT-30B
846.54Energy (J)
8
OPT-13B
385.31Energy (J)
8
OPT 6.7B
215.27Energy (J)
8
OPT-2.7B
95.67Energy (J)
8
OPT 1.3B
55.8Energy (J)
8
OPT-350M
20.17Energy (J)
8
OPT-125M
11.41Energy Consumption (J)
8
OPT 1.3B Generation
80.4SQuAD Score
6
OPT-66B ZS user input pool v1.4 (test)
71.34RSR
5