LAMBADA
Benchmarks
TaskDatasetSOTA resultTrendResults
LAMBADA
86.9Accuracy
412
LAMBADA
3.1Perplexity
254
LAMBADA
86.9Accuracy
222
Lambada OpenAI
78.4Accuracy
134
LAMBADA
79.4Accuracy
114
LAMBADA (test)
4Perplexity
109
Lambada
14.36Perplexity (Lambada)
78
LAMBADA (test)
87.15Accuracy
53
LAMBADA
56.2Accuracy
50
LAMBADA zero-shot (test)
69.12Accuracy (zero-shot)
44
LAMBADA
0.2PPL Change (%)
41
Lambada (val)
10.14Perplexity
39
LAMBADA standard (LS)
73.67Accuracy (LAMBADA)
37
Lambada Standard
60.8Accuracy
36
LAMBADA OpenAI
71.4Accuracy
29
LAMBADA
4.11Perplexity (PPL)
27
LAMBADA
43.3Delta (%)
25
Lambada
80.5Accuracy
24
Lambada (OpenAI split)
3.11PPL
22
LAMBADA multilingual (test)
140.97LAMBADA Score (DE)
20
LAMBADA standard
65.57Accuracy
20
Lambada OpenAI
75.65Accuracy
20
LAMBADA CONTROL (all)
36Accuracy
20
LAMBADA (dev)
12.34Perplexity
20
Lambada
66.8Accuracy
18