Last Letter Concatenation
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Last Letter Concatenation
90.4Accuracy
68
Last-letter-concatenation 12 words (out-of-distribution)
100Accuracy
15
Last-letter-concatenation 10 words (out-of-distribution)
100Accuracy
15
Last-letter-concatenation 8 words (out-of-distribution)
100Accuracy
15
Last-letter-concatenation 6 words (out-of-distribution)
100Accuracy
15
Last-letter-concatenation 4 words (out-of-distribution)
100Accuracy
15
Last-letter-concatenation 2 words (in-distribution)
100Accuracy
15
Last-letter-concatenation 1 word (in-distribution)
100Accuracy
15
Last Letter Concatenation (test)
81.9Accuracy
8
Last Letter Concatenation (LLC) out-of-distribution (test)
98LLC-4 Accuracy
7
Last-letter-concatenation 100 words (out-of-distribution)
100Accuracy
5
Last-letter-concatenation 50 words (out-of-distribution)
100Accuracy
5
Last Letter Concatenation zero-shot
70.1Accuracy (Zero-shot)
4
Last Letter Concatenation OOD: 4 (test)
63Accuracy
3
Last Letter Concatenation OOD: 3 (test)
94.8Accuracy
3
Last-letter-concatenation 100 words
—Accuracy
0
Last-letter-concatenation 50 words
—Accuracy
0
Last-letter-concatenation 12 words
—Accuracy
0
Last-letter-concatenation 10 words
—Accuracy
0
Last-letter-concatenation 8 words
—Accuracy
0
Last-letter-concatenation 6 words
—Accuracy
0
Last-letter-concatenation 4 words
—Accuracy
0
Last-letter-concatenation 2 words
—Accuracy
0
Last-letter-concatenation 1 word
—Accuracy
0