Bamboogle
Benchmarks
TaskDatasetSOTA resultTrendResults
Bamboogle
60EM
227
Bamboogle
56Exact Match
128
Bamboogle (test)
67.5EM
110
Bamboogle
48EM Accuracy (%)
68
Bamboogle
75.2Accuracy
62
Bamboogle
64.1EM
61
Bamboogle (test)
53.6EM (%)
57
Bamboogle
54.4Exact Match (EM)
55
Bamboogle
78.4EM
51
Bamboogle (test)
74.2Exact Match (EM)
50
Bamboogle
57.8Exact Match (EM)
46
Bamboogle
73Accuracy
46
Bamboogle
47.6Accuracy
44
Bamboogle Full
100Precision
36
Bamboogle
0.94F1 Score
36
Bamboogle
56EM
27
Bamboogle
73.8Exact Match (EM)
25
Bamboogle
74.9Accuracy (%)
25
Bamboogle
61.6F1
25
Bamboogle (test)
70.1Accuracy
24
Bamboogle out-of-domain
71.7F1
24
Bamboogle online Google Search API (test val)
68.7Exact Match
24
Bamboogle offline Wiki-18 (test val)
53.4Exact Match (EM)
24
Bamboogle k=5 OOD (test)
0.065ECE
24
Bamboogle
0.113ECE
24