KILT
Benchmarks
TaskDatasetSOTA resultTrendResults
KILT (test)
21.6WoW F1 Score
29
KILT (test)
62.9WoW Score
28
KILT Benchmark Natural Questions, TriviaQA, HotpotQA (test)
85.6EM Score (TriviaQA)
10
KILT (dev)
67.8FEV Score
8
KILT TriviaQA
91.9Match Score
5
KILT HotpotQA
51.9Match
5
KILT T-REX (test)
75.5Retrieval Score
4
KILT ZSRE (test)
80.5Retrieval
4
KILT ELI5 (test)
36.3Retrieval Score
4
KILT WoW (test)
49.8Retrieval
4
KILT NQ* (test)
65.1Retrieval Rate
4
KILT benchmark
62.8FEVER Score
4
KILT Average
71.7Average Judge Score
3
KILT ELI5 (dev test)
26.3RL Score
3