KILT
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
KILT (test)
21.6WoW F1 Score
29
KILT (test)
62.9WoW Score
28
KILT Benchmark Natural Questions, TriviaQA, HotpotQA (test)
85.6EM Score (TriviaQA)
10
KILT (dev)
67.8FEV Score
8
KILT TriviaQA
91.9Match Score
5
KILT HotpotQA
51.9Match
5
KILT T-REX (test)
75.5Retrieval Score
4
KILT ZSRE (test)
80.5Retrieval
4
KILT ELI5 (test)
36.3Retrieval Score
4
KILT WoW (test)
49.8Retrieval
4
KILT NQ* (test)
65.1Retrieval Rate
4
KILT benchmark
62.8FEVER Score
4
KILT Average
71.7Average Judge Score
3
KILT ELI5 (dev test)
26.3RL Score
3