epbench
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
EpBench 200-Chapters Book (test)
0.009Average Cost ($)
6
Epbench 200-Chapters Book (Overall)
86.5Precision
6
Epbench 6+ Cues 200-Chapters Book
94Precision
6
Epbench 3-5 Cues 200-Chapters Book
87.8Precision
6
Epbench 2 Cues 200-Chapters Book
81.7Precision
6
Epbench Chapters Book 200 (1 Cue)
75.5Precision
6
Epbench 0 Cues 200-Chapters Book
97.8Precision
6
epbench ep_news
51.23F1 Score
6
epbench ep_scifi
52.04F1 Score
6
epbench ep_default
53.25F1 Score
6
Epbench Book 2000-Chapters (Overall)
83Precision
5
Epbench 6+ Cues 2000-Chapters
91.1Precision
5
Epbench 3-5 Cues 2000-Chapters
84.1Precision
5
Epbench 2 Cues 2000-Chapters
84.5Precision
5
Epbench 2000-Chapters Book 1 Cue
76.1Precision
5
Epbench 0 Cues 2000-Chapters Book
94.3Precision
5
Epbench 2000-Chapters Book (test)
83Precision
5