UltraDomain
Benchmarks
TaskDatasetSOTA resultTrendResults
UltraDomain mix
76.2Win Rate
18
UltraDomain agriculture
95Win Rate
18
UltraDomain Mix 1.0 (512 question-answer pairs)
54.49Exact Match (EM)
10
UltraDomain Legal 1.0
35.16EM
10
UltraDomain Computer Science 1.0
41.02EM
10
UltraDomain Agriculture 1.0
34.96Exact Match (EM)
10
UltraDomain
36.19F1 (bio)
10
UltraDomain
100Bio Score
9
UltraDomain
100Bio Score
9
UltraDomain Pathology (test)
92.35Comprehension
9
UltraDomain Mix (test)
91.24Comprehensiveness
9
UltraDomain Mix
76.8Comprehensiveness
6
UltraDomain Legal
60.8Comprehensiveness
6
UltraDomain Computer Science
68.8Comprehensiveness
6
UltraDomain Agriculture
65.6Comprehensiveness
6
UltraDomain Legal
86.19Comprehensive Score
5
UltraDomain History
87.75Comprehensive
5
UltraDomain Cooking
89.25Comprehensive Score
5
UltraDomain Biology
89.44Comprehensive
5
UltraDomain Agriculture
89.93Comprehensive Score
5
UltraDomain Physics (test)
89.51Comprehensiveness
5
UltraDomain Philosophy (test)
86.78Comprehensive
5
UltraDomain Music (test)
87.95Comprehensiveness
5
UltraDomain Mix (test)
87.15Comprehensive Score
5
UltraDomain Mathematics (test)
87.3Comprehensiveness
5