RealworldQA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
RealworldQA
75.4Overall Score
17
RealWorldQA (test)
56.08Accuracy
16
RealWorldQA
69.3Accuracy
16
RealWorldQA
65.1Accuracy
16
RealWorldQA
76.5RealWorldQA Score
15
RealWorldQA 1.0 (test)
0.635Accuracy
15
RealworldQA
75.4Accuracy
10
RealWorldQA
65.1Accuracy
9
RealWorldQA
70.07Score
9
RealWorldQA
86.93Pass@5
8
RealWorldQA
68.9Exact Match
8
RealWorldQA 2024 (test)
66.54Score
8
RealWorldQA (test)
77.04Accuracy
8
RealWorldQA
86Pass@1
7
RealworldQA
60.52Score
7
RealworldQA v1.0 (test)
75.5Score
7
RealWorldQA
68.23Accuracy (Clean)
7
RealWorldQA 2024
64.8Score
7
RealWorldQA
78.4Pass@1
7
RealWorldQA (avg)
0.787Score
7
RealWorldQA
73.7Score
6
RealWorldQA
79.61Accuracy
6
RealWorldQA 2024
71.9Accuracy
6
RealWorldQA
69.28Score
5
RealWorldQA
71.63Mean@8 Accuracy
5