RealworldQA
Benchmarks
TaskDatasetSOTA resultTrendResults
RealworldQA
80.2Accuracy
327
RealWorldQA
79.35Accuracy
183
RealWorldQA
81.4Accuracy
110
RealworldQA
81.8Accuracy
75
RealWorldQA
75.4Accuracy
68
RealWorldQA
71.3Accuracy
64
RealWorldQA
75.4Accuracy
62
RealWorldQA
78.7Overall Score
58
RealWorldQA
69.67Accuracy
52
RealWorldQA (test)
79Accuracy
47
RealWorldQA
81.39Accuracy
40
RealWorldQA
70.46Mean@8 Accuracy
40
RealWorldQA
72.29Score
39
RealWorldQA
74.2Score
37
RealWorldQA
78RWQA Score
33
RealWorldQA xAI 2024 (test)
72.81Accuracy
32
RealWorldQA
73.1Score
32
RealWorldQA (test)
77.1Final Performance
30
RealWorldQA
66.01RWQA Score
30
RealWorldQA (RWQA)
68.5Score
26
RealWorldQA
71.9Accuracy
25
RealWorldQA
72.2RealWorldQA Score
21
RealWorldQA
73.99Accuracy
21
RealWorldQA
72.6Accuracy (RealWorldQA)
21
RealWorldQA (test)
77.8Accuracy
18