PHYX
Benchmarks
TaskDatasetSOTA resultTrendResults
PhyX
48.6Accuracy
24
PHYX Thermodynamics
20Compile Rate
10
PHYX Electromagnetism
0.667Compile Success Rate
10
PHYX Mechanics
71.4Compile Rate
10
PHYX Modern
71.4Compile Rate
10
PhyX 3k (test)
84.2Exact Match Accuracy
9
PhyX 1k (test)
79.7MCQ Exact Accuracy
9
PhyX openended
72.1Pass@1
7
PhyX mini (test)
2.7Overall Accuracy
7
PhyX mini (test)
46.2Overall Accuracy
7