Feynman
Benchmarks
TaskDatasetSOTA resultTrendResults
Feynman benchmark
1Median Final Training Loss
60
Feynman
1Loss
60
Feynman Dataset epsilon=0.1 (test)
0.996R2 Score
20
Feynman Dataset epsilon=0.001 (test)
99.62R2
20
Feynman Problem III.17.37
1Mean R2
15
Feynman Problem III.15.14
1Mean R2
15
Feynman Problem III.10.19
1R2 (mean)
15
Feynman Problem III.4.33
1Mean R2
15
Feynman Problem II.38.14
1Mean R2 Score
15
Feynman Problem II.34.29a
100Mean R2
15
Feynman II 4 23
76Median Program Size
6
Feynman
0.995R2 Score
5
Feynman Test 4 (test)
0.221Median RMSE
5
Feynman 3 (test)
0.178Median RMSE
5
Feynman III 14 14 (test)
0.438Median RMSE
5
Feynman II 4 23 (test)
0.284Median RMSE
5
Feynman II 38 3 (test)
0.314Median RMSE
5
Feynman II 34 2 (test)
0.088Median RMSE
5
Feynman I 43 43 (test)
0.37Median RMSE
5
Feynman I 29 4 (test)
0.284Median RMSE
5
Feynman I 25 13 (test)
0.189Median RMSE
5
Feynman I 24 6 (test)
0.162Median RMSE
5
Feynman I 18 4 (test)
0.168Median RMSE
5
Feynman–synthetic Hard tier (test)
2.378R^2
5
Feynman real-world (Hard)
3.69R^2
5