Formula Evaluation on Formula
73.5Initial AccuracyMIPRO
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MIPROOptimizer LLM=GPT-5, Target Model=GPT-4.12026.05 | 73.5 | 76.5 | |
| MIPROOptimizer LLM=GPT-5-mini, Target Model=GPT-4.12026.05 | 73.5 | 77.5 | |
| MIPROOptimizer LLM=Gemini-3.1-Pro, Target Model=GPT-4.12026.05 | 73.5 | 75.5 | |
| MIPROOptimizer LLM=Gemini-3.1-Flash-Lite, Target Model=GPT-4.12026.05 | 73.5 | 74 | |
| GEPAOptimizer LLM=GPT-5, Target Model=GPT-4.12026.05 | 72.5 | 74 | |
| GEPAOptimizer LLM=GPT-5-mini, Target Model=GPT-4.12026.05 | 72.5 | 74.5 | |
| GEPAOptimizer LLM=Gemini-3.1-Pro, Target Model=GPT-4.12026.05 | 72.5 | 75.5 | |
| GEPAOptimizer LLM=Gemini-3.1-Flash-Lite, Target Model=GPT-4.12026.05 | 72.5 | 78.5 | |
| RPTOptimizer LLM=GPT-5, Target Model=GPT-4.12026.05 | 72.3 | 84 | |
| RPTOptimizer LLM=GPT-5-mini, Target Model=GPT-4.12026.05 | 72.3 | 74 | |
| RPTOptimizer LLM=Gemini-3.1-Pro, Target Model=GPT-4.12026.05 | 72.3 | 74 | |
| RPTOptimizer LLM=Gemini-3.1-Flash-Lite, Target Model=GPT-4.12026.05 | 72.3 | 73.5 | |
| ACEOptimizer LLM=GPT-5, Target Model=GPT-4.12026.05 | 71.1 | 85.5 | |
| ACEOptimizer LLM=GPT-5-mini, Target Model=GPT-4.12026.05 | 71.1 | 85 | |
| ACEOptimizer LLM=Gemini-3.1-Pro, Target Model=GPT-4.12026.05 | 71.1 | 84.5 | |
| ACEOptimizer LLM=Gemini-3.1-Flash-Lite, Target Model=GPT-4.12026.05 | 71.1 | 83 |