Question Answering on HotPotQA (Initial/Final Accuracy)
55.5Initial AccuracyRPT
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| RPTOptimizer LLM=GPT-5, Target Model=GPT-4.12026.05 | 55.5 | 68.4 | |
| RPTOptimizer LLM=GPT-5-mini, Target Model=GPT-4.12026.05 | 55.5 | 65.2 | |
| RPTOptimizer LLM=Gemini-3.1-Pro, Target Model=GPT-4.12026.05 | 55.5 | 65.8 | |
| RPTOptimizer LLM=Gemini-3.1-Flash-Lite, Target Model=GPT-4.12026.05 | 55.5 | 64.6 | |
| ACEOptimizer LLM=GPT-5, Target Model=GPT-4.12026.05 | 55.4 | 66.6 | |
| ACEOptimizer LLM=GPT-5-mini, Target Model=GPT-4.12026.05 | 55.4 | 65 | |
| ACEOptimizer LLM=Gemini-3.1-Pro, Target Model=GPT-4.12026.05 | 55.4 | 65.8 | |
| ACEOptimizer LLM=Gemini-3.1-Flash-Lite, Target Model=GPT-4.12026.05 | 55.4 | 66.6 | |
| MIPROOptimizer LLM=GPT-5, Target Model=GPT-4.12026.05 | 48.8 | 66.8 | |
| MIPROOptimizer LLM=GPT-5-mini, Target Model=GPT-4.12026.05 | 48.8 | 65.6 | |
| MIPROOptimizer LLM=Gemini-3.1-Pro, Target Model=GPT-4.12026.05 | 48.8 | 65.2 | |
| MIPROOptimizer LLM=Gemini-3.1-Flash-Lite, Target Model=GPT-4.12026.05 | 48.8 | 63.6 | |
| GEPAOptimizer LLM=GPT-5, Target Model=GPT-4.12026.05 | 46.6 | 64.4 | |
| GEPAOptimizer LLM=GPT-5-mini, Target Model=GPT-4.12026.05 | 46.6 | 62.4 | |
| GEPAOptimizer LLM=Gemini-3.1-Pro, Target Model=GPT-4.12026.05 | 46.6 | 66.4 | |
| GEPAOptimizer LLM=Gemini-3.1-Flash-Lite, Target Model=GPT-4.12026.05 | 46.6 | 64.6 |