Auto-formulation on NLP4LP Hard
75.4AccuracyOptiMUS-0.3
Evaluation results
| Method | Links | |
|---|---|---|
| OptiMUS-0.3LLM=o3, Method Category=agentic frameworks2024.07 | 75.4 | |
| ORLMLLM=Deepseek-Math, Method Category=fine-tuning LLMs2024.07 | 72.9 | |
| CoELLM=GPT-4o, Method Category=agentic frameworks2024.07 | 49.2 | |
| StandardLLM=o3, Method Category=direct prompting2024.07 | 42.4 | |
| OptiMUS-0.3LLM=GPT-4o, Method Category=agentic frameworks2024.07 | 38.5 | |
| OptiMUS-0.2LLM=GPT-4o, Method Category=agentic frameworks2024.07 | 26.4 | |
| ReflexionLLM=GPT-4o, Method Category=direct prompting2024.07 | 22 | |
| StandardLLM=GPT-4o, Method Category=direct prompting2024.07 | 20.3 |