Scientific Question Answering on GPQA (average inference time (seconds))
1.58Average Inference Time (s)CoT
Evaluation Results
| Method | Links | |
|---|---|---|
| CoTModel=GPT-3.52025.09 | 1.58 | |
| Self-reflectionModel=GPT-3.52025.09 | 2.44 | |
| CoTModel=Mixtral 8x22b2025.09 | 3.92 | |
| Self-reflectionModel=Mixtral 8x22b2025.09 | 6 | |
| Self-consistencyModel=GPT-3.52025.09 | 6.37 | |
| CoTModel=Llama3-70b2025.09 | 7.61 | |
| CoTModel=GPT-4o-mini2025.09 | 7.63 | |
| MARSModel=GPT-3.52025.09 | 9.54 | |
| Self-reflectionModel=GPT-4o-mini2025.09 | 11.45 | |
| DMADModel=GPT-3.52025.09 | 12.77 | |
| Self-reflectionModel=Llama3-70b2025.09 | 13.24 | |
| CoTModel=Mixtral 8x7b2025.09 | 16.05 | |
| MADModel=GPT-3.52025.09 | 17.04 | |
| MARSModel=Mixtral 8x22b2025.09 | 22.21 | |
| Self-consistencyModel=Mixtral 8x22b2025.09 | 23.11 | |
| Self-consistencyModel=GPT-4o-mini2025.09 | 29.2 | |
| DMADModel=Mixtral 8x22b2025.09 | 33.78 | |
| MADModel=Mixtral 8x22b2025.09 | 36.83 | |
| Self-reflectionModel=Mixtral 8x7b2025.09 | 38.08 | |
| MARSModel=GPT-4o-mini2025.09 | 49.02 | |
| MARSModel=Llama3-70b2025.09 | 49.77 | |
| Self-consistencyModel=Llama3-70b2025.09 | 52.33 | |
| Self-consistencyModel=Mixtral 8x7b2025.09 | 68.17 | |
| MARSModel=Mixtral 8x7b2025.09 | 79.24 | |
| MADModel=Mixtral 8x7b2025.09 | 79.33 | |
| DMADModel=GPT-4o-mini2025.09 | 84.06 | |
| MADModel=GPT-4o-mini2025.09 | 85.67 | |
| DMADModel=Llama3-70b2025.09 | 102.78 | |
| MADModel=Llama3-70b2025.09 | 104.25 | |
| DMADModel=Mixtral 8x7b2025.09 | 128.67 |