Quantitative Reasoning on OCWCourses (test)
30.8AccuracyMinerva
Evaluation results
| Method | Links | |
|---|---|---|
| MinervaModel Parameters=540B, Majority Voting (maj1@k)=true, k samples=642022.06 | 30.8 | |
| MinervaModel Parameters=62B, Majority Voting (maj1@k)=true, k samples=642022.06 | 23.5 | |
| MinervaModel Parameters=540B2022.06 | 17.6 | |
| OpenAI davinci-0022022.06 | 14.8 | |
| MinervaModel Parameters=62B2022.06 | 12.9 | |
| MinervaModel Parameters=8B, Majority Voting (maj1@k)=true, k samples=642022.06 | 12.5 | |
| MinervaModel Parameters=8B2022.06 | 7.7 | |
| PaLMModel Parameters=540B2022.06 | 7.1 | |
| PaLMModel Parameters=62B2022.06 | 5.9 | |
| PaLMModel Parameters=8B2022.06 | 1.5 |