Formal Fallacies detection on Formal Fallacies (test)
90.8AccuracyHuman-Rater
Evaluation results
| Method | Links | |
|---|---|---|
| Human-RaterModel=Human, Prompting Strategy=Average2023.05 | 90.8 | |
| AMPLIFYModel=GPT-3, Prompting Strategy=AMPLIFY2023.05 | 60.1 | |
| AMPLIFYModel=GPT-3.5, Prompting Strategy=AMPLIFY2023.05 | 59.9 | |
| GPT-3.5Model=GPT-3.5, Prompting Strategy=CoT2023.05 | 54.6 | |
| GPT-3Model=GPT-3, Prompting Strategy=AO2023.05 | 53.6 | |
| SOTAModel=N/A, Prompting Strategy=N/A2023.05 | 52.2 | |
| GPT-3.5Model=GPT-3.5, Prompting Strategy=AO2023.05 | 51.4 | |
| GPT-3Model=GPT-3, Prompting Strategy=CoT2023.05 | 50.8 | |
| RandomModel=N/A, Prompting Strategy=Random Choice2023.05 | 25 |