Biological Tool Use on AlphaFold
10Pass@10GPT-4o
Evaluation results
| Method | Links | |
|---|---|---|
| GPT-4oFine-tuned=true2024.12 | 10 | |
| GPT-4 TurboScaffold=Ranger, Browser access=true2024.12 | 0 | |
| GPT-4oScaffold=Ranger, Browser access=true2024.12 | 0 | |
| o1Scaffold=Ranger, Mitigation status=post-mitigation2024.12 | 0 | |
| o1-previewScaffold=Ranger, Mitigation status=post-mitigation2024.12 | 0 | |
| o1-miniScaffold=Ranger, Mitigation status=post-mitigation2024.12 | 0 | |
| o1Mitigation status=post-mitigation2024.12 | 0 | |
| o1-previewMitigation status=post-mitigation2024.12 | 0 | |
| o1-miniMitigation status=post-mitigation2024.12 | 0 | |
| o1Mitigation status=pre-mitigation2024.12 | 0 | |
| o1-previewMitigation status=pre-mitigation2024.12 | 0 | |
| o1-miniMitigation status=pre-mitigation2024.12 | 0 |