Word Sorting on Big-Bench Hard
79.8Success RateTextGrad
Evaluation results
| Method | Links | ||
|---|---|---|---|
| TextGradsource=Reported, optimizer=GPT-4o-2024-08-06, student model=GPT-3.5-turbo-11062024.06 | 79.8 | — | |
| TextGradversion=24-10-30, optimizer=GPT-4o-2024-08-06, student model=GPT-3.5-turbo-11062024.06 | 72 | 211.1 | |
| OptoPrimeimplementation=Trace, optimizer=GPT-4o-2024-08-06, student model=GPT-3.5-turbo-11062024.06 | 71.6 | 82.5 | |
| TextGradimplementation=Trace, optimizer=GPT-4o-2024-08-06, student model=GPT-3.5-turbo-11062024.06 | 71.4 | — |