Data Filtering on OpenWebText Mainstream
92.4Balanced AccuracyGPT-4o
Evaluation results
| Method | Links | ||
|---|---|---|---|
| GPT-4o#Queries to GPT-4o=13.5M, Lightweight Model Cost=$0, Total Cost=$67,0002024.10 | 92.4 | 50 | |
| SIEVE#Queries to GPT-4o=100K, Lightweight Model Cost=$300, Total Cost=$8002024.10 | 91 | 54 | |
| GPT-3.5-Turbo#Queries to GPT-4o=13.5M, Lightweight Model Cost=$0, Total Cost=$13,0002024.10 | 76.11 | — |