Data Filtering on FineWeb-edu CC-MAIN-2024-10
81.9Recall@30Ens(Good, Bad)
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Ens(Good, Bad)Model=Ensemble, Components=Good KenLM, Bad KenLM2024.09 | 81.9 | 96.47 | 89.19 | |
| FastText(Good, Bad)Model=FastText, Training Data=Good KenLM & Bad KenLM filtered data2024.09 | 74.62 | 94.12 | 84.37 | |
| Good KenLMModel=KenLM, Training Data=S2ORC, Textbooks2024.09 | 70.59 | 91.95 | 81.27 | |
| FastText(Wiki, Bad)Model=FastText, Training Data=Wiki KenLM & Bad KenLM filtered data2024.09 | 64.53 | 88.78 | 76.65 | |
| Ens(Good, Wiki)Model=Ensemble, Components=Good KenLM, Wiki KenLM2024.09 | 63.12 | 88.98 | 76.05 | |
| Wiki KenLMModel=KenLM, Training Data=Wikipedia2024.09 | 55.3 | 85.13 | 70.22 | |
| Bad KenLMModel=KenLM, Training Data=SNS, Spam2024.09 | 34.03 | 70.31 | 52.17 |