Language Modeling on The Pile non-copyrighted (test)
0.557BPBSIFT
Evaluation Results
| Method | Links | |
|---|---|---|
| SIFTEvaluation Protocol=Test-Time FT, Base Model=Llama-3.2, Parameters=3B2024.10 | 0.557 | |
| SIFTEvaluation Protocol=Test-Time FT, Base Model=Phi-3, Parameters=3.8B2024.10 | 0.595 | |
| SIFTEvaluation Protocol=Test-Time FT, Base Model=Llama-3.2, Parameters=1B2024.10 | 0.606 | |
| Gemma-2Parameters=27B2024.10 | 0.629 | |
| Llama-3.2Parameters=3B2024.10 | 0.64 | |
| Phi-3Parameters=14B2024.10 | 0.651 | |
| Phi-3.5-MoEParameters=16x3.8B2024.10 | 0.656 | |
| GPT-3Parameters=175B2024.10 | 0.666 | |
| Gemma-2Parameters=9B2024.10 | 0.67 | |
| Phi-3Parameters=7B2024.10 | 0.678 | |
| Phi-3Parameters=3.8B2024.10 | 0.679 | |
| Phi-3.5Parameters=3.8B2024.10 | 0.69 | |
| Llama-3.2Parameters=1B2024.10 | 0.697 | |
| Gemma-2Parameters=2B2024.10 | 0.721 | |
| Llama-3.2-InstructParameters=3B2024.10 | 0.737 | |
| SIFTEvaluation Protocol=Test-Time FT, Base Model=GPT-2, Parameters=774M2024.10 | 0.762 | |
| Llama-3.2-InstructParameters=1B2024.10 | 0.807 | |
| SIFTEvaluation Protocol=Test-Time FT, Base Model=GPT-2, Parameters=124M2024.10 | 0.862 | |
| GPT-2Parameters=774M2024.10 | 1.093 | |
| GPT-2Parameters=124M2024.10 | 1.241 |