Factual Knowledge Retrieval on MCEval mLAMA 8K (test)
79.5AccuracyAct
Evaluation results
| Method | Links | |
|---|---|---|
| ActModel=Qwen2.5-7B2024.12 | 79.5 | |
| Magn-ProbeModel=Qwen2.5-7B2024.12 | 78.5 | |
| Magn-ProbeModel=Llama3.1-8B2024.12 | 78.5 | |
| LM-ProbModel=Qwen2.5-7B2024.12 | 78.4 | |
| ActModel=Llama3.1-8B2024.12 | 78.1 | |
| LM-ProbModel=Llama3.1-8B2024.12 | 76.2 | |
| Magn-ProbeModel=Llama2-70B2024.12 | 76 | |
| LM-ProbModel=Llama2-70B2024.12 | 75.3 | |
| Magn-ProbeModel=Llama2-7B2024.12 | 63.7 | |
| ActModel=Llama2-7B2024.12 | 62.2 | |
| LM-ProbModel=Llama2-7B2024.12 | 60.8 | |
| Magn-ProbeModel=Llama3.2-3B2024.12 | 57 | |
| ActModel=Llama3.2-3B2024.12 | 56.3 | |
| LM-ProbModel=Llama3.2-3B2024.12 | 47.3 |