Named Entity Recognition on MCEval NER 8K (test)
0.877AccuracyAct
Evaluation Results
| Method | Links | |
|---|---|---|
| ActModel=Qwen2.5-7B2024.12 | 0.877 | |
| Magn-ProbeModel=Qwen2.5-7B2024.12 | 0.877 | |
| LM-ProbModel=Qwen2.5-7B2024.12 | 0.871 | |
| Magn-ProbeModel=Llama3.1-8B2024.12 | 0.833 | |
| ActModel=Llama3.1-8B2024.12 | 0.826 | |
| Magn-ProbeModel=Llama2-70B2024.12 | 0.817 | |
| LM-ProbModel=Llama3.1-8B2024.12 | 0.815 | |
| LM-ProbModel=Llama2-70B2024.12 | 0.79 | |
| ActModel=Llama3.2-3B2024.12 | 0.633 | |
| Magn-ProbeModel=Llama3.2-3B2024.12 | 0.618 | |
| LM-ProbModel=Llama3.2-3B2024.12 | 0.598 | |
| Magn-ProbeModel=Llama2-7B2024.12 | 0.498 | |
| ActModel=Llama2-7B2024.12 | 0.453 | |
| LM-ProbModel=Llama2-7B2024.12 | 0.361 |