Correctness Prediction on MMLU
65.83AccuracyIRT-NET
Evaluation results
| Method | Links | |
|---|---|---|
| IRT-NETTrain samples=10242026.01 | 65.83 | |
| EMBEDLLMTrain samples=10242026.01 | 65.62 | |
| EMBEDLLM+Train samples=10242026.01 | 65.55 | |
| LOCUSTrain samples=10242026.01 | 65.39 | |
| IRT-NETTrain samples=5122026.01 | 65.2 | |
| EMBEDLLM+Train samples=5122026.01 | 65.19 | |
| EMBEDLLMTrain samples=5122026.01 | 64.8 | |
| LOCUSTrain samples=5122026.01 | 64.64 | |
| kNNTrain samples=10242026.01 | 64.54 | |
| KMEANSTrain samples=10242026.01 | 64.16 | |
| EMBEDLLMTrain samples=2562026.01 | 64.01 | |
| kNNTrain samples=5122026.01 | 63.82 | |
| IRT-NETTrain samples=2562026.01 | 63.57 | |
| KMEANSTrain samples=5122026.01 | 63.25 | |
| LOCUSTrain samples=2562026.01 | 62.99 | |
| EMBEDLLM+Train samples=2562026.01 | 62.77 | |
| KMEANSTrain samples=2562026.01 | 61.33 | |
| kNNTrain samples=2562026.01 | 52.08 |