Correctness Prediction on LogiQA
67.75AccuracyLOCUS
Evaluation results
| Method | Links | |
|---|---|---|
| LOCUSTrain samples=10242026.01 | 67.75 | |
| kNNTrain samples=2562026.01 | 65.35 | |
| IRT-NETTrain samples=10242026.01 | 65.07 | |
| LOCUSTrain samples=2562026.01 | 64.88 | |
| EMBEDLLM+Train samples=10242026.01 | 63.25 | |
| IRT-NETTrain samples=5122026.01 | 62.31 | |
| EMBEDLLMTrain samples=10242026.01 | 61.38 | |
| IRT-NETTrain samples=2562026.01 | 59.89 | |
| LOCUSTrain samples=5122026.01 | 59.84 | |
| kNNTrain samples=10242026.01 | 59.58 | |
| EMBEDLLM+Train samples=5122026.01 | 57.63 | |
| EMBEDLLMTrain samples=5122026.01 | 55.92 | |
| KMEANSTrain samples=2562026.01 | 55.74 | |
| EMBEDLLMTrain samples=2562026.01 | 55.58 | |
| KMEANSTrain samples=10242026.01 | 55.57 | |
| kNNTrain samples=5122026.01 | 55.02 | |
| EMBEDLLM+Train samples=2562026.01 | 53.15 | |
| KMEANSTrain samples=5122026.01 | 51.98 |