Correctness Prediction on SoQA
67.85AccuracyKMEANS
Evaluation Results
| Method | Links | |
|---|---|---|
| KMEANSTrain samples=10242026.01 | 67.85 | |
| KMEANSTrain samples=2562026.01 | 67.74 | |
| kNNTrain samples=10242026.01 | 67.48 | |
| KMEANSTrain samples=5122026.01 | 67.47 | |
| LOCUSTrain samples=10242026.01 | 66.83 | |
| EMBEDLLM+Train samples=2562026.01 | 66.01 | |
| kNNTrain samples=5122026.01 | 65.9 | |
| IRT-NETTrain samples=10242026.01 | 65.51 | |
| EMBEDLLMTrain samples=2562026.01 | 65.24 | |
| IRT-NETTrain samples=2562026.01 | 65.08 | |
| EMBEDLLM+Train samples=10242026.01 | 64.84 | |
| IRT-NETTrain samples=5122026.01 | 64 | |
| kNNTrain samples=2562026.01 | 63.94 | |
| EMBEDLLMTrain samples=10242026.01 | 62.67 | |
| LOCUSTrain samples=2562026.01 | 61.76 | |
| EMBEDLLM+Train samples=5122026.01 | 61.63 | |
| EMBEDLLMTrain samples=5122026.01 | 61.4 | |
| LOCUSTrain samples=5122026.01 | 54.08 |