Computerized Adaptive Testing on CodeWorkout (test)
41.4Exp.% (med)NCAT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| NCATstep t=5, validation=5-fold averaged2026.02 | 41.4 | 58.92 | |
| GENCAT (Information)selection strategy=Information, step t=5, validation=5-fold averaged2026.02 | 15.6 | 35.41 | |
| GENCAT (Uncertainty)selection strategy=Uncertainty, step t=5, validation=5-fold averaged2026.02 | 12.8 | 25.33 | |
| BOBCATstep t=5, validation=5-fold averaged2026.02 | 12.6 | 35.67 | |
| GENCAT (Diversity)selection strategy=Diversity, step t=5, validation=5-fold averaged2026.02 | 11.6 | 36.21 | |
| 1PL_IRTstep t=5, validation=5-fold averaged2026.02 | 10.6 | 28.2 | |
| LACATstep t=5, validation=5-fold averaged, Backbone=GPT-3.5-turbo-16k2026.02 | 6.4 | 25.92 |