List your company

ResearchFormerly WizWand

CodeWorkout

Benchmarks

TaskDatasetSOTA resultTrendResults

Knowledge Estimation

CodeWorkout

72.32Accuracy

49

Code Similarity

CodeWorkout (5-fold averaged)

0.593CodeBLEU

49

Computerized Adaptive Testing

CodeWorkout (test)

41.4Exp.% (med)

7

Knowledge Tracing Correctness Prediction

CodeWorkout Java

0.816AUC

6

Knowledge Tracing

CodeWorkout (test)

82.4A1 Performance Score

4

Code Prediction

CodeWorkout Java

58CodeBLEU

3

Predictive Modeling (AFM)

CodeWorkout Selected KC set (test)

63.1AUC

3

Predictive Modeling (AFM)

CodeWorkout Generated KC set (test)

0.676AUC

3

Predictive Modeling (AFM)

CodeWorkout Human KC set (test)

66.5AUC

3

Learning Curve fit

CodeWorkout Selected KC set (test)

0.069RMSE

3

Learning Curve fit

CodeWorkout Generated KC set (test)

0.07RMSE

3

Learning Curve fit

CodeWorkout Human KC set (test)

0.077RMSE

3