Programming Skill Prediction on INF110 2018-2024 train 2025 test (lab sessions)
75MathJina
Evaluation results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| JinaClassifier=MLP (100 hidden neurons), Embedding dimension=768, Adapter=text-matching LoRA adapter, Training protocol=Balanced dataset downsampling2026.02 | 75 | 64 | 37 | 52 | 53 | 80 | 89 | 98 | 69 | |
| CodeBERT-cppClassifier=MLP (100 hidden neurons), Embedding dimension=768, Training protocol=Balanced dataset downsampling2026.02 | 68 | 63 | 41 | 52 | 51 | 75 | 90 | 90 | 66 | |
| TF-IDFClassifier=MLP (100 hidden neurons), Embedding dimension=768 (reduced from vocabulary size), Training protocol=Balanced dataset downsampling2026.02 | 66 | 52 | 32 | 45 | 46 | 54 | 86 | 87 | 59 | |
| GraphCodeBERTClassifier=MLP (100 hidden neurons), Embedding dimension=768, Training protocol=Balanced dataset downsampling2026.02 | 61 | 61 | 39 | 47 | 51 | 74 | 89 | 89 | 64 |