Code Similarity on CodeWorkout (5-fold averaged)
0.593CodeBLEUGENCAT (Information)
Evaluation Results
| Method | Links | |
|---|---|---|
| GENCAT (Information)Step t=152026.02 | 0.593 | |
| 1PL_IRTStep t=202026.02 | 0.5925 | |
| GENCAT (Information)Step t=202026.02 | 0.5918 | |
| NCATStep t=102026.02 | 0.5915 | |
| NCATStep t=72026.02 | 0.5914 | |
| GENCAT (Information)Step t=72026.02 | 0.5913 | |
| NCATStep t=152026.02 | 0.5913 | |
| GENCAT (Information)Step t=102026.02 | 0.5911 | |
| GENCAT (Uncertainty)Step t=202026.02 | 0.5907 | |
| 1PL_IRTStep t=152026.02 | 0.5905 | |
| 1PL_IRTStep t=102026.02 | 0.5896 | |
| GENCAT (Diversity)Step t=152026.02 | 0.5895 | |
| NCATStep t=202026.02 | 0.5895 | |
| GENCAT (Uncertainty)Step t=152026.02 | 0.5891 | |
| BOBCATStep t=152026.02 | 0.5891 | |
| GENCAT (Uncertainty)Step t=102026.02 | 0.589 | |
| GENCAT (Diversity)Step t=72026.02 | 0.589 | |
| GENCAT (Diversity)Step t=202026.02 | 0.5889 | |
| LACATStep t=202026.02 | 0.5889 | |
| BOBCATStep t=72026.02 | 0.5886 | |
| GENCAT (Uncertainty)Step t=72026.02 | 0.5885 | |
| BOBCATStep t=202026.02 | 0.5881 | |
| BOBCATStep t=102026.02 | 0.5875 | |
| GENCAT (Diversity)Step t=102026.02 | 0.5873 | |
| LACATStep t=152026.02 | 0.5859 | |
| LACATStep t=72026.02 | 0.5855 | |
| LACATStep t=102026.02 | 0.5854 | |
| BOBCATStep t=52026.02 | 0.5854 | |
| GENCAT (Information)Step t=52026.02 | 0.5852 | |
| 1PL_IRTStep t=72026.02 | 0.5852 | |
| GENCAT (Uncertainty)Step t=52026.02 | 0.5844 | |
| NCATStep t=52026.02 | 0.5843 | |
| GENCAT (Diversity)Step t=52026.02 | 0.5842 | |
| 1PL_IRTStep t=32026.02 | 0.5775 | |
| 1PL_IRTStep t=52026.02 | 0.5774 | |
| LACATStep t=52026.02 | 0.5765 | |
| GENCAT (Information)Step t=32026.02 | 0.5761 | |
| NCATStep t=32026.02 | 0.5757 | |
| GENCAT (Diversity)Step t=32026.02 | 0.5754 | |
| GENCAT (Uncertainty)Step t=32026.02 | 0.5739 | |
| BOBCATStep t=32026.02 | 0.5713 | |
| NCATStep t=12026.02 | 0.5621 | |
| GENCAT (Information)Step t=12026.02 | 0.5608 | |
| GENCAT (Diversity)Step t=12026.02 | 0.5607 | |
| 1PL_IRTStep t=12026.02 | 0.5592 | |
| BOBCATStep t=12026.02 | 0.5581 | |
| GENCAT (Uncertainty)Step t=12026.02 | 0.5563 | |
| LACATStep t=12026.02 | 0.5556 | |
| LACATStep t=32026.02 | 0.5552 |