Lacuna
Benchmarks
TaskDatasetSOTA resultTrendResults
Lacuna-10 forget split
1Af Score
40
Lacuna-10 (retention)
100Ar (Retention Accuracy)
40
Lacuna-10 (test)
94.34Accuracy (Test Set)
40
Lacuna-10 (test)
1.4Test Error (mean)
36
Lacuna-5 (test)
3.87Test Error
27
Lacuna 10 (test)
1.48Test Error (Mean)
27
Lacuna-10
1.67Test Error
27
Lacuna-10 (test train forget)
1.05Test Error
10
Lacuna-5
5Test Error
10
Lacuna 1.0 (train test)
2.13Test Error
7
Lacuna-10 (test)
2.1Test Error
7
Lacuna-10-KR (test)
100Df
5
Lacuna-10 (test)
100Df
5
Lacuna-100-KR (test)
95.48Df (Differential Forgetting)
5
Lacuna-100 (test)
94.58Df
5
Lacuna-5 (test)
0.044KL Divergence
4
Lacuna-5 (forget set)
1.35KL Divergence
4
Lacuna-10 (forget set)
5.76KL Divergence
2