Retain Set
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
Retain Set
48.13Classification Accuracy
35
Retain set
99Instruction Following Accuracy
12
Retain-Set 15% forgetting ratio experiment
61.6Classification VQA Accuracy
7
Retain-Set 5% forgetting ratio experiment
61.56Accuracy (Class VQA)
7