Multi-Task Incremental Learning on MTIL Suite (11 Datasets)
96.8Caltech101 AccuracyDual-RAIL
Evaluation results
| Method | Links | ||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Dual-RAILProtocol=Last2025.03 | 96.8 | 52.5 | 83.3 | 80.1 | 96.4 | 99 | 89.9 | 98.8 | 93.5 | 85.5 | 79.2 | 86.8 | |
| Primal-RAILProtocol=Last2025.03 | 96.5 | 51.9 | 82.8 | 80 | 96 | 98.7 | 89.7 | 98.8 | 93.3 | 84.8 | 78.7 | 86.5 | |
| DPeCLIPProtocol=Last2025.03 | 95.6 | 49.9 | 85.8 | 78.6 | 98.4 | 95.8 | 92.1 | 99.4 | 94 | 84.5 | 81.7 | 86.9 | |
| ConDU (LoRA)Adaptation=LoRA, Protocol=Last2025.03 | 95.2 | 48.9 | 87.8 | 78.5 | 96.3 | 95.2 | 91.7 | 97.6 | 93 | 85.3 | 78.8 | 86.2 | |
| Individual FTProtocol=General Baseline2025.03 | 95.1 | 62 | 89.6 | 79.5 | 98.9 | 97.5 | 92.7 | 99.6 | 94.7 | 89.6 | 81.8 | 89.2 | |
| CoLeCLIPProtocol=Last2025.03 | 94.9 | 48.7 | 78.8 | 78.4 | 88.9 | 96.3 | 91.1 | 97.6 | 94.4 | 82.7 | 80.2 | 84.7 | |
| MoEProtocol=Last2025.03 | 94.7 | 34.6 | 82.7 | 76.9 | 97.7 | 94.8 | 91.9 | 99.4 | 94.7 | 80.9 | 80.5 | 84.4 | |
| ConDU (FT)Adaptation=Fine-Tuning, Protocol=Last2025.03 | 93.7 | 58.6 | 86.6 | 76.1 | 98.2 | 93.4 | 91.9 | 99.6 | 94.8 | 84.9 | 80.5 | 87.1 | |
| iCaRLProtocol=Last2025.03 | 93 | 35.8 | 77 | 70.2 | 83.3 | 88.5 | 90.4 | 86.7 | 93.2 | 81.2 | 81.9 | 80.1 | |
| MulKIProtocol=Last2025.03 | 93 | 49.7 | 82.8 | 73.7 | 96.2 | 92.3 | 90.4 | 99 | 94.8 | 85.2 | 78.9 | 85.1 | |
| ZSCLProtocol=Last2025.03 | 92.2 | 40.6 | 81.3 | 70.5 | 94.8 | 90.5 | 91.9 | 98.7 | 93.9 | 85.3 | 80.2 | 83.6 | |
| MAProtocol=Last2025.03 | 92.2 | 49.8 | 86.1 | 78.1 | 95.7 | 94.3 | 89.5 | 98.1 | 89.9 | 81.6 | 80 | 85 | |
| WiSE-FTProtocol=Last2025.03 | 90.8 | 27.2 | 68 | 68.9 | 86.9 | 74 | 87.6 | 99.6 | 92.6 | 77.8 | 81.3 | 77.7 | |
| LwF-VRProtocol=Last2025.03 | 89.8 | 20.5 | 72.3 | 67.6 | 85.5 | 73.8 | 85.7 | 99.6 | 93.1 | 73.3 | 80.9 | 76.6 | |
| Continual FTProtocol=Last2025.03 | 89.3 | 31 | 65.8 | 67.3 | 88.9 | 71.1 | 85.6 | 99.6 | 92.9 | 77.3 | 81.1 | 77.3 | |
| Zero-shotProtocol=General Baseline2025.03 | 88.4 | 24.3 | 68.2 | 44.6 | 54.9 | 71 | 88.5 | 59.4 | 89 | 64.7 | 65.2 | 65.3 | |
| Primal-RAILProtocol=Transfer2025.03 | 88.4 | — | 68.2 | 44.6 | 54.9 | 71 | 88.5 | 59.6 | 89 | 64.7 | 65.2 | 69.4 | |
| Dual-RAILProtocol=Transfer2025.03 | 88.4 | — | 68.2 | 44.6 | 54.9 | 71 | 88.5 | 59.6 | 89 | 64.7 | 65.2 | 69.4 | |
| MoEProtocol=Transfer2025.03 | 88.2 | — | 66.9 | 44.7 | 54.1 | 70.6 | 88.4 | 59.5 | 89 | 64.7 | 65 | 69.1 | |
| CoLeCLIPProtocol=Transfer2025.03 | 88.2 | — | 65.1 | 44.7 | 54.1 | 68.8 | 88.5 | 59.5 | 89 | 64.7 | 65.1 | 68.8 | |
| DPeCLIPProtocol=Transfer2025.03 | 88.2 | — | 67.2 | 44.7 | 54 | 70.6 | 88.2 | 59.5 | 89 | 64.7 | 64.8 | 69.1 | |
| ConDU (LoRA)Adaptation=LoRA, Protocol=Transfer2025.03 | 88.1 | — | 68.9 | 45.7 | 57 | 71.3 | 88.8 | 61.2 | 89.3 | 65.1 | 67.8 | 70.3 | |
| ConDU (FT)Adaptation=Fine-Tuning, Protocol=Transfer2025.03 | 88.1 | — | 68.9 | 46.4 | 57.1 | 71.4 | 88.7 | 65.5 | 89.3 | 65 | 67.8 | 70.8 | |
| MAProtocol=Transfer2025.03 | 87.9 | — | 68.2 | 44.4 | 49.9 | 70.7 | 88.7 | 59.7 | 89.1 | 64.5 | 65.5 | 68.9 | |
| MulKIProtocol=Transfer2025.03 | 87.8 | — | 69 | 46.7 | 51.8 | 71.3 | 88.3 | 64.7 | 89.7 | 63.4 | 68.1 | 70.1 | |
| LwFProtocol=Last2025.03 | 87.5 | 26.3 | 71.9 | 66.6 | 79.9 | 66.9 | 83.8 | 99.6 | 92.1 | 66.1 | 80.4 | 74.6 | |
| ZSCLProtocol=Transfer2025.03 | 86 | — | 67.4 | 45.4 | 50.4 | 69.1 | 87.6 | 61.8 | 86.8 | 60.1 | 66.8 | 68.1 | |
| LwF-VRProtocol=Transfer2025.03 | 77.1 | — | 61 | 40.5 | 45.3 | 54.4 | 74.6 | 47.9 | 76.7 | 36.3 | 58.6 | 57.2 | |
| LwFProtocol=Transfer2025.03 | 74.5 | — | 56.9 | 39.1 | 51.1 | 52.6 | 72.8 | 60.6 | 75.1 | 30.3 | 55.9 | 58.9 | |
| WiSE-FTProtocol=Transfer2025.03 | 73.5 | — | 55.6 | 35.6 | 41.5 | 47 | 68.3 | 53.9 | 69.3 | 26.8 | 51.9 | 52.3 | |
| Continual FTProtocol=Transfer2025.03 | 67.1 | — | 46 | 32.1 | 35.6 | 35 | 57.7 | 44.1 | 60.8 | 20.5 | 46.6 | 44.6 | |
| iCaRLProtocol=Transfer2025.03 | 56.6 | — | 44.6 | 32.7 | 39.3 | 46.6 | 68 | 46 | 77.4 | 31.9 | 60.5 | 50.4 |