Few-shot Image Classification on Meta-Dataset (test)
97.2Omniglot AccuracyTSP
Evaluation results
| Method | Links | |||||||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| TSPWay=Varying, Shot=5, TSP Base Method=TSA2024.12 | 97.2 | 50.6 | 86.2 | 77 | 69.1 | 78.7 | 73.6 | 90.8 | 79.6 | 57.5 | 93 | 73.5 | 65 | 2.2 | — | — | — | — | 77.9 | 73.7 | 76.3 | — | — | |
| TSPWay=Varying, Shot=5, TSP Base Method=TA2-Net2024.12 | 97.1 | 50.8 | 86.7 | 77.8 | 69.3 | 78.8 | 72.9 | 91.1 | 80.9 | 59.3 | 93.9 | 74.2 | 65.6 | 1.4 | — | — | — | — | 78.1 | 74.8 | 76.8 | — | — | |
| TSPWay=5, Shot=1, Base Model=TA²-Net (TSP††)2024.12 | 96.8 | 50.5 | 81.3 | 75.7 | 55.4 | 80.2 | 78.1 | 81.1 | 56.9 | 60.5 | 81.7 | 56 | 65.6 | 1.5 | — | — | — | — | 74.9 | 64.1 | 70.8 | — | — | |
| TSAWay=Varying, Shot=52024.12 | 96.8 | 48.3 | 85.5 | 76.6 | 68.3 | 77.9 | 70.4 | 89.5 | 72.3 | 56 | 92.5 | 72 | 64.1 | 4.3 | — | — | — | — | 76.7 | 71.4 | 74.6 | — | — | |
| TSPWay=5, Shot=1, Base Model=TSA (TSP†)2024.12 | 96.6 | 50.1 | 81.1 | 75.7 | 55.5 | 80.7 | 77.8 | 81 | 57.4 | 59.7 | 81.4 | 55.9 | 65.2 | 1.9 | — | — | — | — | 74.8 | 63.9 | 70.6 | — | — | |
| TA2-NetWay=Varying, Shot=52024.12 | 96.6 | 49.3 | 85.9 | 77.3 | 68.3 | 78.5 | 70.3 | 90 | 76.7 | 56 | 93.3 | 73.1 | 64.1 | 3.5 | — | — | — | — | 77 | 72.6 | 75.3 | — | — | |
| URLShots=5, Ways=varying2021.03 | 96.4 | 49.5 | 84.4 | 75.6 | 65.7 | 78.3 | 68.1 | 86.3 | 57.6 | 54.7 | 89.4 | 64.6 | 54.9 | 1.5 | — | — | — | — | — | — | — | — | — | |
| TSAWay=5, Shot=12024.12 | 96.3 | 48 | 79.6 | 74.5 | 54.5 | 79.3 | 75.3 | 80.3 | 57.2 | 59.9 | 80.1 | 55.8 | 63.7 | 3.5 | — | — | — | — | 73.5 | 63.3 | 69.6 | — | — | |
| URLShots=1, Ways=52021.03 | 96.1 | 48.1 | 81.6 | 75.7 | 52.4 | 79.4 | 73.7 | 80 | 56.4 | 58.5 | 78.9 | 53.2 | 61.3 | 1.3 | — | — | — | — | — | — | — | — | — | |
| URTShots=5, Ways=varying2021.03 | 96 | 48.6 | 81.2 | 71.2 | 65.2 | 79.2 | 66.9 | 82.4 | 45.1 | 52.3 | 86.5 | 61.4 | 52.5 | 2.5 | — | — | — | — | — | — | — | — | — | |
| URTWay=Varying, Shot=52024.12 | 96 | 48.6 | 81.2 | 71.2 | 65.2 | 79.2 | 66.9 | 82.4 | 45.1 | 52.3 | 86.5 | 61.4 | 52.5 | 6.6 | — | — | — | — | 73.8 | 59.6 | 68.3 | — | — | |
| URLWay=Varying, Shot=52024.12 | 96 | 49.4 | 84.8 | 76 | 69.1 | 78.2 | 70 | 89.3 | 57.5 | 56.1 | 89.7 | 66 | 57 | 4.9 | — | — | — | — | 76.6 | 65.3 | 72.2 | — | — | |
| MOKDWay=Varying, Shot=52024.12 | 96 | 47.5 | 84.4 | 76.8 | 66.3 | 78.9 | 68.8 | 89.1 | 59.2 | 51.8 | 89.4 | 58.8 | 55.3 | 5.8 | — | — | — | — | 76 | 63 | 71 | — | — | |
| SURShots=5, Ways=varying2021.03 | 95.8 | 39.7 | 82.1 | 62.8 | 60.2 | 79 | 66.5 | 76.9 | 44.9 | 48.1 | 90.1 | 50.3 | 46.4 | 3 | — | — | — | — | — | — | — | — | — | |
| URLWay=5, Shot=12024.12 | 95.8 | 49.6 | 79.6 | 74.9 | 53.6 | 79 | 75.2 | 79.9 | 57.9 | 59.2 | 78.7 | 54.7 | 61.8 | 4.2 | — | — | — | — | 73.5 | 62.5 | 69.2 | — | — | |
| SURWay=Varying, Shot=52024.12 | 95.8 | 46.7 | 82.1 | 62.8 | 60.2 | 79 | 66.5 | 76.9 | 44.9 | 48.1 | 90.1 | 50.3 | 46.4 | 7.8 | — | — | — | — | 71.3 | 56 | 65.4 | — | — | |
| TA²-NetWay=5, Shot=12024.12 | 95.7 | 48.8 | 79.8 | 74.4 | 54.1 | 78.9 | 75.2 | 80.1 | 54.1 | 58.1 | 80.3 | 52.9 | 61 | 4.8 | — | — | — | — | 73.4 | 61.3 | 68.7 | — | — | |
| URTShots=1, Ways=52021.03 | 95.6 | 47.4 | 77.9 | 70.9 | 49.4 | 79.6 | 71 | 72.7 | 52.7 | 56.9 | 75.6 | 47.3 | 54.9 | 2.3 | — | — | — | — | — | — | — | — | — | |
| URTWay=5, Shot=12024.12 | 95.6 | 47.4 | 77.9 | 70.9 | 49.4 | 79.6 | 71 | 72.7 | 52.7 | 56.9 | 75.6 | 47.3 | 54.9 | 6.8 | — | — | — | — | 70.6 | 57.5 | 65.5 | — | — | |
| MOKDWay=5, Shot=12024.12 | 95.5 | 46 | 78.6 | 75.9 | 51.4 | 78.9 | 71.1 | 79.8 | 57 | 50.9 | 72.5 | 47.3 | 60.2 | 6.2 | — | — | — | — | 72.2 | 57.5 | 66.5 | — | — | |
| Simple CNAPSShots=5, Ways=varying2021.03 | 95.1 | 47.2 | 74.6 | 69.6 | 57.5 | 70.9 | 50.3 | 86.5 | 55.2 | 49.2 | 88.9 | 66.1 | 53.8 | 3 | — | — | — | — | — | — | — | — | — | |
| Simple CNAPSWay=Varying, Shot=52024.12 | 95.1 | 47.2 | 74.6 | 69.6 | 57.5 | 70.9 | 50.3 | 86.5 | 55.2 | 49.2 | 88.9 | 66.1 | 53.8 | 7.9 | — | — | — | — | 69 | 62.6 | 66.5 | — | — | |
| Simple CNAPSShots=1, Ways=52021.03 | 93.1 | 42.6 | 65.8 | 67.9 | 42.2 | 70.5 | 58.3 | 79.9 | 55.3 | 48.8 | 80.1 | 50.3 | 53.8 | 2.8 | — | — | — | — | — | — | — | — | — | |
| Simple CNAPSWay=5, Shot=12024.12 | 93.1 | 42.6 | 65.8 | 67.9 | 42.2 | 70.5 | 58.3 | 79.9 | 55.3 | 48.8 | 80.1 | 50.3 | 53.8 | 7.5 | — | — | — | — | 65 | 57.7 | 62.2 | — | — | |
| SURShots=1, Ways=52021.03 | 93 | 40.7 | 67.1 | 59.2 | 42.5 | 79.8 | 64.8 | 65 | 44.6 | 47.8 | 77.1 | 35.8 | 42.9 | 3.5 | — | — | — | — | — | — | — | — | — | |
| SURWay=5, Shot=12024.12 | 93 | 40.7 | 67.1 | 59.2 | 42.5 | 79.8 | 64.8 | 65 | 44.6 | 47.8 | 77.1 | 35.8 | 42.9 | 8.2 | — | — | — | — | 64 | 49.6 | 58.5 | — | — | |
| GAP + fo-MAMLBackbone=ResNet-18, Training setup=trained on eight datasets2023.04 | 88.29 | 51.72 | 81.52 | 74.16 | 70.92 | 67.95 | 38.88 | 85.1 | 68.32 | 43.26 | — | — | — | — | — | 95.92 | 73.5 | 61.29 | 69.82 | 55.79 | 67.01 | 68.46 | 69.29 | |
| Approximate GAP + fo-MAMLBackbone=ResNet-18, Training setup=trained on eight datasets2023.04 | 88.13 | 51.57 | 81.05 | 73.85 | 70.85 | 67.26 | 38.78 | 84.48 | 67.72 | 43.26 | — | — | — | — | — | 95.74 | 73.04 | 60.72 | 69.5 | 55.49 | 66.7 | 68.1 | 68.96 | |
| GAP + Proto-MAMLBackbone=ResNet-18, Training setup=trained on eight datasets2023.04 | 86.54 | 53.54 | 78.59 | 74.57 | 68.73 | 69.67 | 43.61 | 87.9 | 68.73 | 46.04 | — | — | — | — | — | 94.86 | 73.25 | 60.72 | 70.39 | 57.39 | 67.79 | 68.39 | 69.62 | |
| Approximate GAP + Proto-MAMLBackbone=ResNet-18, Training setup=trained on eight datasets2023.04 | 85.82 | 53.04 | 79.3 | 74.06 | 68.12 | 68.92 | 42.22 | 87.42 | 68.12 | 45.76 | — | — | — | — | — | 94.73 | 72.62 | 59 | 69.86 | 56.94 | 66.77 | 68.05 | 69.16 | |
| fo-MAMLBackbone=ResNet-18, Training setup=trained on eight datasets2023.04 | 83.92 | 37.83 | 76.41 | 62.43 | 64.14 | 59.73 | 33.54 | 79.94 | 42.91 | 29.37 | — | — | — | — | — | — | — | — | 62.24 | 36.14 | 57.02 | — | — | |
| Proto-MAMLBackbone=ResNet-18, Training setup=trained on eight datasets2023.04 | 82.69 | 46.52 | 75.23 | 69.88 | 68.25 | 66.84 | 41.99 | 88.72 | 52.42 | 41.74 | — | — | — | — | — | — | — | — | 67.52 | 47.08 | 63.43 | — | — | |
| TCPRTask centroid approximation=x_SUQ2022.10 | 80.88 | — | — | 53.83 | 54.38 | 57.31 | 46.28 | 75.37 | 56.65 | — | — | — | — | — | 69.52 | — | — | — | — | — | — | — | — | |
| ZN2022.10 | 78.8 | — | — | 48.15 | 52.2 | 52.86 | 43.24 | 70.21 | 53.92 | — | — | — | — | — | 67.05 | — | — | — | — | — | — | — | — | |
| TCPRTask centroid approximation=c_task2022.10 | 78.51 | — | — | 51.87 | 52.5 | 54.62 | 44.38 | 72.55 | 54.83 | — | — | — | — | — | 68.06 | — | — | — | — | — | — | — | — | |
| ALFA + Proto-MAMLBackbone=ResNet-18, Training setup=trained on eight datasets2023.04 | 78.4 | 49.87 | 71.88 | 68.57 | 70.23 | 63.72 | 43.76 | 89.09 | 58.46 | 46.17 | — | — | — | — | — | — | — | — | 66.94 | 52.32 | 64.02 | — | — | |
| SimpleShot2022.10 | 78.19 | — | — | 49.68 | 51.19 | 54.5 | 43.79 | 71.68 | 54.04 | — | — | — | — | — | 67.18 | — | — | — | — | — | — | — | — | |
| TCPRTask centroid approximation=x_S2022.10 | 77.89 | — | — | 50.48 | 51.49 | 54.6 | 43.15 | 70.33 | 54.22 | — | — | — | — | — | 66.88 | — | — | — | — | — | — | — | — | |
| baseline2022.10 | 77.28 | — | — | 47.75 | 50.47 | 51.6 | 42.36 | 70.33 | 53.5 | — | — | — | — | — | 64.63 | — | — | — | — | — | — | — | — | |
| ALFA + fo-MAMLBackbone=ResNet-18, Training setup=trained on eight datasets2023.04 | 76.67 | 48.88 | 68.82 | 66.32 | 68.72 | 66.07 | 37.52 | 86.79 | 65.13 | 43.05 | — | — | — | — | — | — | — | — | 64.97 | 54.09 | 62.8 | — | — |