Distribution Alignment on ImageNet (train)
1.29FDDRL (λ*)
Evaluation Results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DRL (λ*)Model=RAE, Embedder=Incep., cfg=1, λ=1, R1=10−52026.06 | 1.29 | 0.61 | 72.8 | 64 | 1.092 | 95.7 | |
| BaseModel=RAE, Embedder=Incep., cfg=1, λ=--, R1=--2026.06 | 1.31 | 0.43 | 71.9 | 64.3 | 1.066 | 95.6 | |
| DRL (λ=1, R1=0)Model=RAE, Embedder=Incep., cfg=1, λ=1, R1=02026.06 | 1.38 | 0.82 | 73.6 | 63.2 | 1.114 | 95.7 | |
| DRL (λ=1, R1=0)Model=REPA, Embedder=Incep., cfg=1, λ=1, R1=02026.06 | 2.14 | 1.16 | 71.9 | 61.1 | 1.072 | 94.3 | |
| DRL (λ*)Model=REPA, Embedder=Incep., cfg=1, λ=1, R1=02026.06 | 2.14 | 1.16 | 71.9 | 61.1 | 1.072 | 94.3 | |
| DRL (λ=1, R1=0)Model=SiT, Embedder=Incep., cfg=1, λ=1, R1=02026.06 | 2.62 | 0.85 | 71.3 | 59.7 | 1.068 | 93.7 | |
| DRL (λ*)Model=SiT, Embedder=Incep., cfg=1, λ=1, R1=02026.06 | 2.62 | 0.85 | 71.3 | 59.7 | 1.068 | 93.7 | |
| DRL (λ*)Model=JiT, Embedder=Incep., cfg=1, λ=5, R1=10−52026.06 | 2.73 | 0.61 | 69.9 | 61.6 | 1.001 | 93 | |
| DRL (λ=1, R1=0)Model=JiT, Embedder=Incep., cfg=1, λ=1, R1=02026.06 | 3.72 | 0.79 | 65.2 | 64.5 | 0.871 | 90.5 | |
| DRL (λ*)Model=RAE, Embedder=DINOv3-L, cfg=1, λ=10, R1=10−52026.06 | 4.49 | 2.75 | 76.9 | 68.4 | 0.886 | 87.7 | |
| DRL (λ=1, R1=0)Model=RAE, Embedder=DINOv3-L, cfg=1, λ=1, R1=02026.06 | 5.71 | 4.21 | 74.2 | 69.8 | 0.821 | 85.9 | |
| BaseModel=REPA, Embedder=Incep., cfg=1, λ=--, R1=--2026.06 | 6.48 | 2.94 | 60 | 68.7 | 0.75 | 87.2 | |
| BaseModel=RAE, Embedder=DINOv3-L, cfg=1, λ=--, R1=--2026.06 | 6.66 | 5.2 | 73.1 | 69.7 | 0.802 | 84.9 | |
| BaseModel=JiT, Embedder=Incep., cfg=1, λ=--, R1=--2026.06 | 7.16 | 2.81 | 58.8 | 66.4 | 0.714 | 86 | |
| DRL (λ*)Model=RAE, Embedder=SigLIP-L, cfg=1, λ=10, R1=10−52026.06 | 9.13 | 19.68 | 84.4 | 51.8 | 1.2 | 91.9 | |
| BaseModel=SiT, Embedder=Incep., cfg=1, λ=--, R1=--2026.06 | 9.38 | 5.27 | 58.6 | 67.5 | 0.719 | 84.3 | |
| DRL (λ=1, R1=0)Model=RAE, Embedder=SigLIP-L, cfg=1, λ=1, R1=02026.06 | 9.53 | 19.3 | 83 | 53.5 | 1.143 | 91.5 | |
| BaseModel=RAE, Embedder=SigLIP-L, cfg=1, λ=--, R1=--2026.06 | 10.19 | 20.64 | 82.2 | 54.1 | 1.118 | 91 | |
| DRL (λ*)Model=JiT, Embedder=DINOv3-L, cfg=1, λ=20, R1=10−52026.06 | 11.32 | 8.13 | 75.4 | 47 | 0.862 | 81 | |
| DRL (λ*)Model=REPA, Embedder=SigLIP-L, cfg=1, λ=5, R1=10−52026.06 | 12.77 | 23.97 | 82.3 | 44.9 | 1.138 | 87.4 | |
| DRL (λ=1, R1=0)Model=REPA, Embedder=SigLIP-L, cfg=1, λ=1, R1=02026.06 | 14.34 | 28.71 | 79.5 | 47 | 1.033 | 86.4 | |
| DRL (λ*)Model=REPA, Embedder=DINOv3-L, cfg=1, λ=10, R1=10−52026.06 | 15.58 | 10.88 | 79.1 | 38.6 | 1.066 | 82.7 | |
| DRL (λ*)Model=SiT, Embedder=SigLIP-L, cfg=1, λ=5, R1=10−52026.06 | 16.9 | 30.2 | 81.7 | 38.2 | 1.128 | 84.3 | |
| DRL (λ*)Model=SiT, Embedder=DINOv3-L, cfg=1, λ=20, R1=10−52026.06 | 19.25 | 10.9 | 78.1 | 27.8 | 1.019 | 74.9 | |
| DRL (λ=1, R1=0)Model=SiT, Embedder=SigLIP-L, cfg=1, λ=1, R1=02026.06 | 20.17 | 40.37 | 77.6 | 41.7 | 0.977 | 82.3 | |
| DRL (λ*)Model=RAE, Embedder=DINOv2-L, cfg=1, λ=10, R1=10−52026.06 | 20.6 | 9.31 | 73.4 | 75.9 | 0.849 | 88.2 | |
| DRL (λ*)Model=JiT, Embedder=SigLIP-L, cfg=1, λ=20, R1=10−52026.06 | 20.99 | 45.97 | 85.6 | 30.2 | 1.27 | 87.5 | |
| DRL (λ=1, R1=0)Model=JiT, Embedder=DINOv3-L, cfg=1, λ=1, R1=02026.06 | 23.66 | 21.87 | 65.1 | 46.4 | 0.735 | 71.1 | |
| DRL (λ=1, R1=0)Model=REPA, Embedder=DINOv3-L, cfg=1, λ=1, R1=02026.06 | 29.43 | 28.16 | 66 | 41.2 | 0.855 | 76.3 | |
| DRL (λ=1, R1=0)Model=JiT, Embedder=SigLIP-L, cfg=1, λ=1, R1=02026.06 | 29.72 | 71.41 | 80.2 | 31.5 | 1.03 | 83.3 | |
| DRL (λ=1, R1=0)Model=RAE, Embedder=DINOv2-L, cfg=1, λ=1, R1=02026.06 | 30.17 | 22 | 68.9 | 78.1 | 0.737 | 84.9 | |
| BaseModel=REPA, Embedder=SigLIP-L, cfg=1, λ=--, R1=--2026.06 | 31.56 | 79.18 | 72.9 | 45.6 | 0.809 | 76.9 | |
| BaseModel=JiT, Embedder=DINOv3-L, cfg=1, λ=--, R1=--2026.06 | 33.89 | 33.84 | 62 | 42.8 | 0.749 | 63.6 | |
| BaseModel=RAE, Embedder=DINOv2-L, cfg=1, λ=--, R1=--2026.06 | 37.47 | 29.75 | 66.9 | 78.7 | 0.692 | 83.2 | |
| BaseModel=JiT, Embedder=SigLIP-L, cfg=1, λ=--, R1=--2026.06 | 39.41 | 100.22 | 77.2 | 29.7 | 0.921 | 77.9 | |
| DRL (λ*)Model=REPA, Embedder=DINOv2-L, cfg=1, λ=5, R1=10−52026.06 | 40.33 | 23.77 | 72.1 | 61.5 | 0.877 | 82.9 | |
| BaseModel=SiT, Embedder=SigLIP-L, cfg=1, λ=--, R1=--2026.06 | 42.59 | 108.37 | 71.2 | 39.5 | 0.761 | 70 | |
| DRL (λ*)Model=JiT, Embedder=DINOv2-L, cfg=1, λ=20, R1=10−52026.06 | 42.84 | 21.31 | 70.9 | 62.2 | 0.847 | 82.5 | |
| DRL (λ=1, R1=0)Model=SiT, Embedder=DINOv3-L, cfg=1, λ=1, R1=02026.06 | 43.76 | 46.23 | 58.1 | 34.7 | 0.754 | 64.7 | |
| DRL (λ*)Model=SiT, Embedder=DINOv2-L, cfg=1, λ=10, R1=10−52026.06 | 54.37 | 22.62 | 73.3 | 51 | 0.92 | 78.2 | |
| DRL (λ=1, R1=0)Model=REPA, Embedder=DINOv2-L, cfg=1, λ=1, R1=02026.06 | 58.33 | 45.83 | 64.4 | 65.3 | 0.693 | 77.3 | |
| BaseModel=REPA, Embedder=DINOv3-L, cfg=1, λ=--, R1=--2026.06 | 63.87 | 77.62 | 54 | 38.5 | 0.848 | 59.7 | |
| BaseModel=SiT, Embedder=DINOv3-L, cfg=1, λ=--, R1=--2026.06 | 88.22 | 117.44 | 47 | 31.4 | 0.803 | 45.3 | |
| DRL (λ=1, R1=0)Model=SiT, Embedder=DINOv2-L, cfg=1, λ=1, R1=02026.06 | 95.51 | 81.43 | 56.4 | 60.9 | 0.545 | 65.9 | |
| DRL (λ=1, R1=0)Model=JiT, Embedder=DINOv2-L, cfg=1, λ=1, R1=02026.06 | 97.33 | 89.2 | 56.8 | 65.9 | 0.545 | 69 | |
| BaseModel=JiT, Embedder=DINOv2-L, cfg=1, λ=--, R1=--2026.06 | 148.03 | 153.22 | 51.5 | 64.8 | 0.463 | 59.6 | |
| BaseModel=REPA, Embedder=DINOv2-L, cfg=1, λ=--, R1=--2026.06 | 159.46 | 163.05 | 51.7 | 66.8 | 0.465 | 60.6 | |
| BaseModel=SiT, Embedder=DINOv2-L, cfg=1, λ=--, R1=--2026.06 | 241.93 | 276.55 | 46.9 | 62.1 | 0.399 | 45.1 |