Multi-Concept Image Generation on 12-concept dataset
0.682Text AlignmentDB-LoRA (FedAvg)
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| DB-LoRA (FedAvg)State=Merged2024.12 | 0.682 | 0.531 | 0.098 | — | — | — | |
| DB-LoRA (FedAvg)Merge Time=<1 s2023.12 | 0.682 | 0.531 | 0.098 | 0.069 | -0.213 | -0.585 | |
| Custom DiffusionState=Merged2024.12 | 0.673 | 0.623 | 0.408 | — | — | — | |
| Custom DiffusionMerge Time=~2 s2023.12 | 0.673 | 0.623 | 0.408 | 0.005 | -0.025 | -0.096 | |
| Custom DiffusionState=Single2024.12 | 0.668 | 0.648 | 0.504 | — | — | — | |
| LoRACLRState=Single2024.12 | 0.668 | 0.766 | 0.799 | — | — | — | |
| Custom DiffusionMerge Time=~2 s2023.12 | 0.668 | 0.648 | 0.504 | — | — | — | |
| LoRACLRState=Merged2024.12 | 0.665 | 0.776 | 0.828 | — | — | — | |
| Orthogonal AdaptationMerge Time=<1 s2023.12 | 0.654 | 0.748 | 0.74 | — | — | — | |
| Orthogonal AdaptationState=Merged2024.12 | 0.644 | 0.741 | 0.745 | — | — | — | |
| Orthogonal AdaptationMerge Time=<1 s2023.12 | 0.644 | 0.741 | 0.745 | -0.01 | -0.007 | 0.005 | |
| P+State=Single2024.12 | 0.643 | 0.683 | 0.515 | — | — | — | |
| P+State=Merged2024.12 | 0.643 | 0.683 | 0.515 | — | — | — | |
| P+Merge Time=<1 s2023.12 | 0.643 | 0.683 | 0.515 | — | — | — | |
| P+Merge Time=<1 s2023.12 | 0.643 | 0.683 | 0.515 | — | — | — | |
| MoS (Grad Fusion)State=Merged2024.12 | 0.631 | 0.729 | 0.717 | — | — | — | |
| MoS (Grad Fusion)Merge Time=~15 m2023.12 | 0.631 | 0.729 | 0.717 | 0.006 | -0.016 | -0.011 | |
| MoS (FedAvg)State=Single2024.12 | 0.625 | 0.745 | 0.728 | — | — | — | |
| MoS (Grad Fusion)State=Single2024.12 | 0.625 | 0.745 | 0.728 | — | — | — | |
| MoS (FedAvg)Merge Time=<1 s2023.12 | 0.625 | 0.745 | 0.728 | — | — | — | |
| MoS (Grad Fusion)Merge Time=~15 m2023.12 | 0.625 | 0.745 | 0.728 | — | — | — | |
| Orthogonal AdaptationState=Single2024.12 | 0.624 | 0.748 | 0.74 | — | — | — | |
| MoS (FedAvg)State=Merged2024.12 | 0.621 | 0.735 | 0.706 | — | — | — | |
| MoS (FedAvg)Merge Time=<1 s2023.12 | 0.621 | 0.735 | 0.706 | -0.004 | -0.01 | -0.022 | |
| DB-LoRA (FedAvg)State=Single2024.12 | 0.613 | 0.744 | 0.683 | — | — | — | |
| DB-LoRA (FedAvg)Merge Time=<1 s2023.12 | 0.613 | 0.744 | 0.683 | — | — | — |