Natural Language Inference on SNLI (System Metrics)
131.39VRAMZorBA
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ZorBAModel=OPT-125M2026.02 | 131.39 | 2.43 | |
| FedZOModel=OPT-125M2026.02 | 167.44 | 3.19 | |
| DeComFLModel=OPT-125M2026.02 | 167.44 | 1.85 | |
| FedITModel=OPT-125M2026.02 | 190.74 | 1.4 | |
| ZorBAModel=OPT-1.3B2026.02 | 1,583.55 | 2.27 | |
| FedZOModel=OPT-1.3B2026.02 | 2,315.9 | 2.42 | |
| DeComFLModel=OPT-1.3B2026.02 | 2,315.9 | 2.34 | |
| FedITModel=OPT-1.3B2026.02 | 2,378.05 | 1.07 |