ResearchBenchmarksLinguistic Acceptability on CoLA (train)Linguistic Acceptability on CoLA (train)Follow17.9Training ThroughputAQ-SGD1.5725.81110.0514.289Jun 2, 2022Evaluation resultsMethodMethodLinksTraining ThroughputAQ-SGDNetwork Bandwidth=10 G...Network Bandwidth=10 Gbps, Backbone=DeBERTa-1.5B, Pipeline Config=fw2 bw42022.0617.9FP32Network Bandwidth=100...Network Bandwidth=100 Mbps, Backbone=DeBERTa-1.5B, Precision=FP322022.062.2