ResearchBenchmarksMemory Footprint for Private Text Generation on GPT2-base (124M)Memory Footprint for Private Text Generation on GPT2-base (124M)Follow100Usage FractionCrypTen35.2652.067568.87585.6825May 25, 2023Evaluation resultsMethodMethodLinksUsage FractionEmbed SizeLinear Layer SizeSoftmax Layer SizeTotal Memory FootprintCrypTen2023.05100————THE-X2023.0598.95————MPCformersoftmax_approximation=...softmax_approximation=sm2relu2023.0598.34————MPCformersoftmax_approximation=...softmax_approximation=sm2quad2023.0598.2————MERGEmode=only MMmode=only MM2023.0587.39————MERGEmode=only ERmode=only ER2023.0552.24————MERGEmode=ER+MMmode=ER+MM2023.0537.75————