# Learning in the Dark: Privacy-Preserving Machine Learning using Function Approximation

Source: [Learning in the Dark: Privacy-Preserving Machine Learning using Function Approximation](<https://www.sota2.com/research/paper/68fa70901e209131cea4bdab>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2025-10-28T13:57:01.076Z

Authors: Tanveer Khan, Antonis Michalas

Published: 2023-09-15T06:45:58.000Z

## Abstract

Over the past few years, a tremendous growth of machine learning was brought about by a significant increase in adoption and implementation of cloud-based services. As a result, various solutions have been proposed in which the machine learning models run on a remote cloud provider and not locally on a user's machine. However, when such a model is deployed on an untrusted cloud provider, it is of vital importance that the users' privacy is preserved. To this end, we propose Learning in the Dark -- a hybrid machine learning model in which the training phase occurs in plaintext data, but the classification of the users' inputs is performed directly on homomorphically encrypted ciphertexts. To make our construction compatible with homomorphic encryption, we approximate the ReLU and Sigmoid activation functions using low-degree Chebyshev polynomials. This allowed us to build Learning in the Dark -- a privacy-preserving machine learning model that can classify encrypted images with high accuracy. Learning in the Dark preserves users' privacy since it is capable of performing high accuracy predictions by performing computations directly on encrypted data. In addition to that, the output of Learning in the Dark is generated in a blind and therefore privacy-preserving way by utilizing the properties of homomorphic encryption.

## Recorded benchmark results

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

- [Image Classification on MNIST (Plaintext and Encrypted Accuracy)](<https://www.sota2.com/research/sota/image-classification-on-mnist-plaintext-and-encrypted-accuracy.md>): Image Classification; MNIST; Plaintext Accuracy: 97.6.

- [Image Classification on MNIST CKKS (encrypted)](<https://www.sota2.com/research/sota/image-classification-on-mnist-ckks-encrypted.md>): Image Classification; MNIST CKKS (encrypted); Total Exp. Time (s): 6780.

- [ReLU Approximation on SST-2 RoBERTa tokenized vectors (test)](<https://www.sota2.com/research/sota/relu-approximation-on-sst-2-roberta-tokenized-vectors-test.md>): ReLU approximation; SST-2 RoBERTa tokenized vectors (test); MSE: 0.629.

- [ReLU Approximation on SST-2 DistilBERT tokenized vectors (test)](<https://www.sota2.com/research/sota/relu-approximation-on-sst-2-distilbert-tokenized-vectors-test.md>): ReLU approximation; SST-2 DistilBERT tokenized vectors (test); MSE: 0.548.

- [Image Classification on CIFAR-100 (ACC, NLL, ECE, ESS)](<https://www.sota2.com/research/sota/image-classification-on-cifar-100-acc-nll-ece-ess.md>): Image Classification; CIFAR-100; Accuracy: 35.6.

- [Image Classification on CIFAR-10 (Accuracy)](<https://www.sota2.com/research/sota/image-classification-on-cifar-10-accuracy.md>): Image Classification; CIFAR-10; Accuracy: 62.

## Original sources and implementation

[Original paper](<https://arxiv.org/abs/2309.08190>)

[PDF](<https://arxiv.org/pdf/2309.08190.pdf>)
