TARU PUBLICATIONS
Journal of Discrete Mathematical Sciences and Cryptography cover
Open Access ·Peer-reviewed·ISSN (Online): 2169-0065·ISSN (Print): 0972-0529

Monthly Journal: Publishes theoretical and applied research in all areas of Discrete Mathematical Sciences, Cryptography, Combinatorics, Elliptic Curves and Information Security.

Issues up to 2022 co-published with and available at:Taylor & Francis Online
submissions@tarupublications.com
Open Access Research Article

Chebyshev polynomial approximation in CNN for zero-knowledge encrypted data analysis

, * , , , ,

* Corresponding author · click or hover a name for details

pp. 203–214Vol. 27Issue 2-AMarch 2024DOI: 10.47974/JDMSC-1880 Crossmark XML
Published Online:
06 Apr 2024
Article type:
Research Article
Language:
EN
Article no.:
JDMSC-1880
Pages:
203–214

Abstract

Integrating Deep Learning (DL) techniques in Convolutional Neural Networks (CNNs) with encrypted data analysis is an emerging field for enhancing data privacy and security. A significant challenge in this domain is the incompatibility of standard non-linear Activation Functions (AF) like Rectified Linear Unit (ReLU) and Hyperbolic Tangent (tanh) with Zero-Knowledge (ZK) encrypted data, which impacts computational efficiency and data privacy. Addressing this, our paper introduces the novel application of Chebyshev Polynomial Approximation (CPA) to adapt these AF to process encrypted data effectively. Utilizing the MNIST dataset, this paper conducted experiments with LeNet and various configurations of AlexNet, extending the range of the ReLU and tanH functions to optimize CPA. Our results reveal an optimal polynomial degree (α), with α = 10 for ReLU and between α = 10 and α = 15 for tanH, beyond which the benefits in accuracy plateau. This finding is crucial for ensuring the accuracy and efficiency of CNNs in processing encrypted data. This recommended study demonstrates that while the accuracy slightly decreases for plaintext data and more significantly for ciphertext data, the overall effectiveness of CPA in CNNs is maintained. This advancement enables CNNs to process encrypted data while preserving privacy and marks a significant step in developing privacy-preserving Machine Learning (ML) and encrypted data analysis.

Keywords

Subject Classifications

97F90

References

[1] Dubey, S. R., et al., Activation functions in deep learning: A comprehensive survey and benchmark. Neurocomputing (2022).
[2] He, M. et al., Convolutional neural networks on graphs with Chebyshev approximation revisited—Advances in Neural Information Processing Systems, 35, 7264-7276 (2022).
[3] S. K. Sharma, A. Chaurasia, V. S. Sharma, C. L. Chowdhary and S. Basheer, “GEMM, a Genetic Engineering-Based Mutual Model for Resource Allocation of Grid Computing,” in IEEE Access, vol. 11, pp. 128537-128548 (2023), doi: 10.1109/ACCESS.2023.3333278.
[4] Scholz, F., & Jüttler, B., Parameterization for polynomial curve approximation via residual deep neural networks. Computer Aided Geometric Design, 85, 101977 (2021).
[5] Mao, T. et al., Approximating functions with multi-features by deep convolutional neural networks. Analysis and Applications, 21(01), 93-125 (2023).
[6] Goyal, M., et al., Improved polynomial neural networks with normalized activations. International Joint Conference on Neural Networks, pp. 1-8, IEEE (2020).
[7] H. Zhang et al., Polynomial Improved Convolution Kernel Graph Network For Fault Diagnosis, 3rd International Conference on Neural Networks, Information and Communication Engineering, Guangzhou, China, pp. 15-19 (2023).
[8] V. Atanasov, Application of Convolutional Neural Networks and Signal Processing Techniques to Identify and Filter Noise from ECG Signals, 18th Conference on Electrical Machines, Drives and Power Systems, Varna, Bulgaria, pp. 1-5 (2023).
[9] R. Koç and F. T. Yarman Vural, DidEye: An Attempt for Defining and Incorporating Visual Intuition for Convolutional Neural Networks, 31st Signal Processing and Communications Applications Conference (SIU), Istanbul, Turkiye, pp. 1-4 (2023).
[10] A. Takiddin et al., A Graph Neural Network Multi-Task Learning-Based Approach for Detection and Localization of Cyberattacks in Smart Grids, IEEE International Conference on Acoustics, Speech and Signal Processing, Rhodes Island, Greece, pp. 1-5 (2023).
[11] C. Yang et al., An Improved KNNG Driven Graph Transfer Diagnosis Method Via Edge Predictor,” 5th International Conference on Intelligent Control, Measurement and Signal Processing, Chengdu, China, pp. 829-832 (2023).

Views: 312Downloads: 9Citations: 0