Open AccessAdaBias: An Optimization Method With Bias Correction for Differential Privacy Protection
Author(s) -
Xuanyu Zhao,
Tao Hu,
Jun Li,
Chunxia Mao
Publication year - 2022
Publication title -
ieee access
Language(s) - English
Resource type - Journals
SCImago Journal Rank - 0.587
H-Index - 127
ISSN - 2169-3536
DOI - 10.1109/access.2022.3212031
Subject(s) - aerospace , bioengineering , communication, networking and broadcast technologies , components, circuits, devices and systems , computing and processing , engineered materials, dielectrics and plasmas , engineering profession , fields, waves and electromagnetics , general topics for engineers , geoscience , nuclear engineering , photonics and electrooptics , power, energy and industry applications , robotics and control systems , signal processing and analysis , transportation
A continuous increase in privacy attacks has caused the research and application of differential privacy (DP) to gradually increase. We can improve the efficiency of the DP model by Optimizing its parameters significantly. Inspired by the performance of various optimization methods for differential privacy, this paper proposes an improved RDP-AdaBound optimization method with bias correction, which is called “AdaBias”, to increase the performance of Rényi differential privacy (RDP). The bias correction is used to realize the learning rate and speed up the convergence by upper and lower bound functions. We evaluate our method on the three datasets by training two different privacy model. We further compare three traditional optimization algorithms, namely, RDP-SGD, RDP-Adagrad, and RDP-Adam. And we use AdaBias to verify the performance of privacy protection on the COVID-19 dataset. Experimental results show that the new variant better implements learning rate adjustment to accommodate updates of noisy gradients. As a result, it can achieve higher accuracy and lower losses with a lower privacy budget, thereby better protecting data privacy.