Privacy Preserving synthesized data releasing via generative adversarial networks

隐私保护通过生成性对抗网络发布合成数据*最近发生的Facebook隐私丑闻涉及一家总部位于伦敦的数据挖掘公司滥用数千万用户的Facebook信息，再次突显了收集、存储和使用敏感数据进行数据分析时的隐私问题。传统的数据清理技术通过屏蔽真实数据中的敏感信息并释放屏蔽的版本来解决隐私问题。这种方法对什么是敏感信息以及如何使用数据做出了某些假设。通常这些信息不可用，因此需要过度的数据清理，这会破坏潜在分析的数据效用。这项研究的目的是探索通过保留真实数据的分布特征来发布由真实数据生成的合成数据的替代方案，而不是发布实际个人的记录。关键是如何保持分布特征，以及如何确保这样做不会泄露有关个人的敏感信息。*生成性对抗网络(GANS)在机器学习和深度神经网络中的最新发展为解决上述问题开辟了新的可能性。GANS是一个由两个神经网络组成的系统，它们在零和博弈框架下相互竞争。生成网络学习从潜在空间映射到感兴趣的特定数据分布，而区分网络区分来自真实数据分布的实例和由生成网络产生的候选。这两个网络都改进了它们的方法，直到合成的实例与真实的实例无法区分，即保留了真实数据的分布特征。为了解决隐私问题，以前的工作主要是从图像生成的角度，在Gans的训练中添加随机噪声来扰动随机梯度下降过程中的梯度。由于扰动梯度对收敛速度和解的效用有不利影响，因此由于实用性差，只评估了弱隐私设置。这项拟议的研究将调查添加噪音的替代方法，以更好地保护隐私和效用，并在广泛的领域评估数据效用。我们特别感兴趣的一个应用是向研究人员发布医疗保健数据，这要归功于我们可以获得该领域的真实数据和专业知识。这项研究的意义在于，数据持有者不必关心数据隐私，因为没有真实数据被发布，发布的数据满足强大的隐私保障；另一方面，数据分析师将得到几乎相同的结果，就像分析真实数据一样。这项工作将有助于保护隐私的做法，并鼓励数据共享，以利于数据分析。*****

Privacy Preserving synthesized data releasing via generative adversarial networks******The recent Facebook privacy scandal involving a London-based data-mining firm on misusing Facebook information of tens of millions of users highlights again the privacy concern over collecting, storing, and using sensitive data for data analysis. The traditional data sanitization technique addresses privacy concerns by masking sensitive information in true data and releasing the masked version. This approach makes certain assumptions on what is sensitive information and how the data will be used. Often these information are not available, so excessive data sanitization is necessary, which destroys data utility for potential analyses. The objective of this proposed research is to investigate the alternative of releasing synthesized data generated from true data by preserving the distributional characteristics of true data, instead of releasing actual individuals' records. The key is how to preserve distributional characteristics and how to ensure that doing so does not disclose sensitive information about individuals. ******The recent development of Generative Adversarial Networks (GANs) in machine learning and deep neural networks opens up new possibilities to address the above problem. GANs are a system of two neural networks contesting with each other in a zero-sum game framework. The generative network learns to map from a latent space to a particular data distribution of interest, while the discriminative network discriminates between instances from the true data distribution and candidates produced by the generative network. Both networks improve their methods until the synthesized instances are indistinguishable from the genuine ones, i.e., preserve the distributional characteristics of true data. To address privacy concerns, previous works, mainly from image generation, added random noises to perturb the gradient during stochastic gradient descent in the training of GANs. Since the perturbed gradient adversely affects the convergence rate and the utility of solutions, only weak privacy settings were evaluated because of poor utility. The proposed research will investigate alternatives ways of adding noises that could better preserve both privacy and utility, and evaluate data utility in a broad range of domains. One application of special interests to us is releasing medical and healthcare data to researchers, thanks to our access to true data and expertise in this domain. The significance of this research is that the data holder does not have to be concerned with data privacy because no true data is released and the released data meets a strong privacy guarantee; on the other hand, the data analyst will get nearly the same result as if true data were analyzed. This work will contribute to the practice of privacy preservation and the encouragement of data sharing for the benefits of data analysis. *****