Collaborative Research: SaTC: CORE: Medium: Private Model Personalization

现代机器学习的成功给隐私带来了严峻的挑战：现在广泛记录的是，目前使用的模型以令人惊讶的方式对个人输入进行编码。了解如何检测这种记忆，以及避免这种记忆的训练方法，是当前研究的一个主要课题。然而，之前的研究主要集中在机器学习的批处理模型上，其中训练数据都来自单一的底层人群。该项目旨在了解当来自许多人群的训练数据被汇集以利用跨人群共享的结构时所产生的隐私风险。例如，可以将许多个人的照片集中起来，以训练更好的人脸识别算法（即使每个人对不同的人脸集感兴趣）。这些设置被称为“模型个性化”、“多任务学习”或“元学习”，它们提供了一个强大的框架，可以将来自遥远、不同数据源的见解结合起来。然而，他们的权力提出了一个根本性的问题，即联合分析的结果在多大程度上侵犯了个人用户数据的隐私。该项目既着眼于对隐私的攻击从预测结果或模型中提取个人或个人级别信息的方法，也着眼于基于现在标准的最先进框架差异隐私的缓解策略。该项目涉及理论分析和现实世界的实验。它将为这些复杂设置的训练算法的开发提供信息，并为公司和其他研究团体提供工具。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Modern machine learning's success has brought with it a serious challenge for privacy: it is now widely documented that the models currently in use encode individual inputs in surprising ways. Understanding how to detect such memorization, and training methods that avoid it, is a major topic of current research. However, prior investigations have focused mostly on the batch model of machine learning, in which training data are all drawn from a single underlying population.This project seeks to understand the privacy risks that arise when the training data from many populations are pooled in order to take advantage of structure that is shared across populations. For example, many individuals’ photos could be pooled to train better face recognition algorithms (even though each person is interested in a different set of faces). Such settings—called “model personalization”, “multitask learning” or “meta-learning”—provide a powerful framework for combining insights from far-flung, disparate data sources. However, their power raises fundamental questions about the extent to which the results of joint analysis violate the privacy of individual users' data. The project looks both at attacks on privacy—methods for extracting individual-level or dataset-level information from the resulting predictions or models—as well as mitigation strategies based on the now-standard, state-of-the-art framework, differential privacy. The project involves both theoretical analysis and real-world experimentation. It will inform the development of training algorithms for these complex settings and provide tools for use by companies and other research groups. This impact will be facilitated by the project team's existing collaborations with industry researchers.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.