Collaborative Research: SaTC: CORE: Small: Measuring, Validating and Improving upon App-Based Privacy Nutrition Labels

智能手机在人们使用时收集了大量的个人数据，当智能手机应用程序以人们意想不到的方式使用或共享数据时，这可能会导致侵犯隐私。现有的基于文本的隐私政策很难阅读和理解，这使得人们很难理解移动应用程序将如何处理他们的数据。这导致各大应用商店要求应用程序使用标准化的“隐私标签”--类似于营养标签--以帮助人们对他们使用的应用程序做出明智的选择；然而，目前尚不清楚这些标签在现实世界中的效果如何。这个项目将通过研究隐私标签对三个主要群体的作用来解决这个问题：应用程序开发人员，他们必须为他们的应用程序选择正确的标签；应用程序商店管理员，他们为标签制定政策和标准；以及最终用户，他们必须使用它们来做出隐私决策。该团队还将分析移动应用程序，看看它们遵守隐私标签做出的承诺的情况如何，以及人们对隐私标签的理解和应用程序对隐私标签的遵守程度如何随着时间的推移而变化。这项工作将使监管机构和使用移动应用程序的人更好地理解、设计和使用隐私标签。为了解决这些问题，该项目将采用混合方法。为了研究最终用户，研究团队将进行迭代的可用性测试和纵向理解研究，以衡量对这些新的隐私标签的理解，以及它如何随着时间的推移而变化。该团队还将使用多元回归分析的析因小插曲来确定现有和假设的隐私标签设计的因素，这些因素可能会影响用户关于安装、使用和授予应用程序权限的决策。为了研究开发人员和平台，该团队将使用“隐私标签观察站”进行定量测量研究，该观察站将定期收集两个应用程序及其隐私标签的多个版本，使用对应用程序的动态软件分析来确定它们对私人信息的使用。这将有助于回答这样的问题：随着开发人员对隐私标签的熟悉，隐私标签是否会随着时间的推移变得更加准确，以及应用生态系统对监管或公司政策变化和执法行动等事件的反应。该项目的主要成果将是实证数据，内容包括这些新的隐私工具是否有效，它们可能如何以及为什么会让应用程序开发人员和消费者都失望，以及平台如何改进设计以使其更有效。这将包括关于隐私标签当前和历史使用的公共数据集，以及改善隐私标签和移动应用隐私状态的设计模式和政策建议。该奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

Smartphones collect a large amount of personal data as people use them, which can cause privacy violations when smartphone applications (“apps”) use or share the data in ways people don’t expect. Existing text-based privacy policies are hard to read and make sense of, making it hard for people to understand what a mobile app will do with their data. This has led major app stores to require apps to use standardized “privacy labels”—akin to nutrition labels—to help people make informed choices about the apps they use; however, it is unclear how well these labels work in the real world. This project will attack this question by studying how privacy labels work for three main groups: app developers who must select correct labels for their apps; app store administrators that create the policies and standards for the labels; and end users who must use them to make privacy decisions. The team will also analyze mobile apps to see how well they adhere to the promises made by their privacy labels, and how both people’s understandings of privacy labels and apps’ adherence to them changes over time. Together the work will lead to better understanding, design, and use of privacy labels for both regulators and people who use mobile apps. To address these questions, the project will apply a mixed-methods approach. For studying end users, the research team will perform iterative usability testing and longitudinal comprehension studies to gauge understanding of these new privacy labels and how it changes over time. The team will also use factorial vignettes analyzed by multivariate regressions to identify factors of both existing and hypothetical privacy label designs that might impact user decision making around installing, using, and granting permissions to apps. For studying developers and platforms, the team will conduct quantitative measurement studies using a “privacy label observatory” that will periodically collect a number of versions of both apps and their privacy labels, using dynamic software analysis of the apps to determine their use of private information. This will help answer questions about whether privacy labels become more accurate over time as developers become more familiar with them, as well as how the app ecosystem reacts to events like regulatory or company policy changes and enforcement actions. The primary outcomes of this project will be empirical data on whether these new privacy tools are working, how and why they might be failing both app developers and consumers alike, and how platforms can improve their design to make them more effective. This will include public datasets about current and historical usage of privacy labels, as well as design patterns and policy recommendations for improving the state of privacy labels and mobile app privacy.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.