Collaborative Research: Using Computer Vision to Measure Neighborhood Variables Affecting Health

该项目将开发一种自动化方法，利用计算机科学的进步，大规模地系统地观察和记录邻里环境的物理条件。社区环境在塑造个人和社区的健康方面发挥着重要作用，因此导致了美国的不平等。过去的研究表明，社区中存在的身体障碍、维护不善的财产和空地会对身心健康产生负面影响，吸引更多的犯罪和混乱，并导致社区投资减少。这项研究产生的措施将有助于检查这些过程，并为科学研究界提供强大的资源。通过允许政策制定者、从业者和公众跟踪社区进展并确定改进目标，它们也将带来更广泛的益处。该项目利用谷歌街景图像？最大的公共街道视觉外观纵向数据集？会使用亚马逊吗？土耳其机械？一个众包平台？以及现有的实地调查数据，以确定物理紊乱和维护的指标，如垃圾和破旧的建筑，这些数据来自波士顿、底特律和洛杉矶三个不同城市的街道样本。这些数据将用于训练一种算法，该算法利用了机器学习和计算机视觉方面的最新进展。识别特征和措施的方法的可靠性和有效性将在整个过程的每个步骤中进行测试。由此产生的社区物质条件的纵向测量将与在三个城市中每个城市进行的纵向健康调查相联系，以分析社区物质条件与健康之间的关系。此外，新措施将作为一个公开的数据库发布，该数据库将对多个城市的实际社区状况进行纵向测量。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

This project will develop an automated method, using advances in computer science, to observe and record systematically the physical conditions of neighborhood environments at a large-scale. Neighborhood environments play a significant role in shaping the health of individuals and communities, consequently contributing to inequality in the U.S. Past research suggests that the presence of physical disorder, poorly maintained properties, and vacant lots in neighborhoods can negatively affect physical and mental health, attract more crime and disorder, and lead to neighborhood disinvestment. The measures resulting from this study will facilitate examination of these processes and provide a powerful resource for the scientific research community. They will be more broadly beneficial as well by allowing policymakers, practitioners, and the public to track neighborhood progress and target improvements.The project takes advantage of Google Street View imagery?the largest publicly available longitudinal dataset of visual appearance of street blocks?and will use Amazon?s Mechanical Turk? a crowdsourcing platform?and existing field survey data to identify indicators of physical disorder and maintenance, such as trash and blighted buildings, on a sample of street segments across three distinct cities: Boston, Detroit, and Los Angeles. These data will be used to train an algorithm that draws on recent advances in machine learning and computer vision. Reliability and validity of the method for identifying characteristics and measures will be tested throughout each step of the process. The resulting longitudinal measures of the physical conditions of neighborhoods will be linked to longitudinal health surveys conducted in each of the three cities to analyze the relationship between physical neighborhood conditions and health. In addition, the new measures will be released as a publicly available database of longitudinal measures of physical neighborhood conditions across multiple cities.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.