Computational and Statistical Approaches to Regression Problems in the Presence of Linkage Errors

该研究项目将开发计算工具，以尽量减少不匹配记录对后续数据分析的影响。为了充分解决感兴趣的研究问题，通常需要将多个数据源结合起来。记录链接是在属于同一实体的多个数据源中识别匹配记录的过程。记录链接和计算的进步为创建丰富的数据产品提供了大量机会。与此同时，高数据量、数据质量问题以及对数据匿名化和隐私的需求增加了不匹配错误的可能性，这可能会严重破坏后续分析，进而导致错误的结论。本项目开发的工具将通过提高大量下游统计分析的完整性，帮助利用关联数据固有的潜力。该项目产生的所有技术发展将作为开源软件发布。研究结果将应用于联邦统计机构感兴趣的大规模调查数据分析和数据联系。研究人员将把这个项目的结果整合到他们的教育活动中，并将提供动手教程，培训学生、专业人员和科学家分析关联数据。该项目还将为研究生提供研究机会和支持。该研究项目将建立在高维统计和优化技术的基础上，开发一套调整和纠正错配误差以及不确定性量化的方法。研究人员将处理各种各样的问题，这些问题的解决方案将需要统计、算法和与具体实际数据应用相关的实际方面的适当平衡。这些方法的统计特性将在理论、模拟研究和各种当代关联数据问题中得到严格研究。要研究的后关联分析场景包括现代半参数回归和常见的无监督多变量分析方法，这些方法在关联数据分析的背景下几乎没有研究过。最优传输理论的进步将被用来纠正错配误差，从而提高数据质量。该奖项由MMS项目和联邦统计机构联盟支持。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

This research project will develop computational tools for minimizing the impact of mismatched records on subsequent data analysis. To adequately address a research question of interest, multiple data sources often need to be combined. Record linkage is the process of identifying matched records in multiple data sources pertaining to the same entity. Advances in record linkage and computation yield substantial opportunities for creating rich data products. At the same time, high data volumes, data quality issues, and the need for data anonymization and privacy increase the potential for mismatch error that can considerably disrupt subsequent analysis and in turn lead to incorrect conclusions. The tools to be developed in this project will help leverage the potential inherent in linked data by improving the integrity of a significant range of downstream statistical analyses. All technical developments resulting from this project will be released as open-source software. Research results will be applied to large-scale survey data analysis and data linkages of interest to the Federal statistical agencies. The investigators will integrate the results of this project into their educational activities and will offer hands-on tutorials to train students, professionals, and scientists in the analysis of linked data. The project also will provide research opportunities and support for graduate students.This research project will build on techniques in high-dimensional statistics and optimization to develop a suite of methods adjusting for and correcting mismatch error along with uncertainty quantification. The investigators will tackle a variety of problems whose solutions will require an appropriate balance of statistical, algorithmic, and practical aspects pertaining to specific real data applications. The statistical properties of the methods will be rigorously studied theoretically, in simulation studies, and in various contemporary linked data problems. Post-linkage analytic scenarios to be investigated include modern semiparametric regression and common unsupervised multivariate analysis methods that have scarcely been studied in the context of linked data analysis. Advances in optimal transport theory will be leveraged to correct mismatch error and hence improve data quality. This award is supported by the MMS Program and a consortium of Federal statistical agencies.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.