Interpolation Methods in Statistics and Machine Learning

统计学和机器学习课程中教授的关键原则之一是数据插值（或数据记忆）不可避免地导致过拟合和较差的预测性能。然而，大多数现代大规模模型，包括过度参数化的神经网络，通常都是为了在训练数据上实现零误差而进行优化的。该项目的研究目标是挑战普遍的智慧，并为训练数据的插值方法提供理论和算法基础。该项目将侧重于插值方法的统计和计算方面。将推导插值制度下回归和分类方法的一致性和有限样本界限，并将开发插值规则的信息论极限。该项目还将侧重于插值的计算方面。PI旨在揭示具有完美拟合数据能力的过度参数化模型的相对优点和缺点。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

One of the key tenets taught in courses on Statistics and Machine Learning is that data interpolation (or, data memorization) inevitably leads to overfitting and poor prediction performance. Yet, most of the modern large-scale models, including over-parametrized neural networks, are routinely optimized to achieve zero error on training data. The research objective of this project is to challenge the common wisdom and develop theoretical and algorithmic foundations for methods that interpolate the training data. The project will focus on the statistical and computational aspects of interpolation methods. Consistency and finite-sample bounds will be derived for regression and classification methods in the interpolation regime, and information-theoretic limits of interpolating rules will be developed. The project will also focus on the computational aspects of interpolation. The PI aims to shed light on the relative advantages and disadvantages of over-parametrized models that have capacity to perfectly fit the data.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.