GOALI: Statistically Parsimonious Adaptive Dynamic Programming for Minimizing the Environmental Impact of Airport Deicing Activities

NSF建议0801802PI：Chen，VictoriaGOALI：统计节约型自适应动态规划，以最小化机场除冰活动对环境的影响这项研究的目的是使极高维、非平稳近似动态规划的计算高效的数值解成为可能。该项目的达拉斯-沃斯堡国际机场除冰活动应用涉及7000多个维度，而迄今为止解决的最大问题是陈博士的524个维度的空气质量应用。该方法从统计、优化和强化学习的角度开发了一种新颖而具有挑战性的集成，以创建高效的新混合算法。智能优点：该研究的统计观点在近似动态规划社区中是独一无二的，是简约的关键。该项目的集成方法将产生新的算法，用于探索状态和决策空间，这对流行的强化学习方法至关重要；同时进行自适应设计和建模，有利于更大的建模社区；以及统计模型的非凸优化，对一般全局优化有用。这种集成的成功可能会改变研究人员在近似动态规划中进行探索和建模的方式。广泛影响：这项研究很重要，因为它可以为复杂、不确定和动态的决策系统提供实用方法，包括环境政策、医疗保健和医药、能源分配和多样性、国土安全和减灾。目前的解决方案使用过度简化，通常会牺牲社会效益来满足经济限制，而这个项目试图通过智能和节俭的方法有效地表示真正的系统。作为一个重要的门户，机场必须解决涉及上述许多系统的问题，与机场的长期合作将产生有益于教育的激励应用程序，如论文、研讨会和课程材料。

NSF Proposal 0801802PI: Chen, VictoriaGOALI: Statistically Parsimonious Adaptive Dynamic Programming for Minimizing the Environmental Impact of Airport Deicing ActivitiesThe objective of this research is to enable computationally-efficient numerical solutions to extremely high-dimensional, nonstationary approximate dynamic programming. This project's Dallas-Fort Worth International Airport deicing activities application involves over 7000 dimensions, while the largest solved to-date is Dr. Chen's air quality application with 524 dimensions. The approach develops a novel and challenging integration of perspectives from statistics, optimization, and reinforcement learning to create efficient new hybrid algorithms.Intellectual Merit:This research's statistical perspective is unique within the approximate dynamic programming community and is the key to parsimony. This project's integrated approach will yield new algorithms for exploration of state and decision spaces, critical for the popular reinforcement learning approach; simultaneous adaptive design and modeling, beneficial to the larger modeling community; and nonconvex optimization of statistical models, useful for general global optimization. The success of this integration will potentially transform the way researchers conduct exploration and modeling in approximate dynamic programming.Broader Impacts:This research is important because it can yield practical methods for complex, uncertain, and dynamic decision-making systems, including environmental policy, health care and medicine, energy distribution and diversity, homeland security, and disaster mitigation. Current solutions use oversimplifications that typically compromise social benefits to satisfy economic constraints, while this project seeks to efficiently represent the true system via an intelligent and parsimonious approach. As a major gateway, the airport must address issues involving many of the above systems, and a long-term collaboration with the airport will yield motivating applications benefiting education, such as dissertations, seminars, and course material.