Scalable Algorithms for Deterministic Global Optimization With Parallel Architectures

复杂系统无处不在：从农业供应链、废水处理和公共供水系统，到用于住宅和工业建筑供暖、制冷和照明的能源/电力基础设施。脱碳过程工业，特别是因为它们涉及食品，能源和水，是特别和及时的重要性。工程师有一个不断的使命，即改善这些支持和改善社会的复杂系统的健康，安全和鲁棒性。然而，创新本质上增加了复杂性，因此，解决复杂和相互关联的挑战的努力，包括设计新系统和改进现有系统，在很大程度上依赖于基于计算建模，仿真和优化的方法。该提案旨在解决两个主要挑战：（1）计算优化方法的当前性能限制了其对简化，低复杂性问题的适用性，以及（2）大学工程课程在整个课程中通常缺乏连贯的计算思维活动。解决（1）将缓解当前的计算瓶颈，并扩大可以解决的复杂问题的规模和范围。Solving（2）不仅有助于培养下一代工程师的计算建模方法，还有助于提高他们解决问题的整体技能。本项目的研究目标是开发可扩展的确定性全局优化（DGO）算法和开源软件实现，通过利用替代的流计算架构进行并行化，以实现更高复杂性模型的解决方案，这些模型包括第一原理模型和涉及非线性（偏）微分和代数方程的机器学习元素。所提出的工作的意义在于解锁大规模并行计算性能的图形处理单元（GPU）的DGO与一个新的分支定界确定性搜索算法的发展。其结果将是在当前技术水平上的显著加速，这将使食品-能源-水（FEW）应用中出现的更大规模更高复杂性问题的解决方案成为可能。第一个主要的创新是一种方法，用于自动生成源代码表示的凸/凹松弛的非凸函数的优化配方，其次梯度，在任意域的兴趣。第二个主要创新是一个可扩展的GPU兼容的并行DGO算法和开源软件实现的非凸规划的保证解决方案。该项目将使拟议的研究与教育活动保持一致，旨在将多样化的学生群体转变为熟练的计算思想家。该项目将支持培训学生从优化环境中理解系统模型的复杂性，以更好地理解基于优化的方法的实用性。该项目将提供方法，工具和培训模块，以满足工程领域当前和未来的技术劳动力培训需求，这些领域将越来越依赖于优化创新。该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

Complex systems are everywhere: from agricultural supply chains, wastewater treatment and public water systems, to the energy/power infrastructure that heats, cools, and light residential and industrial buildings. Decarbonizing process industries, especially as they relate to food, energy, and water, is of particular and timely importance. Engineers have an ever-constant mission of improving the health, safety, and robustness of these complex systems that support and improve society. However, innovation inherently increases complexity and, therefore, the efforts to solve complex and interconnected challenges, which include designing new systems and improving existing systems, rely heavily on computational modeling, simulation, and optimization-based approaches. There are two major challenges that this proposal aims to address: (1) the current performance of computational optimization approaches limits their applicability to simplified, lower-complexity problems, and (2) university engineering programs often lack cohesive computational-thinking activities throughout their curricula. Solving (1) will alleviate the current computational bottlenecks and broaden the scale and scope of complex problems that can be solved. Solving (2) will not only help train the next generation of engineers on computational modeling approaches but improve their overall problem-solving skills.The research objective of this project is to develop scalable deterministic global optimization (DGO) algorithms and open-source software implementations by exploiting alternative stream computing architectures for parallelization, to enable the solution of higher complexity models that include first-principles models and machine learning elements involving nonlinear (partial) differential and algebraic equations. The significance of the proposed work lies in unlocking the massive parallel computing performance of graphical processing units (GPUs) for DGO with the development of a new branch-and-bound deterministic search algorithm. The result will be a significant speedup over the current state of the art, which will enable the solution of larger-scale higher-complexity problems that arise in food-energy-water (FEW) applications, among others. The first major innovation is a method for automatically generating source code representations of convex/concave relaxations of nonconvex functions in the optimization formulation, and subgradients thereof, on arbitrary domains of interest. The second major innovation is a scalable GPU-compatible parallel DGO algorithm and open-source software implementation for the guaranteed solution of nonconvex programs. This project will align the proposed research with educational activities aimed at transforming a diverse cohort of students into skilled computational thinkers. This project will support the training of students to understand the complexity of systems models from an optimization context to better understand the practicality of optimization-based approaches. This project will deliver methods, tools, and training modules to serve the immediate and future technology workforce training needs of engineering fields that will increasingly depend on optimization for innovation.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.