Collaborative Research: Globally Optimal Neural Computing: Algorithms and Applications

0098770 Sahinidi这笔赠款支持全球优化社区的一名成员(Nick Sahinidis)和神经计算和优化专家(Theodore TraFalis)之间的合作，以开发新的神经网络训练算法并展示其在解决大规模学习问题方面的好处。最近，随着工程师和科学家广泛采用神经计算来寻求对复杂现象和系统的更深入了解，神经网络在技术的各个方面的应用都有所升级。为特定应用找到可能的最佳神经网络需要以最大限度地减少学习错误的方式选择网络参数。即使对于简单的学习问题，误差函数也存在大量的局部极小(孤立谷)。尽管人们对神经网络投入了大量的注意力，但目前还没有一种有效的方法可以确定误差函数的全局最小值。目前的方法，如反向传播方法和随机搜索方法，可能会陷入与较大的学习误差和次优神经网络相对应的局部极小值。这可能会导致不正确的推断，并摧毁决策者。全球最优神经计算拥有一种使能技术的前景，可以显著改善许多不同应用领域的学习。拟议的研究结果将在其广泛分布的全球优化软件包中实施，并将向研究界提供。

0098770SahinidisThis grant supports a collaboration between a member of the global optimization community (Nick Sahinidis) and an expert in neural computation and optimization (Theodore Trafalis) to develop novel neural network training algorithms and demonstrate their benefits in solving large-scale learning) problems.The application of neural networks to all aspects of technology has escalated recently as engineers and scientists have widely embraced neural computing in their quest for deeper understanding of complex phenomena and systems.Finding the best possible neural network for a particular application requires choosing the network parameters in a way that minimizes learning errors. Even for simple learning problems, the error function possesses a large number of local minima (isolated valleys). Despite the enormous amount of attention devoted to neural networks, there is currently no efficient method that can identify with certainty time global minimum of the error function. Current approaches, such as back-propagation and stochastic search methods, may get trapped at local minima corresponding to large learning errors and suboptimal neural networks. This may lead to incorrect inferences and devastate decision makers.Globally optimal neural computing holds the promise of an enabling technology that could significantly improve learning in many diverse application domains. The results of the proposed research will be implemented in the their widely distributed global optimization software package and will be made available to the research community.