A unifying framework for integrating domain knowledge into machine learning algorithms for multidisciplinary industrial applications

尽管监督学习方法在预测分析中表现出上级性能，但迄今为止，它们仅从标记数据中学习。人在这一过程中的作用仅限于“贴标签者”，专家的知识没有得到充分利用。这项研究设想开发一个总体框架，以代表和整合专家的意见到学习系统，并在可能的情况下，转移他们的宝贵知识，在现实生活中的应用决策过程。在接下来的五年里，我们计划开发一个新的统一框架，以有效的方式利用人类的建议来促进机器学习（ML）算法，我们打算为工业应用开发新的人工指导学习解决方案。拟议研究的长期目标包括深入研究和开发新型、自动化、高效的实时ML算法，这些算法能够通过在监督和非监督方法中利用领域知识来提供工业问题的解决方案。 创新：将开发将专家知识纳入嘈杂的结构化领域的ML算法的新方法，以加速学习有效模型，到目前为止，人类仅被用作标记器。我们计划开发一个自然的框架，允许专家将他们的知识编码为关于该领域的一般建议和关于特定示例的具体建议。拟议的框架将提供一般性的捕获不同类型的建议，通过优惠，成本函数为基础，定性约束，以及特权信息。实际应用：在实践中，这项研究有可能对以下领域产生重大影响：（i）医学成像和法医学等领域的工业应用，这些领域可以受益于图像分割和配准技术，并且可以通过有效的方式使用深度学习来利用人类的建议;（ii）焊接行业，通过加速焊接序列优化和减少结构变形;（iii）制造业，通过自动化操作，例如钉孔插入任务;以及（iv）机器人工业，通过提供更高自由度的机器人逆运动学问题的解决方案。高素质人才培训：拟议的研究计划旨在培养学生并培养具有ML和人工智能（AI）独特专业知识的数据科学家，使他们成为ML，AI和计算机视觉领域的世界级专家。

Though supervised learning methods demonstrate superior performance in predictive analytics, to date, they learn only from labeled data. The role of human beings in the process has been restricted to "mere labeler," and the knowledge of experts is not being fully utilized. This research envisages the development of a general framework to represent and integrate experts' opinions into learning systems, and, if possible, to transfer their invaluable knowledge for decision-making processes in real-life applications. Over the next five years, we plan to work on developing a novel unifying framework for utilizing human advice in an efficient manner to facilitate machine learning (ML) algorithms and we intend to develop novel solutions to human-guided learning for industrial applications. The long-term goals of the proposed research include deep investigation and development of novel, automated, efficient real-time ML algorithms capable of providing solutions to industrial problems by exploiting domain knowledge in both supervised and unsupervised methods. Innovation: Novel approaches for incorporating experts' knowledge into ML algorithms in noisy, structured domains will be developed to accelerate learning effective models in which, so far, humans have been merely used as labelers. We plan to develop a natural framework which will allow experts to encode their knowledge, both as general advice about the domain and as specific advice about particular examples. The proposed framework will offer generality by capturing different types of advice through preferential, cost function-based, qualitative constraints, as well as privileged information. Practical Applications: In practice, this research has the potential to significantly impact: (i)industrial applications in fields such as medical imaging and forensics, which can benefit from image segmentation and registration techniques and in which human advice can be exploited by using deep learning in an effective manner; (ii)the welding industry, by accelerating welding sequence optimization and reducing structural deformations; (iii)the manufacturing industry, by automating operations such as peg-hole insertion tasks; and (iv)the robotics industry, by providing solutions to robot inverse kinematics problems for higher degrees of freedom. Highly Qualified Personnel Training: The proposed research program intends to train students and produce data scientists with unique expertise in ML and artificial intelligence (AI), which will enable them to be world-class experts in the fields of ML, AI, and computer vision.