Beyond Deep Associative learning

超越深度联想学习

• 批准号: RGPIN-2019-04824
• 负责人: Ghodsi, Ali
• 金额: $ 1.68万
• 依托单位: University of Waterloo
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=765759
• 关键词: Beyond; Deep; Associative; learning

Mathematicians and scientists have been pursuing Artificial Intelligence (AI) for over sixty years. A significant discipline within AI is machine learning, where a system is trained through exposure to enormous amounts of data to learn new situations. Applications of machine learning are now commonplace - think of personalized searches on Google or Amazon, voice recognition systems, or digital assistants such as Cortana and Siri. These applications are associational - they look for consistent relationships between variables. While they are impressive, they still lack a human's ability to use prior knowledge and intuition and the ability to examine a new situation and imagine alternative outcomes. Further development of AI could plateau without a breakthrough into more human-like learning. The goal of this proposal is to begin the process of training a machine to learn as a human child learns, thereby significantly advancing the field of AI. Humans learn through repeated exposure to similar but slightly different events. For a machine, we believe the same result can be accomplished through a new generation of deep neural networks - where a machine can be trained through repeated exposure to similar but somewhat different data sets to learn and anticipate outcomes. My team and I will work towards this goal and attempt to move AI beyond associational models and towards human-like reasoning. There are three specific ingredients which will be the focus of our research: first, we will work to train a machine with deep learning of basic physics and see if it can apply this training across a wide variety of scenarios, approaching what would be common sense in a human; second, we will attempt to train a machine in cause-and-effect relationships which should allow it to predict alternative outcomes, the way a human considers counterfactuality - the innate human ability to imagine an infinite number of `what if?' scenarios; third, we will explore the possibilities of conditioning the machine to use its training outside of specific scenarios into completely new fields, the way a human can use experience and imagination when encountering new situations. There are many areas of work associated with this project and we will use two applications to illustrate the motivation driving this research and to validate our algorithms. These two applications are of significant importance by themselves and address a challenging industrial problem (autonomous vehicles) and an important and very influential bioinformatic open question (peptide sequencing).

六十多年来，数学家和科学家一直在追求人工智能(AI)。人工智能中的一个重要学科是机器学习，通过接触大量数据来训练系统以学习新情况。机器学习的应用现在很常见--想想谷歌或亚马逊的个性化搜索、语音识别系统，或者Cortana和Siri等数字助理。这些应用程序是关联的--它们寻找变量之间的一致关系。尽管它们令人印象深刻，但它们仍然缺乏人类利用先验知识和直觉的能力，以及检查新情况和想象替代结果的能力。人工智能的进一步发展可能会停滞不前，而不会突破到更像人类的学习。这项提议的目标是开始训练机器学习的过程，就像人类儿童学习一样，从而显著推动人工智能领域的发展。人类通过反复接触相似但略有不同的事件来学习。对于一台机器，我们相信，通过新一代深度神经网络可以实现同样的结果--通过反复接触类似但略有不同的数据集，机器可以被训练，以学习和预测结果。我和我的团队将朝着这个目标努力，并试图将人工智能超越联想模型，转向类似人类的推理。有三个具体的因素将是我们研究的重点：首先，我们将致力于训练一台深入学习基础物理的机器，看看它是否可以将这种训练应用于各种场景，接近人类的常识；第二，我们将尝试训练一台机器，使其能够预测替代结果，就像人类思考反现实的方式--人类与生俱来的能力，想象无限多的假设？第三，我们将探索将机器的训练应用于全新领域的可能性，就像人类在遇到新情况时使用经验和想象力的方式一样。这个项目涉及许多领域，我们将使用两个应用程序来说明推动这项研究的动机，并验证我们的算法。这两个应用本身具有重要意义，并解决了一个具有挑战性的工业问题(自动驾驶汽车)和一个重要的、非常有影响力的生物信息学开放问题(肽序列)。