Automated Intelligent Decision Making in Domains With Large Action Spaces

人工智能(AI)研究涉及开发新技术，以便在各种更加复杂的现实世界问题中做出智能决策。这个自动化的决策过程需要对给定域进行建模，然后对给定场景中可能发生的未来操作进行推理，最终决定采取哪种操作，同时考虑到某个目标。人工智能研究人员面临的主要挑战之一是如何在一个未来可能出现的场景和行动的数量如此之多的领域中选择要采取的行动，以至于无法探索所有这些场景和行动。据说，这些领域有很大的行动空间--其中许多领域需要在几分之一秒内做出实时决定，这个问题很快就变得难以解决。*这项建议的主要目标是：更好地了解具有大行动空间的领域的性质，利用这一知识开发解决以前过于复杂的领域的新技术，并应用这些新技术来解决现实世界的问题。我未来五年的具体目标是与HQP一起进行研究，探索最初有希望的技术，从而完成4-5名硕士学生(每名2年)和2名博士生(每名4年)的毕业论文。这些短期目标的完成将为长期目标铺平道路，这些目标包括开发世界级的人工智能系统，以及与加拿大科技行业的合作。近年来，越来越多的人工智能研究人员将计算机游戏和模拟作为开发和测试新人工智能技术的试验台。由于严格的实时计算限制，复杂的规则，以及模拟现实生活场景的能力，计算机游戏能够在更方便的受控环境中模拟现实世界问题的性质。我计划用电脑游戏作为人工智能尖端技术的试验台。通过严格的实验和数据分析，我希望在启发式搜索、状态抽象、层次分解和降维等领域开发新技术，所有这些都是解决这些复杂领域问题所需的关键方法。*人工智能正迅速成为我们日常生活中越来越多的一部分，推动电子商务、自主机器人、医疗保健和计算机游戏等行业的发展。正如工业革命创造了机器来完成我们的重担一样，人工智能革命也在创造机器来完成我们的繁重思考。人工智能预计将在未来几年成为最重要的技术领域之一，这项拟议研究的成功将导致人工智能的进步，这可以显著增加加拿大经济的价值，并提高所有加拿大人的整体生活质量。

Artificial Intelligence (AI) research involves the development of new techniques for making intelligent decisions in a wide variety of ever more complex real-world problems. This process of automated decision making requires modelling a given domain, and then reasoning about future actions which are possible from a given scenario, eventually deciding on which action to take with some goal in mind. One of the major challenges faced by AI researchers is how to choose an action to take in a domain where the number of possible future scenarios and actions is so large that there is no way to explore them all. These domains are said to have large action spaces – and with many of them requiring real-time decisions to be made in fractions of a second, the problem quickly becomes intractable. ******The main objectives of this proposal are: to better understand the nature of domains with large action spaces, to use this knowledge to develop novel techniques for tackling domains which were previously too complex, and to apply these new techniques to solve real-world problems. My specific objective for the next five years is to conduct research with HQP to investigate initially promising techniques, resulting in the completed theses for 4-5 MSc students (2 years each), and 2 PhD students (4 years each). The completion of these short-term objectives will pave the way for long term goals which include developing world-class AI systems, and collaboration with the Canadian technology industry.******In recent years, an increasing number of AI researchers have been using computer games and simulations as test-beds for developing and testing new AI techniques. With harsh real-time computational constraints, complex rules, and an ability to simulate real-life scenarios, computer games are able to model the properties of real-world problems while being simulated in a more convenient controlled environment. I plan to use computer games as a test-bed for state-of-the-art techniques in AI. Through rigorous experimentation and data analysis, I hope to develop novel techniques in the areas of heuristic search, state abstraction, hierarchical decompositions, and dimensionality reduction, all of which are key methods required for solving problems in these complex domains.******AI is quickly becoming an increasing part of our daily lives, powering technologies which advance industries such as e-commerce, autonomous robotics, health care, and computer games. As the industrial revolution created machines to do our heavy lifting, the AI revolution is creating machines to do our heavy thinking. Artificial intelligence is predicted to become one of the most important technology sectors in the next few years, and success in this proposed research will lead to advances in AI which can significantly add value to the Canadian economy, and improve overall quality of life for all Canadians.