Ontologies for the Physical Turing Test

点击翻译按钮获取中文摘要

The Turing Test was originally proposed as a way of evaluating how well a software system represents human intelligence, based on natural language conversations.  It has recently been recognized that a different approach is needed that incorporates capabilities required for general intelligence. The Visual Turing Test extends the Turing Test to include perception -- it specifies an open domain task of question answering based on corpora of images depicting real-world scenes.  The Physical Turing Test extends this further by specifying questions that require the integration of perception, reasoning, and action. To capture the commonsense knowledge required to perform the Physical Turing Test, existing approaches to computer vision and robotics have begun to include simple knowledge representation schemes such as WordNet.  However, such approaches cannot fully specify the intended semantics of the terminology,nor can they support automated reasoning.  What is needed is an ontology, that is, a computer interpretable specification that is used by an agent, application, or other information resource to declare what terms it uses, and what the terms mean. In this project, we will design new ontologies in first-order logic that can represent objects in the physical world, the activities in which these objects can possibly participate, and how to recognize these objects and the spatial relationships between them within images. (We will refer to these as the PRAxIS Ontologies, for Perception, Reasoning, and Action across Intelligent Systems) These ontologies will be integrated to support reasoning about physical objects, their behaviours (e.g. the ways in which they can change), and their interactions (e.g.manipulation of solid physical objects). Ontologies for perception will be tested using question-answering based on real-world images, such as detecting and localizing instances of objects and relationships among the objects in a scene. Ontologies for action will be tested through the representation of instructions for assembling, using, and maintaining physical objects, including devices and everyday objects such as furniture To support the question-answering for the Physical Turing Test, this project will also investigate reasoning (theorem proving and constraint satisfaction) with first-order ontologies.