RI: Medium: Collaborative Research: Physically Grounded Object Recognition

点击翻译按钮获取中文摘要

Proposal Title: RI: Medium: Collaborative Research: Physically Grounded ObjectRecognitionInstitution: Carnegie-Mellon UniversityAbstract Date: 05/05/09"This award is funded under the American Recovery and Reinvestment Act of 2009(Public Law 111-5)."Although the world is very much three-dimensional, most of today's approaches tovisual object recognition essentially reduce the problem to one of 2D patternclassification, where rectangular image patches are independently compared to storedtemplates to produce isolated object labels within the image. This project aims toaccount for the three-dimensional nature of the real world by exploring qualitativegeometric reasoning in terms of 3D spatial relationships between scene components,category-level object models, and global scene understanding.The project is organized around two major research areas. Qualitative 3D sceneparsing: A central part of our effort will be to develop qualitative 3D models of the scenethat describe the depicted objects and surfaces and their physical relations. Groundingobjects in the scene: We integrate the geometric representation of the scene and thecorresponding 3D spatial relations with the object recognition process by (1) inferringthe set of likely object identities based on 3D relations among scene components; (2)predicting the most likely object locations from the scene layout; and (3) using theocclusion relations and depth ordering to predict the parts of objects that may be visiblein the scene.The project is anticipated to result in major advances in 3D scene understanding fromphotographs, a critical enabling technology for a wide range of applications includingautonomous systems, health care, human-computer interaction, assistive technology,image retrieval, industrial and personal robotics, manufacturing, scientific imageanalysis, surveillance and security, and transportation.NATIONAL SCIENCE FOUNDATIONProposal AbstractProposal:0905402 PI Name:Hebert, MartialPrinted from eJacket: 05/06/09 Page 1 of 1