3D object recognition and tracking from live cameras

点击翻译按钮获取中文摘要

The main objective of this collaborative research project is to identify and validate new modalities for users to interact with software systems. More specifically, using an object recognition component, users will be able to interact with a software product by using a recognized 3D object. The objective is to be able to extract a representative and compact model from a given 3D object. This model will be composed of distinct features that must then be matched to the ones extracted from an incoming video frames. Once a match has been established, the object pose then has to be inferred. The challenge here is to be able to perform robust model matching at frame rate such to create a seamless interactive experience. The model building step must also be simple such that non-expert users can add new objects to the system in an easy way.