A novel augmented reality framework for enriching museum exhibits

增强现实（AR）是最热门的新兴技术之一，其中虚拟和真实的世界的组合可以为最终用户带来沉浸式和自然的体验。AR已在医疗成像、安全、娱乐、健身等领域得到应用。与SimentIT公司合作，我们将开发新技术，打破人们体验博物馆展品或类似物品的方式。具体来说，我们将研究：1）3D物体识别，其中快速准确地识别3D物体在移动的设备上的AR（例如，在博物馆展出的对象）将导致AR体验的快速实例化; 2）跟踪，在那里，我们将研究新的技术，以提高国家的最先进的同时定位和地图（SLAM）通过结合视觉数据的语义理解和从车载移动的惯性传感器获得的数据的多模态融合;以及3）云处理;其中智能客户端-服务器工作分配和高度并行处理将进一步提高AR应用的处理能力。总之，所提出的方法将产生用于创建移动的AR应用的鲁棒框架。拟议的研究将有助于定位加拿大作为一个领导者在多媒体技术在21世纪世纪。由此产生的对加拿大工业的技术转让将加强加拿大的全球竞争力，并对加拿大经济和社会产生积极影响。

Augmented Reality (AR) is one of the hottest emerging technologies, where the combination of virtual and real worlds can result in an immersive and natural experience for the end-user. AR has found its application in fields such as medical imaging, security, enterntainment, fitness, etc. Collaborating with SimentIT, Inc., we will develop new technologies that will disrupt the way people experience museum exhibits or the like of. Specifically, we will investigate : 1) 3D object recognition, where fast and accurate recognition of 3D objects (e.g. objects on display at museums) on mobile devices will result in quick instantiation of an AR experience; 2) tracking, where we will investigate novel techniques to improve the state-of-the-art in Simultaneous Localization and Mapping (SLAM) through incorporation of semantic understanding of the visual data and multimodal fusion of data obtained from on-board mobile inertial sensors; and 3) cloud processing; where intelligent client-server work distribution and highly parallel processing will further improve the processing capabilities of an AR application. Together, the proposed methods will result in a robust framework for creating mobile AR applications. The proposed research will help to position Canada as a leader in multimedia technologies in the 21st century. The resultant technology transfer to Canadian industry will strengthen Canada's global competitiveness and create positive impacts to Canadian economy and society.