An optimized cloud-based mobile augmented reality system for marketing and advertising

增强现实（AR）是一种直接或间接的物理真实世界环境的实时视图，其元素由计算机生成的内容（如文本，声音，视频或动画）增强。AR营销和广告应用可以为产品本身增加价值，无论是以增强的产品形式还是以更具吸引力的观众体验的形式。 与SimentIT，Inc.合作，我们将在基于云的移动的AR系统中开发新技术，用于营销和广告。具体来说，我们将研究三个子项目：1）目标识别，首先利用角点特征和超像素建立语义词袋模型，然后应用分层条件随机场模型进行目标识别; 2）跟踪，首先提出了一种基于同步定位与地图构建（SLAM）的实时跟踪方案，然后采用基于核熵分量分析的多模态信息融合来提高跟踪性能; 3）游戏流，其中我们提出了一种优先交付方案，通过为每个3D对象最佳分配比特率来最大化场景质量，以及可伸缩对等（P2P）几何流传输方案，以向异构用户提供不同的回放质量。 所提出的方法有望显著提高移动的AR应用的体验质量（QoE）。此外，拟议的研究将有助于定位加拿大作为一个领导者在多媒体技术在21世纪世纪。由此产生的对加拿大工业的技术转让将加强加拿大的全球竞争力，并对加拿大经济和社会产生积极影响。

Augmented Reality (AR) is a live, direct or indirect, view of a physical, real-world environment whose elements are augmented by computer-generated contents such as text, sound, video, or animation. AR marketing and advertising applications can add value to the product itself, either in the form of an enhanced product or a more engaging viewer experience. Collaborating with SimentIT, Inc., we will develop new technology in the cloud-based mobile AR system for marketing and advertising. Specifically, we will investigate three sub-projects: 1) object recognition, in which we first utilize the corner features and superpixels to create a semantic bag-of-words (BoW) model, and then apply a hierarchical Conditional Random Field (CRF) model to perform the object recognition; 2) tracking, in which we first propose a real-time tracking scheme based on Simultaneous Localization And Mapping (SLAM), and then improve the tracking performance by using Kernel Entropy Component Analysis (KECA) based multimodal information fusion; 3) game streaming, in which we propose a prioritized delivery scheme to maximize the scene quality by optimally allocating the bit rate for each 3D object, and a scalable Peer-to-Peer (P2P) geometry streaming scheme to provide different playback qualities for heterogeneous users. The proposed methods are expected to significantly improve the Quality of Experience (QoE) for mobile AR applications. Moreover, the proposed research will help to position Canada as a leader in multimedia technologies in the 21st century. The resultant technology transfer to Canadian industry will strengthen Canada's global competitiveness and create positive impacts to Canadian economy and society.