Distributed mixed reality with TV sync

AWE有限公司（AWECO）的使命是“使人们能够使用移动的设备与世界互动的方式是富有想象力的，信息和智能”。在我们之前成功的NSERC与AWECO合作的基础上，我们共同开发了一种技术解决方案，用于约克堡历史遗址的户外增强现实体验。该项目最终开发、测试和部署了一个移动的增强现实解决方案，该解决方案能够在先前已知的区域内跟踪用户的移动的平板电脑。在设计阶段和实时操作期间，在体验之前绘制区域地图，平板电脑使用GPS坐标识别用户当前定位的感兴趣区域，加载适当的特征子地图并跟踪该子地图中的当前显示。渲染的几何图形和动画可以显示在视频图像的顶部，以创建混合现实体验。虽然AWECO已经完成了这个项目，但他们看到了在新技术计划中使用开发的混合现实技术的潜力，以实现家庭中的混合现实体验。将混合现实体验与正在播放的电视节目联系起来，将使AWECO能够创造创新的体验，让儿童以互动的方式探索历史观点和事实。电视节目中的事件将被设计成与用户的移动终端交互。然而，需要解决方案来确保混合现实解决方案可以适应和扩展到不受控制的环境。这是AWECO目前问题的核心。他们需要一个混合现实解决方案，可以扩展到不受控制的环境，

AWE Company Ltd's (AWECO) mission is to "enable people using mobile devices to interact with the world in ways that are imaginative, informative, and intelligent". Building on our previous successful NSERC Engage with AWECO we worked together to develop a technology solution for an outdoor augmented reality experience for the Fort York historical site. This project culminated in the development, testing and deployment of a mobile augmented reality solution that is capable of tracking the user's mobile tablet within a previously known area. The area is mapped prior to the experience during the design phase and during realtime operation the tablet identifies which region of interest the user is currently positioned using GPS coordinates, loads the appropriate submap of features and tracks the current display in this submap. Rendered geometry and animation can then be displayed on top of the video imagery to create the mixed reality experience. While AWECO has been completing this project, they see the potential to use the developed mixed reality technology in a new technology initiative to enable mixed reality experiences in the home. Tying the mixed reality experience to a television show being broadcast will allow AWECO to create innovative experiences that allow children to explore historical perspectives and facts in an interactive manner. Events in the TV show will be designed to interact with the users' mobile device. However, solutions are needed to ensure that the mixed reality solution can be adapted and scaled to uncontrolled environments. This is at the core of AWECO's current problem. They require a mixed reality solution that scales to uncontrolled environments that can be