Real-time stitching for virtual reality

与Advanced Micro Devices Inc.合作(AMD)谢里丹学院的屏幕产业研究和培训中心（SIRT）提议利用其在数字电影和游戏制作工作流程领域的核心研发能力，帮助AMD实现专业虚拟现实（VR）解决方案集成套件的突破性交付。虚拟现实（VR）预计将作为一个国际市场迅速增长，预计到2020年该领域的内容制作收入将超过80亿美元。然而，目前，消费者市场中的生产工作流程和由此产生的内容的商业成功受到劳动密集型要求和与真人VR拍摄相关的技术限制的严重阻碍。为了在虚拟现实显示器中重新创建360度世界观，需要多个视频流，其中拼接，对齐和进一步处理这些流的复杂过程是该过程的关键部分。目前，还没有成熟的经过行业测试和验证的解决方案。这种真空创造了一个机会，以快速创新和股份要求的一个大部分的增长市场。这一拟议的NSERC ARD项目将与研究资助的安大略卓越中心的VIP II计划在两年的时间内。这将导致开发一个实时拼接应用程序为360度球形视频用于电影VR和游戏为基础的制作。该解决方案将是开源的，针对使用AMD硬件解决方案的应用进行了优化，并旨在与现有的第三方技术（如相机和游戏引擎）集成，这些技术将用作生产过程的一部分。

In partnership with Advanced Micro Devices Inc. (AMD), Sheridan College's Screen Industries Research andTraining Centre (SIRT) proposes to leverage its core research and development capabilities within the area ofdigital cinema and gaming production workflows to help AMD achieve breakthrough delivery of an integratedsuite of professional Virtual Reality (VR) solutions. Virtual Reality (VR) is expected to grow rapidly as aninternational market, with predictions of over $8 billion in content production revenue in this sector by 2020.At the present time, however, production workflows and commercial success of the resulting content withinconsumer markets is significantly hampered by the labour-intensive requirements and technical limitationsassociated with live action VR filming. Multiple streams of video are required in order to recreate 360-degreeworldviews in a virtual reality display, with a complex process of stitching, aligning and further processing ofthese streams as key parts of the process. Currently, there are no established industry-tested and standardizedsolutions. This vacuum creates an opportunity to rapidly innovate and stake claim to a large segment of thegrowing market.This proposed NSERC ARD project will be integrated with research funded by Ontario Centres of Excellence'sVIP II program over a two-year period. It will result in the development of a real-time stitching application for360-degree spherical video for use in both cinematic VR and game-based productions. The solution will beopen source, optimized for application using AMD hardware solutions, and developed with a view tointegrating with existing third-party technologies, such as cameras and game engines, that will be used as partof the production process.