HoloLens 2 Research Mode as a Tool for Computer Vision Research
HoloLens 2 Research Mode as a Tool for Computer Vision Research
复制标题
HoloLens 2 研究模式作为计算机视觉研究的工具
DOI：
--
复制
发表时间：
2020
期刊：
影响因子：
--
通讯作者：
M. Pollefeys
中科院分区：
文献类型：
--
作者：
Dorin Ungureanu;Federica Bogo;S. Galliani;Pooja Sama;Xin Duan;Casey Meekhof;Jan Stühmer;T. Cashman;Bugra Tekin;Johannes L. Schönberger;Pawel Olszta;M. Pollefeys
混合现实耳机，如微软HoloLens 2，是功能强大的传感设备，具有集成的计算能力，这使其成为计算机视觉研究的理想平台。在这份技术报告中，我们介绍了HoloLens 2研究模式、一个API和一组能够访问原始传感器流的工具。我们将提供API的概述，并解释如何使用它来构建基于处理传感器数据的混合现实应用程序。我们还展示了如何将研究模式传感器数据与HoloLens 2提供的内置眼睛和手跟踪功能相结合。通过发布研究模式API和一组开源工具，我们的目标是促进计算机视觉和机器人领域的进一步研究，并鼓励研究社区的贡献。
Mixed reality headsets, such as the Microsoft HoloLens 2, are powerful sensing devices with integrated compute capabilities, which makes it an ideal platform for computer vision research. In this technical report, we present HoloLens 2 Research Mode, an API and a set of tools enabling access to the raw sensor streams. We provide an overview of the API and explain how it can be used to build mixed reality applications based on processing sensor data. We also show how to combine the Research Mode sensor data with the built-in eye and hand tracking capabilities provided by HoloLens 2. By releasing the Research Mode API and a set of open-source tools, we aim to foster further research in the fields of computer vision as well as robotics and encourage contributions from the research community.