Optical Touch Sensing on Nonparametric Rear-Projection Surfaces for Interactive Physical-Virtual Experiences
Optical Touch Sensing on Nonparametric Rear-Projection Surfaces for Interactive Physical-Virtual Experiences
复制标题
非参数背投表面上的光学触摸传感，用于交互式物理-虚拟体验
DOI：
10.1162/pres_a_00242
复制
发表时间：
2016
期刊：
影响因子：
--
通讯作者：
G. Welch
中科院分区：
文献类型：
--
作者：
Jason Hochreiter;Salam Daher;A. Nagendran;Laura González;G. Welch
我们展示了一个通用的方法，统一的多点触摸检测和响应各种非参数和参数化的表面，以支持交互式的物理虚拟体验。该方法采用多个红外（IR）相机、一个或多个投影仪、IR光源和背投表面。从人的手指反射的IR光由具有匹配的IR通滤波器的相机捕获，从而允许检测和定位多个同时的手指触摸事件。这些事件的处理与渲染系统紧密耦合，以产生使用投影仪在表面上显示的听觉和视觉响应，从而实现响应的、交互的、物理-虚拟体验。我们证明了两个非参数面形曲面和平面曲面的方法。我们还说明了该方法的适用性，在一个互动的医疗培训方案中使用的头表面之一，以支持动手，触摸敏感的医疗培训与动态的物理虚拟患者的行为。
We demonstrate a generalizable method for unified multitouch detection and response on various nonparametric and parametric surfaces to support interactive physical-virtual experiences. The method employs multiple infrared (IR) cameras, one or more projectors, IR light sources, and a rear-projection surface. IR light reflected off human fingers is captured by cameras with matched IR pass filters, allowing for the detection and localization of multiple simultaneous finger-touch events. The processing of these events is tightly coupled with the rendering system to produce auditory and visual responses displayed on the surface using the projector(s) to achieve a responsive, interactive, physical–virtual experience. We demonstrate the method on two nonparametric face-shaped surfaces and a planar surface. We also illustrate the approach's applicability in an interactive medical training scenario using one of the head surfaces to support hands-on, touch-sensitive medical training with dynamic physical–virtual patient behavior.