OpenMPD: A Low-Level Presentation Engine for Multimodal Particle-Based Displays

OpenMPD: A Low-Level Presentation Engine for Multimodal Particle-Based Displays
复制标题

OpenMPD:用于基于粒子的多模式显示的低级呈现引擎

DOI:
10.1145/3572896
复制
发表时间:
2023
影响因子:
6.2
通讯作者:
Montano-Murillo R
Montano-Murillo R
中科院分区:
计算机科学1区
文献类型:
--
作者:
Montano-Murillo R

文献摘要

参考文献

被引文献

相似文献

传感器的相控阵列在软件和硬件方面已经快速发展,应用于触觉(声振动),显示(悬浮)和音频。最近,多模态粒子显示器(MPD)甚至展示了可以同时看到,听到和感觉到的体积内容,而无需额外的仪器。然而,目前的软件工具只支持个别的模态,它们不解决的集成和开发的多模态潜力的MPD。这是因为没有标准化的呈现流水线来解决与呈现这种多模态内容有关的挑战(例如,多模式支持、10 KHz下的多速率同步、视觉呈现或同步和连续性)。本文介绍了OpenMPD,这是一个低级别的演示引擎,可以处理这些挑战,并允许结构化地利用任何类型的MPD内容(即,视觉、触觉、听觉)。我们描述了OpenMPD的性能,并说明了如何将其集成到更高级别的开发工具(即,Unity游戏引擎)。然后,我们说明了它的能力,使新的演示功能,如支持多个MPD内容,灵巧的操作快速移动的粒子,或新的扫描量MPD内容。
Phased arrays of transducers have been quickly evolving in terms of software and hardware with applications in haptics (acoustic vibrations), display (levitation), and audio. Most recently, Multimodal Particle-based Displays (MPDs) have even demonstrated volumetric content that can be seen, heard, and felt simultaneously, without additional instrumentation. However, current software tools only support individual modalities and they do not address the integration and exploitation of the multi-modal potential of MPDs. This is because there is no standardized presentation pipeline tackling the challenges related to presenting such kind of multi-modal content (e.g., multi-modal support, multi-rate synchronization at 10 KHz, visual rendering or synchronization and continuity). This article presents OpenMPD, a low-level presentation engine that deals with these challenges and allows structured exploitation of any type of MPD content (i.e., visual, tactile, audio). We characterize OpenMPD’s performance and illustrate how it can be integrated into higher-level development tools (i.e., Unity game engine). We then illustrate its ability to enable novel presentation capabilities, such as support of multiple MPD contents, dexterous manipulations of fast-moving particles, or novel swept-volume MPD content.
ArticuLev:用于铰接式多珠悬浮基元的集成自组装管道
DOI: 10.1145/3411764.3445342
发表时间: 2021
期刊: --
影响因子: --
作者:
Fender A
通讯作者: Fender A
DOI: 10.1038/ncomms9661
发表时间: 2015-10-27
影响因子: 16.6
作者:
Marzo A;Seah SA;Drinkwater BW;Sahoo DR;Long B;Subramanian S
通讯作者: Subramanian S
用驱动的悬浮粒子增强物理对象
DOI: --
发表时间: 2019
期刊: International Symposium on Pervasive Displays
影响因子: --
作者:
Euan Freeman;A. Marzo;Praxitelis B. Kourtelos;J. Williamson;S. Brewster
通讯作者: S. Brewster
基于 FPGA 的模块化相控阵超声悬浮系统与 MATLAB
DOI: 10.1109/ultsym.2019.8926194
发表时间: 2019
期刊: 2019 IEEE International Ultrasonics Symposium (IUS)
影响因子: --
作者:
Sebastian Zehnter;C. Ament
通讯作者: C. Ament
物理声音教科书
DOI: 10.1038/063026a0
发表时间: --
期刊: Nature
影响因子: 64.8
作者:
E. E.
通讯作者: E. E.