Semantic Entity-Component State Management Techniques to Enhance Software Quality for Multimodal VR-Systems
Semantic Entity-Component State Management Techniques to Enhance Software Quality for Multimodal VR-Systems
复制标题
用于提高多模式 VR 系统软件质量的语义实体组件状态管理技术
DOI：
10.1109/tvcg.2017.2657098
复制
发表时间：
2017
影响因子：
5.2
通讯作者：
Marc Erich Latoschik
中科院分区：
文献类型：
--
作者：
Martin Fischbach;Dennis Wiebusch;Marc Erich Latoschik
模块化、可修改性、可重用性和API可用性是决定软件体系结构可维护性的重要软件质量。虚拟、增强和混合现实（VR、AR、MR）系统、现代计算机游戏以及交互式人机系统通常包括各种专用输入、输出和处理子系统。这些子系统共同维护一致应用状态的实时模拟。个体状态表示、相互状态访问、整体同步和控制流之间的相互依赖意味着概念上的紧密耦合，而软件质量要求解耦以开发维护解决方案。本文提出了五种基于语义的软件技术来解决这一矛盾：语义基础，语义代码，接地动作，语义查询和语义解耦。这些技术被应用于扩展完善的实体组件系统（ECS）模式，以克服这种模式的缺陷方面的隐含状态访问。一个多模态（语音和手势）VR界面的中央实现方面的演练是用来突出技术的好处。这个用例被选为复杂架构的原型示例，其中包含许多VR、AR和MR架构中的多个交互子系统。最后，给出了实现提示，指出了可维护性方面的经验教训，并讨论了性能影响。
Modularity, modifiability, reusability, and API usability are important software qualities that determine the maintainability of software architectures. Virtual, Augmented, and Mixed Reality (VR, AR, MR) systems, modern computer games, as well as interactive human-robot systems often include various dedicated input-, output-, and processing subsystems. These subsystems collectively maintain a real-time simulation of a coherent application state. The resulting interdependencies between individual state representations, mutual state access, overall synchronization, and flow of control implies a conceptual close coupling whereas software quality asks for a decoupling to develop maintainable solutions. This article presents five semantics-based software techniques that address this contradiction: Semantic grounding, code from semantics, grounded actions, semantic queries, and decoupling by semantics. These techniques are applied to extend the well-established entity-component-system (ECS) pattern to overcome some of this pattern's deficits with respect to the implied state access. A walk-through of central implementation aspects of a multimodal (speech and gesture) VR-interface is used to highlight the techniques' benefits. This use-case is chosen as a prototypical example of complex architectures with multiple interacting subsystems found in many VR, AR and MR architectures. Finally, implementation hints are given, lessons learned regarding maintainability pointed-out, and performance implications discussed.