Mechanisms of integrating haptic cues for VR-based interactive analytics of complex data

整合触觉线索以进行基于 VR 的复杂数据交互式分析的机制

• 批准号: RGPIN-2020-04052
• 负责人: Hu, Yaoping
• 金额: $ 2.04万
• 依托单位: University of Calgary
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2020
• 资助国家: 加拿大
• 起止时间: 2020-01-01 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=716786
• 关键词: Mechanisms; integrating; haptic; cues; VR

PROBLEM: Many scientific/engineering applications yield increasingly complex data in multiple dimensions and variates. Although application-specific algorithms can extract certain ill-defined patterns of the data, the intricate characteristics of these patterns require experts (users) with various competencies to analyze them interactively and collaboratively (i.e., interactive analytics) for decision-making. High-end computers usually display the patterns as 3-dimensional objects in intertwisted shapes (local attributes) and interlinkages (global relationships). Routinely, the users interact with the objects via keyboards/mice while viewing them on screens. This practice deters the users from conducting interactive analytics efficiently, due to difficulties in relying solely on the sense of vision for decoding the interconnection between the local attributes and global relationships. A solution might employ the sense of touch to explore the local attributes, while maintaining the view of the global relationships. The solution involves the human ability of using both senses to interact with objects for achieving cognitive responses. Rendering visual and haptic (touch by force and vibrotactile) cues to stimulate both senses, a computer platform based on advanced Virtual Reality (VR) technologies has a potential for catalyzing interactive analytics. Impediments are however two major deficiencies in the current knowledgebase: (a) the lack of robust schemes for associating the haptic cues with the local attributes of the patterns, and (b) the unavailability of adequate models for integrating the cues to foster neuro-ergonomic interaction. OBJECTIVE: The long-term objective of this program is to address the deficiencies by creating computational mechanisms for integrating the haptic cues, hence catalysing VR-based interactive analytics. The short-term objectives of the program are to establish schemes of force and vibrotactile cues (Theme A) and to build models of integrating the cues (Theme B). IMPACT: It is challenging to invent cue-integration mechanisms in complying with behavioural and neural responses for fostering neuro-ergonomic interaction. Collaborating with national and international researchers, the program meets the challenge by achieving two innovative elements: (i) a methodology of creating cue schemes from pattern attributes, and (ii) an optimization of ensuring the cue-integration. The achievement signifies a knowledge gain to permit the use of haptic cues for facilitating interactive analytics, and a technical advancement to enable a viable VR-based platform for benefiting Canadian economy by promoting experts' actions in applications including: planning public safety (e.g., flood mitigation), boosting industrial competitiveness (e.g., reactor design), innovating trustable human-machine interfaces (e.g., human-robot defense systems), and inventing practical brain-machine interaction (e.g., object manipulation via neural signals).

问题：许多科学/工程应用程序在多个维度和变量中产生越来越复杂的数据。尽管特定于应用的算法可以提取数据的某些不明确的模式，但是这些模式的复杂特征需要具有各种能力的专家（用户）来交互地和协作地分析它们（即，交互式分析）进行决策。高端计算机通常将模式显示为三维对象，这些对象具有相互扭曲的形状（局部属性）和相互联系（全局关系）。然而，用户通过键盘/鼠标与对象交互，同时在屏幕上查看它们。这种做法阻碍了用户有效地进行交互式分析，因为仅仅依靠视觉来解码本地属性和全局关系之间的互连是困难的。一个解决方案可能会采用触觉来探索本地属性，同时保持全局关系的视图。解决方案涉及人类使用两种感官与物体互动以实现认知反应的能力。渲染视觉和触觉（通过力和振动触觉的触摸）线索来刺激两种感官，基于先进的虚拟现实（VR）技术的计算机平台具有催化交互式分析的潜力。然而，障碍是当前知识库中的两个主要缺陷：（a）缺乏用于将触觉线索与图案的局部属性相关联的稳健方案，以及（B）不提供用于整合线索以促进神经人体工程学交互的适当模型。 目的：该计划的长期目标是通过创建用于整合触觉提示的计算机制来解决这些缺陷，从而促进基于VR的交互式分析。短期目标为建立力觉与振动触觉线索的图式（主题A）及整合力觉与振动触觉线索的模型（主题B）。 影响：它是具有挑战性的发明线索整合机制，在遵守行为和神经反应，促进神经人机交互。该计划与国内和国际研究人员合作，通过实现两个创新要素来应对挑战：（i）从模式属性创建提示方案的方法，以及（ii）确保提示整合的优化。这一成就意味着知识的获得，允许使用触觉提示来促进交互式分析，以及技术的进步，通过促进专家在应用中的行动，使一个可行的基于VR的平台有利于加拿大经济，包括：规划公共安全（例如，防洪减灾），提高工业竞争力（例如，反应器设计），创新可信赖的人机界面（例如，人类-机器人防御系统），以及发明实用的脑机交互（例如，经由神经信号的对象操纵）。