Mechanisms of integrating haptic cues for VR-based interactive analytics of complex data

整合触觉线索以进行基于 VR 的复杂数据交互式分析的机制

• 批准号: RGPIN-2020-04052
• 负责人: Hu, Yaoping
• 金额: $ 2.04万
• 依托单位: University of Calgary
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2021
• 资助国家: 加拿大
• 起止时间: 2021-01-01 至 2022-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=739646
• 关键词: Mechanisms; integrating; haptic; cues; VR

PROBLEM: Many scientific/engineering applications yield increasingly complex data in multiple dimensions and variates. Although application-specific algorithms can extract certain ill-defined patterns of the data, the intricate characteristics of these patterns require experts (users) with various competencies to analyze them interactively and collaboratively (i.e., interactive analytics) for decision-making. High-end computers usually display the patterns as 3-dimensional objects in intertwisted shapes (local attributes) and interlinkages (global relationships). Routinely, the users interact with the objects via keyboards/mice while viewing them on screens. This practice deters the users from conducting interactive analytics efficiently, due to difficulties in relying solely on the sense of vision for decoding the interconnection between the local attributes and global relationships. A solution might employ the sense of touch to explore the local attributes, while maintaining the view of the global relationships. The solution involves the human ability of using both senses to interact with objects for achieving cognitive responses. Rendering visual and haptic (touch by force and vibrotactile) cues to stimulate both senses, a computer platform based on advanced Virtual Reality (VR) technologies has a potential for catalyzing interactive analytics. Impediments are however two major deficiencies in the current knowledgebase: (a) the lack of robust schemes for associating the haptic cues with the local attributes of the patterns, and (b) the unavailability of adequate models for integrating the cues to foster neuro-ergonomic interaction. OBJECTIVE: The long-term objective of this program is to address the deficiencies by creating computational mechanisms for integrating the haptic cues, hence catalysing VR-based interactive analytics. The short-term objectives of the program are to establish schemes of force and vibrotactile cues (Theme A) and to build models of integrating the cues (Theme B). IMPACT: It is challenging to invent cue-integration mechanisms in complying with behavioural and neural responses for fostering neuro-ergonomic interaction. Collaborating with national and international researchers, the program meets the challenge by achieving two innovative elements: (i) a methodology of creating cue schemes from pattern attributes, and (ii) an optimization of ensuring the cue-integration. The achievement signifies a knowledge gain to permit the use of haptic cues for facilitating interactive analytics, and a technical advancement to enable a viable VR-based platform for benefiting Canadian economy by promoting experts' actions in applications including: planning public safety (e.g., flood mitigation), boosting industrial competitiveness (e.g., reactor design), innovating trustable human-machine interfaces (e.g., human-robot defense systems), and inventing practical brain-machine interaction (e.g., object manipulation via neural signals).

问题：许多科学/工程应用产生了越来越复杂的多维和多变量数据。虽然特定于应用程序的算法可以提取数据的某些定义不明确的模式，但这些模式的错综复杂的特征需要具有各种能力的专家(用户)以交互和协作的方式分析它们，以便进行决策。高端计算机通常将图案显示为相互缠绕的形状(局部属性)和相互关联(全球关系)的三维对象。通常，用户通过键盘/鼠标与对象交互，同时在屏幕上查看它们。这种做法阻碍了用户有效地进行交互分析，因为仅依靠视觉来解码本地属性和全球关系之间的互连是困难的。一种解决方案可能使用触觉来探索局部属性，同时保持对全球关系的看法。解决方案涉及到人类使用两种感官与物体相互作用的能力，以实现认知反应。通过呈现视觉和触觉(力触摸和振动触觉)线索来刺激两种感官，基于先进虚拟现实(VR)技术的计算机平台具有催化互动分析的潜力。然而，障碍是当前知识库中的两个主要缺陷：(A)缺乏将触觉线索与图案的局部属性相关联的健壮方案，以及(B)没有足够的模型来整合线索以促进神经-人体工学相互作用。目标：这个项目的长期目标是通过创建整合触觉线索的计算机制来解决这些不足，从而催化基于VR的互动分析。该计划的短期目标是建立力量和振动触觉线索的方案(主题A)，并建立整合线索的模型(主题B)。影响：发明符合行为和神经反应的线索整合机制以促进神经-人体工学相互作用是具有挑战性的。该项目与国内和国际研究人员合作，通过实现两个创新要素来应对挑战：(I)根据模式属性创建线索方案的方法，以及(Ii)确保线索整合的优化。这一成就标志着知识的增长，允许使用触觉线索促进互动分析，也标志着技术的进步，通过促进专家在应用方面的行动，使一个可行的基于VR的平台受益于加拿大经济，这些应用包括：规划公共安全(例如，减轻洪水)，提高工业竞争力(例如，反应堆设计)，创新可靠的人机界面(例如，人机防御系统)，以及发明实用的脑机交互(例如，通过神经信号操纵对象)。