CPS: Breakthrough: From Whole-Hand Tactile Imaging to Interactive Simulation

CPS：突破：从全手触觉成像到交互模拟

• 批准号: 1446752
• 负责人: Yon Visell
• 金额: $ 49.99万
• 依托单位: Drexel University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2015
• 资助国家: 美国
• 起止时间: 2015-01-01 至 2016-03-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1446752&HistoricalAwards=false
• 关键词: CPS; Breakthrough; Whole; Hand; Tactile

This project aims to enable cyber-physical systems that can be worn on the body in order to one day allow their users to touch, feel, and manipulate computationally simulated three-dimensional objects or digital data in physically realistic ways, using the whole hand. It will do this by precisely measuring touch and movement-induced displacements of the skin in the hand, and by reproducing these signals interactively, via new technologies to be developed in the project. The resulting systems will offer the potential to impact a wide range of human activities that depend on touch and interaction with the hands. The project seeks to enable new applications for wearable cyber physical interfaces that may have broad applications in health care, manufacturing, consumer electronics, and entertainment. Although human interactive technologies have advanced greatly, current systems employ only a fraction of the sensorimotor capabilities of their users, greatly limiting applications and usability. The development of whole-hand haptic interfaces that allow their wearers to feel and manipulate digital content has been a longstanding goal of engineering research, but has remained far from reality. The reason can be traced to the difficulty of reproducing or even characterizing the complex, action-dependent stimuli that give rise to touch sensations during everyday activities.This project will pioneer new methods for imaging complex haptic stimuli, consisting of movement dependent skin strain and contact-induced surface waves propagating in skin, and for modeling the dependence of these signals on hand kinematics during grasping. It will use the resulting fundamental advances to catalyze the development of novel wearable CPS, in the form of whole-hand haptic interfaces. The latter will employ surface wave and skin strain feedback to supply haptic feedback to the hand during interaction with real and computational objects, enabling a range of new applications in VR. The project will be executed through research in three main research areas. In the first, it will utilize novel contact and non-contact techniques based on data acquired through on-body sensor arrays to measure whole-hand mechanical stimuli and grasping kinematics at high spatial and temporal resolution. In a second research area, it will undertake data-driven systems modeling and analysis of statistical contingencies between the kinematic and cutaneous sensed during everyday activities. In a third research area, it will engineer and perceptually evaluate novel cyber physical systems consisting of haptic interfaces for whole hand interaction.In order to further advance the applications of these systems in medicine, through a collaboration with the Drexel College of Medicine, the project will develop new methods for assessing clinical skills of palpation during medical examination, with the aim of improving the efficacy of what is often the first, most common, and best opportunity for diagnosis, using physician's own sense of touch.

该项目旨在使网络物理系统能够佩戴在身体上，以便有一天允许用户使用整个手以物理现实的方式触摸，感受和操纵计算模拟的三维物体或数字数据。它将通过精确测量触摸和运动引起的手部皮肤位移，并通过该项目开发的新技术交互式地再现这些信号来实现这一目标。由此产生的系统将提供影响广泛的人类活动的潜力，这些活动取决于触摸和与手的互动。该项目旨在实现可穿戴网络物理接口的新应用，这些接口可能在医疗保健、制造业、消费电子和娱乐领域具有广泛的应用。虽然人类互动技术已经取得了很大的进步，目前的系统只采用了一小部分的感觉运动能力的用户，大大限制了应用程序和可用性。开发全手触觉界面，让佩戴者能够感受和操纵数字内容，一直是工程研究的长期目标，但离现实还很远。其原因可以追溯到再现甚至表征在日常活动中引起触觉感觉的复杂的动作依赖性刺激的困难。该项目将开创用于成像复杂触觉刺激的新方法，包括运动依赖性皮肤应变和在皮肤中传播的接触引起的表面波，以及用于建模这些信号对抓握过程中手部运动学的依赖性。它将利用由此产生的基本进步来促进新型可穿戴CPS的开发，以全手触觉界面的形式。后者将采用表面波和皮肤应变反馈，在与真实的和计算对象交互时为手部提供触觉反馈，从而实现VR中的一系列新应用。该项目将通过三个主要研究领域的研究来执行。首先，它将利用新的接触和非接触技术的基础上获得的数据，通过对身体传感器阵列，以高的空间和时间分辨率测量全手机械刺激和抓运动学。在第二个研究领域，它将进行数据驱动的系统建模和日常活动中感觉到的运动学和皮肤之间的统计偶然性分析。在第三个研究领域，它将设计和感知评估由触觉界面组成的新型网络物理系统，用于全手交互。为了进一步推动这些系统在医学中的应用，该项目将通过与德雷克塞尔医学院的合作，开发新的方法来评估医疗检查中的触诊临床技能，其目的是利用医生自己的触觉来提高通常是第一、最常见和最佳诊断机会的功效。