Multi-Touch 2-D Tactile Human Computer Interface Design and Optimization for Individuals with Physical Disabilities

在这个项目中，PI将探索有关的问题，并开发一个原型，一个为身体残疾人士设计和优化的多点触控触觉计算机界面，对他们来说，传统的输入设备，如键盘和鼠标，可能构成重大挑战。最近的技术进步支持制造任意尺寸和尺寸的二维多点触摸传感阵列，这些阵列利用零力相互作用，非常薄，并且在各种操作条件下都很坚固。这种多点触摸传感（MTS）技术为综合触觉界面开辟了新的可能性，该界面在基于手势的界面中集成了键盘输入、鼠标控制和强大的宏定义。本研究解决了产生MTS接口所需的核心硬件和软件问题，这些接口对各种残疾的个人来说都是完全可访问的，并且可以适应手的大小/配置、运动范围和运动动态的变化。具体来说，pi将集中于以下患者：(1)手指和手腕运动受限；(2)肘部或肩部运动受限；(3)运动轨迹不规则。该项目将包括四个基本组成部分：1。图像模型开发：与MTS的接触产生由用户和表面之间的接触区域组成的“图像”。目前的图像模型是基于全手和手指功能。这些模型将被更新，以处理手掌，拳头和指关节手势产生的个人残疾人。接触轨迹建模和过滤：将开发模型来跟踪用户接触图像的时空特征。此外，鲁棒滤波算法将被研究和实施，以尽量减少由于意外震颤或痉挛而导致的不规则运动的影响。手势定义和识别：将开发和实施算法来识别手指，指关节，手掌和拳头手势的广泛集合，以适应广泛的功能限制。将制定指导方针，帮助用户确定哪些手势最适合他们的能力。将创建配置软件，以便用户可以将这些手势映射到给定应用程序环境中最关键的操作。4. 集成MTS接口的设计和构建：将设计和构建满足残疾人特殊需求的MTS接口。设计将包括集成到轮椅托盘中的MTS接口和基于蓝牙的无线MTS接口。这些集成接口将使用户能够通过单个定制接口控制多个设备，如pda、计算机和ecu。严格的评估程序将通知所有研究组成部分。更广泛的影响：这项研究将为残疾人提供更方便、更有效地使用计算机、pda和国家信息基础设施的机会，所有这些都是现在商业、教育、旅游和休闲等多种追求的关键。

In this project the PI will explore issues relating to, and develop a prototype of, a multi-touch tactile computer interface designed and optimized for individuals with physical disabilities, for whom traditional input devices such as the keyboard and mouse can pose significant challenges. Recent technological advances support the manufacture of 2D multi-touch sensing arrays of arbitrary size and dimension that utilize zero force interaction, are very thin, and robust under a variety of operating conditions. This multi-touch sensing (MTS) technology opens up new possibilities for a comprehensive tactile interface that incorporates keyboard entry, mouse control, and powerful macro definition in a gesture-based interface. This research addresses the core hardware and software issues necessary to yield MTS interfaces that are fully accessible to individuals with a wide range of disabilities, and that can accommodate variations in hand size/configuration, range of movements, and movement dynamics. Specifically, the PIs will focus on individuals with (1) limited motion of the digits and wrist, (2) limited motion of the elbow or shoulder, and (3) irregularity of movement trajectories. The project will consist of four fundamental components:1. Image Model Development: Contact with the MTS produces an "image" consisting of the areas of contact between the user and surface. Current image models are based on full hand and finger function. These models will be updated to handle palm, fist, and knuckle gestures produced by individuals with disabilities.2. Contact Trajectory Modeling and Filtering: Models will be developed to track the spatio-temporal characteristics of user contact images. Additionally, robust filtering algorithms will be investigated and implemented to minimize the effect of irregular movements due to unintended tremor or spasticity.3. Gesture Definition and Recognition: Algorithms will be developed and implemented to recognize an extensive collection of finger, knuckle, palm and fist gestures so as to accommodate a wide range of functional limitations. Guidelines will be created that help users identify which gestures are most appropriate for their abilities. Configuration software will be created so that users can map these gestures to the most critical actions for a given application environment. 4. Design and Construction of Integrated MTS Interfaces: MTS interfaces that meet the particular needs of individuals with disabilities will be designed and constructed. Designs will include an MTS interface integrated into a wheelchair lap tray and Bluetooth based wireless MTS interfaces. These integrated interfaces will enable users to control multiple devices, such as PDAs, computers, and ECUs, through a single, customized interface.Rigorous evaluation procedures will inform all research components.Broader Impacts: This research will afford individuals with disabilities more accommodatingand efficient access to computer, PDAs, and the National Information Infrastructure, all of which are now critical in such diverse pursuits as business, education, travel, and leisure.