Multi-Touch 2-D Tactile Human Computer Interface Design and Optimization for Individuals with Physical Disabilities

在这个项目中，PI将探索与多点触摸触觉计算机界面相关的问题，并开发一个原型，该界面为肢体残疾人士设计和优化，对他们来说，键盘和鼠标等传统输入设备可能构成重大挑战。最近的技术进步支持制造任意大小和尺寸的2D多点触摸传感阵列，该阵列利用零力相互作用，非常薄，并且在各种操作条件下都很坚固。这种多点触摸传感(MTS)技术为全面的触觉界面开辟了新的可能性，该界面将键盘输入、鼠标控制和强大的宏定义整合到基于手势的界面中。这项研究解决了产生MTS接口所需的核心硬件和软件问题，这些接口对各种残疾人士完全可用，并能够适应手的大小/配置、运动范围和运动动力学的变化。具体地说，PI将重点关注(1)手指和手腕活动受限，(2)肘部或肩部活动受限，以及(3)运动轨迹不规则的个人。该项目将由四个基本部分组成：1.图像模型开发：与MTS接触产生一个由用户与表面之间的接触区域组成的“图像”。目前的图像模型是基于全手和手指功能的。这些模型将被更新，以处理残疾人产生的手掌、拳头和指关节手势。联系人轨迹建模和过滤：将开发模型来跟踪用户联系人图像的时空特征。此外，将研究和实施稳健的过滤算法，以最大限度地减少由于意外震颤或痉挛而导致的不规则运动的影响。手势定义和识别：将开发和实施算法，以识别广泛的手指、指节、手掌和拳头手势，以适应广泛的功能限制。将制定指导方针，帮助用户确定哪些手势最适合他们的能力。将创建配置软件，以便用户可以将这些手势映射到给定应用程序环境的最关键操作。4.综合MTS接口的设计和建造：将设计和建造满足残疾人士特殊需求的MTS接口。设计将包括集成到轮椅笔记本托盘中的MTS接口和基于蓝牙的无线MTS接口。这些集成的界面将使用户能够通过单一的定制界面控制多个设备，如PDA、计算机和ECU。严格的评估程序将通知所有研究组件。广泛影响：这项研究将为残疾人提供更方便和高效的计算机、PDA和国家信息基础设施，所有这些现在都对商务、教育、旅行和休闲等不同追求至关重要。

In this project the PI will explore issues relating to, and develop a prototype of, a multi-touch tactile computer interface designed and optimized for individuals with physical disabilities, for whom traditional input devices such as the keyboard and mouse can pose significant challenges. Recent technological advances support the manufacture of 2D multi-touch sensing arrays of arbitrary size and dimension that utilize zero force interaction, are very thin, and robust under a variety of operating conditions. This multi-touch sensing (MTS) technology opens up new possibilities for a comprehensive tactile interface that incorporates keyboard entry, mouse control, and powerful macro definition in a gesture-based interface. This research addresses the core hardware and software issues necessary to yield MTS interfaces that are fully accessible to individuals with a wide range of disabilities, and that can accommodate variations in hand size/configuration, range of movements, and movement dynamics. Specifically, the PIs will focus on individuals with (1) limited motion of the digits and wrist, (2) limited motion of the elbow or shoulder, and (3) irregularity of movement trajectories. The project will consist of four fundamental components:1. Image Model Development: Contact with the MTS produces an "image" consisting of the areas of contact between the user and surface. Current image models are based on full hand and finger function. These models will be updated to handle palm, fist, and knuckle gestures produced by individuals with disabilities.2. Contact Trajectory Modeling and Filtering: Models will be developed to track the spatio-temporal characteristics of user contact images. Additionally, robust filtering algorithms will be investigated and implemented to minimize the effect of irregular movements due to unintended tremor or spasticity.3. Gesture Definition and Recognition: Algorithms will be developed and implemented to recognize an extensive collection of finger, knuckle, palm and fist gestures so as to accommodate a wide range of functional limitations. Guidelines will be created that help users identify which gestures are most appropriate for their abilities. Configuration software will be created so that users can map these gestures to the most critical actions for a given application environment. 4. Design and Construction of Integrated MTS Interfaces: MTS interfaces that meet the particular needs of individuals with disabilities will be designed and constructed. Designs will include an MTS interface integrated into a wheelchair lap tray and Bluetooth based wireless MTS interfaces. These integrated interfaces will enable users to control multiple devices, such as PDAs, computers, and ECUs, through a single, customized interface.Rigorous evaluation procedures will inform all research components.Broader Impacts: This research will afford individuals with disabilities more accommodatingand efficient access to computer, PDAs, and the National Information Infrastructure, all of which are now critical in such diverse pursuits as business, education, travel, and leisure.