SBIR Phase I: Video-based Head and Face Gesture Recognition System for Hands-Free Control

该小型企业创新研究(SBIR)第一阶段项目由加州未来科技与健康中心(Future of Technology and Health，LC)发起，将开发基于视频的手势识别技术，为因脑瘫、Lou Gerhig病(ALS)、中风、脊髓损伤或重复应激损伤等残疾而难以使用标准键盘或鼠标的人提供有效的新型计算机访问。这项技术还有望为所有可能用手执行其他任务(如打字、驾驶机动车辆、操作测试设备等)的用户提供对计算机和其他电子设备进行“免提”控制的能力。该项目的重点是使用标准的低成本数码摄像机(100美元以下)和标准的个人电脑识别多种头部和面部手势。该系统还可以在用于移动和车载应用的袖珍计算机上实现。脸部和头部手势用于产生鼠标或键盘动作来控制计算机或控制信号，进而控制其他类型的电子设备。例如，一种应用程序是使用头部手势来浏览网页，包括选择和激活所需的链接，从而实现免提上网功能。手势识别可以用来取代或增强现有的开关接口或昂贵的眼睛/头部跟踪系统，供残疾人使用，在许多应用程序中，它比语音识别有许多优势。这项技术的早期客户包括行动不便的计算机用户，他们不能有效地使用标准键盘或鼠标。其他商业应用包括免提控制台式计算机软件，如网络浏览器或文本语音转换，以及免提控制车载信息系统和个人数字助理(PDA)。该技术还可用于工业、科学或军事设备的高度可靠的免提控制。

This Small Business Innovation Research (SBIR) Phase I project from Future of Technology and Health, (FUTH), LC, will develop video-based gesture recognition technology to provide an effective new type of computer access for people who have difficulty using a standard keyboard or mouse due to disabilities including cerebral palsy, Lou Gerhig's disease (ALS), stroke, spinal cord injury, or repetitive stress injury. This technology is also expected to provide the capability for 'hands-free' control of computers and other electronic equipment for all users who may be using their hands for other tasks (such as typing, driving a motor vehicle, operating test equipment, etc.). This project focuses on recognition of multiple head and face gestures using standard low cost digital video cameras (under $100) and standard personal computers. The system may also be implemented on pocket computers for mobile and in-vehicle applications. Face and head gestures are used to generate mouse or keyboard actions to control a computer or to control signals that in turn control other types of electronic devices. For example, one application is the capability to 'surf the web' hands-free using head gestures to navigate web pages, including selecting and activating desired links. Gesture recognition can be used to replace or augment existing switch interfaces or expensive eye/head tracking systems for people with disabilities, and it has a number of advantages over voice recognition in many applications.Early customers for this technology include computer users with mobility impairments who cannot effectively use a standard keyboard or mouse. Other commercial applications include hands-free control of desktop computer software such as web browsers or text-to-speech, and hands-free control of in-vehicle information systems and personal digital assistants (PDA's). The technology may also be applied for highly reliable hands-free control of industrial, scientific, or military equipment.