I-Corps: End-User Trained Augmentative/Alternative Communication Tablet for Speech-Impaired Patients

I-Corps：经过最终用户培训的针对言语障碍患者的增强/替代通信平板电脑

• 批准号: 1935382
• 负责人: Steven Durbin
• 金额: $ 5万
• 依托单位: Western Michigan University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-06-15 至 2020-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1935382&HistoricalAwards=false
• 关键词: Corps; End; User; Trained; Augmentative

The broader impact/commercial potential of this I-Corps project stems from exploiting the powerful image and pattern recognition abilities of artificial intelligence (AI) to create a communication assistance device that does not require the user to adapt to the inherent limitations of a new technology. Instead, the device adapts to the user, within whatever limitations they experience, for near-immediate uptake. Consequently, the significant barriers associated with introducing unfamiliar technology are removed, and the user - regardless of the underlying physical impairment to verbal communication - can interact with others, their environment (through linked internet-of-things enabled smart devices) and equipment or instrumentation interfaces. Particulary for those with a condition permanently limiting verbal communication, a practical, adaptive and viable approach to interacting with others can reduce the reliance on caregivers, and enable them to more fully integrate in their environment. A more detailed understanding of the practical obstacles to introducing new communication devices will translate to related fields as well, including situations characterizing medical, hazardous disposal, and harsh environments.This I-Corps project builds upon the successful demonstration of machine-learning ("artificial intelligence, or AI") image processing techniques to create a viable alternative method for nonverbal communication. The input device is a conventional tablet or smartphone, and the typical user will interact with a single finger, although alternatives are conceivable. The project originates from a study focused on development of next-generation, environmentally-friendly, earth-abundant element semiconductors, in which large amounts of video data needed to be processed in an automated fashion. The underlying framework for the corresponding tool that was developed was adapted to this new, but not unrelated, purpose, so that the communication device adapts to the user and the user's limitations, and not the other way around. We have established that is is feasible to process user-defined abstract input essentially in real time by capitalizing on current generation hardware adapted for AI-based applications. The user trains a neural network, which becomes increasingly more accurate with use. The project will identify meaningful success metrics for target markets so that the corresponding minimum viable product can be compared to existing and competing technologies, as well as identify the primary barriers to technology uptake that can come into play.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

该I-Corps项目的更广泛的影响/商业潜力源于利用强大的图像和模式识别能力（AI）来创建一个不需要用户适应新技术固有局限性的通信辅助设备。取而代之的是，该设备在他们遇到的任何限制内都适应用户，以供近距离吸收。因此，删除了与引入不熟悉技术相关的重大障碍，并且用户 - 无论口头交流的潜在身体损害如何，都可以与他人互动，其环境（通过链接的启用了链接的智能设备）以及设备或仪器界面。对于那些条件永久限制口头交流的人来说，与他人互动的实用，适应性和可行的方法可以减少对护理人员的依赖，并使他们能够在环境中更充分整合。对引入新的通信设备的实际障碍的更详细的了解也将转化为相关领域，包括特征医学，危险处置和恶劣环境的情况。该I-Corps项目以机器学习的成功（“人工智能或AI”的成功展示，以创建可行的替代标准方法。输入设备是常规的平板电脑或智能手机，尽管可以想象，但典型的用户将与单个手指进行交互。该项目源自一项研究，旨在开发下一代，环保，丰富的地球元素半导体，其中需要以自动方式处理大量视频数据。开发的相应工具的基础框架适应了这个新的，但不是无关的目的，因此通信设备适应用户和用户的局限性，而不是相反。我们已经确定，可以通过利用适用于基于AI的应用程序的当前一代硬件来实时实时处理用户定义的抽象输入是可行的。用户训练神经网络，随着使用而变得越来越准确。该项目将确定目标市场的有意义的成功指标，以便可以将相应的最低可行产品与现有和竞争技术进行比较，并确定可以发挥作用的技术吸收的主要技术障碍。该奖项反映了NSF的法定任务，并通过使用该基金会的知识分子优点和广泛的影响来评估NSF的法定任务，并被视为值得进行的支持。