I-Corps: End-User Trained Augmentative/Alternative Communication Tablet for Speech-Impaired Patients

I-Corps：经过最终用户培训的针对言语障碍患者的增强/替代通信平板电脑

• 批准号: 1935382
• 负责人: Steven Durbin
• 金额: $ 5万
• 依托单位: Western Michigan University
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-06-15 至 2020-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1935382&HistoricalAwards=false
• 关键词: Corps; End; User; Trained; Augmentative

The broader impact/commercial potential of this I-Corps project stems from exploiting the powerful image and pattern recognition abilities of artificial intelligence (AI) to create a communication assistance device that does not require the user to adapt to the inherent limitations of a new technology. Instead, the device adapts to the user, within whatever limitations they experience, for near-immediate uptake. Consequently, the significant barriers associated with introducing unfamiliar technology are removed, and the user - regardless of the underlying physical impairment to verbal communication - can interact with others, their environment (through linked internet-of-things enabled smart devices) and equipment or instrumentation interfaces. Particulary for those with a condition permanently limiting verbal communication, a practical, adaptive and viable approach to interacting with others can reduce the reliance on caregivers, and enable them to more fully integrate in their environment. A more detailed understanding of the practical obstacles to introducing new communication devices will translate to related fields as well, including situations characterizing medical, hazardous disposal, and harsh environments.This I-Corps project builds upon the successful demonstration of machine-learning ("artificial intelligence, or AI") image processing techniques to create a viable alternative method for nonverbal communication. The input device is a conventional tablet or smartphone, and the typical user will interact with a single finger, although alternatives are conceivable. The project originates from a study focused on development of next-generation, environmentally-friendly, earth-abundant element semiconductors, in which large amounts of video data needed to be processed in an automated fashion. The underlying framework for the corresponding tool that was developed was adapted to this new, but not unrelated, purpose, so that the communication device adapts to the user and the user's limitations, and not the other way around. We have established that is is feasible to process user-defined abstract input essentially in real time by capitalizing on current generation hardware adapted for AI-based applications. The user trains a neural network, which becomes increasingly more accurate with use. The project will identify meaningful success metrics for target markets so that the corresponding minimum viable product can be compared to existing and competing technologies, as well as identify the primary barriers to technology uptake that can come into play.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

I-Corps项目更广泛的影响/商业潜力源于利用人工智能（AI）强大的图像和模式识别能力，创造一种不需要用户适应新技术固有限制的通信辅助设备。相反，该设备可以适应用户，无论他们遇到什么限制，都可以立即接受。因此，与引入不熟悉的技术相关的重大障碍被消除了，用户-无论潜在的语言沟通障碍-都可以与他人，他们的环境（通过连接的物联网智能设备）以及设备或仪器接口进行交互。特别是对于那些有永久性语言交流障碍的人来说，一种实用的、适应性强的、可行的与他人互动的方法可以减少对照顾者的依赖，使他们能够更充分地融入他们的环境。更详细地了解引入新通信设备的实际障碍也将转化为相关领域，包括具有医疗、危险处置和恶劣环境特征的情况。这个I-Corps项目建立在机器学习（“人工智能，或AI”）图像处理技术成功演示的基础上，为非语言交流创造了一种可行的替代方法。输入设备是传统的平板电脑或智能手机，一般用户将用一个手指进行交互，尽管可以想象其他选择。该项目源于一项以开发下一代环境友好型元素半导体为重点的研究，该研究需要以自动化方式处理大量视频数据。已开发的相应工具的底层框架适应了这个新的（但并非无关的）目的，因此通信设备适应用户和用户的限制，而不是相反。我们已经确定，通过利用适合基于人工智能的应用程序的当前一代硬件，基本上实时处理用户定义的抽象输入是可行的。用户训练一个神经网络，随着使用，它变得越来越精确。该项目将为目标市场确定有意义的成功指标，以便将相应的最小可行产品与现有和竞争技术进行比较，并确定可能发挥作用的技术采用的主要障碍。该奖项反映了美国国家科学基金会的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。