A Specialized Automatic Speech Recognition and Conversational Platform to Enable Socially Assistive Robots for Persons with Mild-to-Moderate Alzheimer's Disease and Related Dementia

专门的自动语音识别和对话平台，为患有轻度至中度阿尔茨海默病和相关痴呆症的人提供社交辅助机器人

• 批准号: 10230460
• 负责人: Victor Wang
• 金额: $ 150.27万
• 依托单位: CARE.COACH CORPORATION
• 依托单位国家: 美国
• 财政年份: 2019
• 资助国家: 美国
• 起止时间: 2019-07-01 至 2022-06-30
• 项目状态: 已结题
• 来源: https://reporter.nih.gov/project-details/10230460
• 关键词: Age; Alzheimer' s Disease; Alzheimer' s disease patient; Alzheimer' s disease related dementia; Artificial Intelligence; Automation; Behavior; Caregivers; Caring; Clinical Research; Communication; Community Hospitals; Computer software; Computers; Contracts; Data; Data Set; Delirium; Dementia; Dependence; Devices; Disease; Elderly; Exhibits; Expert Systems; Family; Family member; Feeds; Frequencies; Generations; Genetic Transcription; Goals; Home environment; Hospitals; Hour; Human; Hybrids; Individual; Institutes; Intervention; Jamaica; Label; Language; Licensing; Loneliness; Manuals; Measures; Medical center; Modeling; Monitor; Natural Language Processing; Network-based; Neural Network Simulation; Neurologic; Noise; Patients; Persons; Phase; Population; Price; Production; Protocols documentation; Reaction; Self Care; Semantics; Small Business Innovation Research Grant; Social Interaction; Social support; Speech; Stress; Study Subject; System; Techniques; Technology; Television; Text; Therapeutic; Training; Tremor; United States; Universities; Validation; Visual; Voice; Washington; Work; World Health Organization; age related; aging population; automated speech recognition; care providers; cost; deep neural network; depressive symptoms; design; evidence base; falls; health plan; human subject; human-in-the-loop; improved; next generation; older patient; patient engagement; patient response; phrases; recruit; research study; response; restraint; satisfaction; skills; social assistive robot; speech recognition; speech synthesis; success; usability

Abstract 1 in 3 seniors in the United States dies with dementia, of which Alzheimer’s disease (AD) is the most common form. AD patients suffer from decreased ability to meaningfully communicate and interact, which causes significant stress and burden for both professional caregivers and family members. Socially assistive robots (SARs) have been designed to promote therapeutic interaction and communication. Unfortunately, artificial intelligence (AI) has long been challenged by the speech of elderly persons, who exhibit age-related voice tremors, hesitations, imprecise production of consonants, increased variability of fundamental frequency, and other barriers that can be exacerbated by the neurological changes associated with AD, further complicated by common environmental noises such as the ceiling fan, television, etc. Because of the resulting poor real-world speech and language understanding by available SAR technologies, scarce human caregivers are often required to guide AD patients through SAR interactions, limiting SARs to small deployments, mostly as part of research studies. Unlike existing approaches relying purely on AI, care.coach™ is developing a SAR-like avatar that converses with elderly and AD patients through truly natural speech. Each avatar is controlled by a 24x7 team of trained human staff who can cost-effectively monitor and engage 12 or more patients sequentially (2 simultaneously) through the audio/visual feeds from the patient’s avatar device. The staff communicate with each patient by sending text commands which are converted into the avatar’s voice through a speech synthesis engine. The staff contribute to the system their human abilities for speech and natural language processing (NLP) and for generating free-form conversational responses to help patients build personal relationships with the avatar. The staff are guided by a software-driven expert system embedded into their work interface, which is programmed with evidence-based prompting and protocols to support healthy behaviors and self-care. This SBIR Fast-Track project will leverage the unique data generated by our human- in-the-loop platform to develop new ASR capabilities, enabling fully automatic conversational protocols to engage and support AD patients without human intervention. We aim in Phase I to leverage our unique prior work dataset to train an automatic speech recognition (ASR) engine to enable the understanding of certain types of elderly and AD patient speech more successfully than any currently available engine. We aim in Phase II to incorporate this new engine along with an NLP module into our existing human-in-the-loop avatar system, recruiting a population of AD patients to further train and validate with during a 2-year human subjects study so that we can demonstrate full automation of a significant portion of our avatar conversations with mild- to-moderate level AD patients. Thus, we will improve the commercial scalability of our avatars, while validating our new ASR/NLP engine as the most accurate platform for enabling the next generation of AD-focused SARs.

摘要