Video Assisted Speech Technology to enhance functional language abilities in individuals with Autism Spectrum Disorder

自闭症谱系障碍(ASD)是一种神经发育的沟通障碍，导致功能语言和 超过350万美国人受到行为迟缓的影响。这些延迟因出现的症状的严重程度而异 ASD，但往往会导致言语受限和沟通困难。在语言习得的同时，口语运动 协调是言语产生的重要组成部分。目前的临床技术已经显示出不同程度的疗效 提高函数式语言能力。大多数技巧都遵循一个类似演练的过程，让孩子们重复 各种声音和短语，直到它们被保留下来。然而，这样的过程可能需要20多次治疗。 表现出进步，然后可能只集中在说话的一个方面。这大大限制了语言和 学生将获得的社交技能。为了提高这些疗程的疗效，必须开发新的技术。 提供最有效的教育体验。视频辅助语音技术(Vavast)是一种使用 一个特写的嘴巴模型的视频，同时用它说话。而不是向个人呈现静态的 首音素的照片，整个口头动作序列可以通过视频记录顺序呈现 产生连接语音的口面部部分，将最佳实践、视频建模和识字与 听觉线索为词汇、词汇组合和交流的发展提供了前所未有的支持。 在这份SBIR第一阶段计划中，iTreatment将为ASD学生开发个性化的教育体验 通过创建一个基于虚拟现实(VR)的大型节目来刺激参与和演讲制作实践。 VR作为一种治疗技术提供了几个好处：克服了感觉困难，更有效地推广 信息，采用视觉学习，并提供个性化治疗。当用户通过 计划，他们将沉浸在一个积极主动的环境中，在那里他们将全神贯注于持续的内容。 不是向个体呈现初始音素的静态照片，而是整个口腔动作序列 可以通过产生连接语音的口面部区域的VR模型片段顺序呈现，结合最佳 实践、视频建模、音乐治疗、识字与听觉线索的结合为发展提供了前所未有的支持 词汇、单词组合和交流。这项创新将是一个逼真的VR嘴巴的视频系列， 将需要在平板电脑或智能手机上使用应用程序，VR护目镜和骨传导耳机。成立为法团 将庞大的系统引入特殊教育课堂将有助于ASD儿童提高他们的功能和社交能力 沟通能力。VR系统将教给他们各种动作和单词的制作技能，这将使他们的 词汇，阅读技能，对演讲的理解，以及整体的功能语言使用。通过在标准基础上构建 治疗技术，这款产品将为ASD患者提供一个机会，通过增加 他们的语言能力，这将使他们能够建立社交网络和处理日常生活事件。

Autism Spectrum Disorder (ASD) is a neurodevelopmental communication disorder resulting in functional language and behavioral delays affecting over 3.5 million Americans. These delays vary with the severity of symptoms that present in ASD but often result in limited speech and increased communication challenges. Alongside linguistic acquisition, oral motor coordination is a crucial part of speech production. Current clinical techniques have shown varying degrees of efficacy in improving functional language proficiency. Most techniques follow a drill-like procedure, where the child is made to repeat various sounds and phrases until they are retained. However, such a process requires potentially over twenty therapy sessions to show improvement which may then only be focused on one aspect of speech. This significantly limits the linguistic and social skills a student will acquire. To improve the efficacy of these therapy sessions, new technology must be developed to provide the most effective educational experience. Video-assisted speech technology (VAST) is a method of using a video of a close-up model of the mouth and speaking simultaneously with it. Rather than present the individual with a static photograph of the initial phoneme, the entire sequence of oral movements can be presented sequentially via video-recorded segments of the orofacial area producing connected speech, combining best practices, video modeling, and literacy with auditory cues to provide unprecedented support the development of vocabulary, word combinations and communication. In this SBIR Phase I proposal, iTherapy will develop a personalized educational experience for students with ASD by creating a virtual reality (VR) based VAST program to stimulate engagement and speech production practice. VR offers several benefits as a therapy technique: overcoming sensory difficulties, more effectively generalizing information, employing visual learning, and providing individualized treatment. As a user moves through the stages of the program, they will be immersed in a proactive environment where they will engross themselves with continuous content. Rather than present the individual with a static photograph of the initial phoneme, the entire sequence of oral movements can be presented sequentially via VR-modelled segments of the orofacial area producing connected speech, combining best practices, video modeling, music therapy, and literacy with auditory cues to provide unprecedented support the development of vocabulary, word combinations and communication. The innovation will be a video series of a realistic VR mouth which will require the use of an app on a tablet or a smartphone, VR goggles, and bone conduction headphones. The incorporation of the VAST system into special education classrooms will help children with ASD to enhance their functional and social communicative abilities. The VR system will teach them various motor and word production skills which will grow their vocabulary, reading skills, understanding of speech, and functional language usage as a whole. By building upon standard therapy techniques, this product will provide those with ASD an opportunity to enhance their quality of life by increasing their speech abilities which will enable them to build social networks and handle the events of daily life.