I-Corps: Multimedia Augmented Reality Vocabulary Instruction

这个i-Corps项目的更广泛的影响/商业潜力是开发一个增强现实(AR)软件解决方案，该解决方案使用基于证据的最佳学习实践来提供动态的、互动的、针对学习者的词汇教学。建议的技术是一种可访问的模块化解决方案，适用于幼儿和成人学习者，无论其识字程度如何。美国有500万儿童被指定为英语学习者，全球有15亿英语作为第二语言的学生，目前有超过3亿数字语言学习工具的用户。拟议的技术通过使用AR和人工智能(AI)提高动机和学习成果，提供多种语言组合的可用性，并为来自不同经济背景的儿童和成年人提供机会，具体满足了这些客户群体的需求。拟议的语言学习系统通过向英语学习者提供互动的、差异化的、带有第一语言支持的学术词汇教学，有可能缩小美国语言背景不同的儿童在历史上普遍存在的成就不平等。该工具可能为支持全球语言学习提供基于研究的、技术增强的解决方案。该i-Corps项目基于语言学习软件解决方案的开发，该解决方案具有增强现实(AR)和人工智能(AI)，用于沉浸式、交互式学习和自适应、深度学习。拟议的技术提供了一种新颖的语言学习解决方案，不需要教师监督，可以与课程保持一致，适合不识字的用户，并提供多种语言的内容。这项拟议的技术旨在将认知人工智能与文本的视觉识别以及语音和说话人识别结合起来。AR平台还可能为语言学习提供新的人工智能培训模式，重点是小学生学习英语。此外，语音和说话人识别能力可以允许进一步改进语言学习者语音的模型。我们的目标是一种技术增强的语言习得解决方案，具有针对学习者的差异化教学、动态适应性库和第一语言特定材料。根据原则证明、用户接受度和阿尔法原型研究的结果，核心技术对四岁以下的儿童来说是用户友好和有效的。此外，这项技术可能会增加对新兴双语和语言习得的科学理解。这一奖项反映了NSF的法定使命，并通过使用基金会的智力优势和更广泛的影响审查标准进行评估，被认为值得支持。

The broader impact/commercial potential of this I-Corps project is the development of an Augmented Reality (AR) software solution that delivers dynamic, interactive, learner-specific vocabulary instruction using evidence-based best practices for learning. The proposed technology is an accessible, modular solution that is suitable for young children and adult learners, regardless of literacy. There are 5 million US children designated as English Language Learners, 1.5 billion English as a Second Language students worldwide, and over 300 million current users of digital language learning tools. The proposed technology specifically addresses the needs of these customer segments by increasing motivation and learning outcomes using AR and artificial intelligence (AI), providing availability in multiple language combinations, and providing access for children and adults from different economic backgrounds. The proposed system of language learning has the potential to narrow historically pervasive achievement inequities for children from linguistically diverse backgrounds in the US by delivering interactive, differentiated, academic vocabulary instruction with first language support to English Language Learners. The tool may provide a research-based, technology-enhanced solution for supporting language learning worldwide.This I-Corps project is based on the development of a language learning software solution with Augmented Reality (AR) for immersive, interactive learning and Artificial Intelligence (AI) for adaptive, deep learning. The proposed technology provides a novel language learning solution that does not require teacher supervision, can align with curricula, is suitable for users who cannot read, and offers content in many languages. The proposed technology is designed to incorporate cognitive AI with vision recognition for text as well as speech and speaker recognition. The AR platform also may provide new AI training models for language acquisition with a focus on primary school aged children learning English. In addition, speech and speaker recognition capacities may allow further refinement of models for language learner speech. The goal is a technology-enhanced language acquisition solution with learner-specific differentiated instruction, dynamic adaptive libraries, and first language specified materials. Based on findings from proof of principle, user acceptance, and alpha prototype research, the core technology is user friendly and effective for children as young as four years old. Further, this technology may increase scientific understanding of emerging bilingualism and language acquisition.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.