EAPSI: Audio Attendant: A User Interface for Learning Peripheral Sounds

朝鲜语正字法明确了书面语和口语的关系，便于对书面语进行语音解码。当一个人学习一门语言时，他们学会了在有意义的类别中代表语言的声音。由于诵读困难是一种将声音映射到书面形式的斗争，韩语中诵读困难的表达可能与英语或西班牙语等其他语言有显着不同。该项目建议设计和创建一个用户界面，可在移动的环境中访问，以促进韩语的语音意识。 这项研究将与韩国首尔国立大学人机交互与设计实验室的Joonhwan Lee博士合作进行。该项目将为开发一个轻量级的阅读障碍筛选器提供信息，该筛选器可以由来自世界各地的非专家（免费或以最低成本）部署，以支持阅读障碍患者获得所需的资源。这项工作将推进研究领域，如基于语言的辅助技术，认知障碍者的人机交互，和众包，并将有助于识别患有阅读障碍的个人，无论他们的母语如何，以帮助世界各地的语言障碍人士访问网络。先前的工作强调了一个系统的作用，可以帮助一个人隐式地学习声音类别，特定于目标语言，虽然可能不是一个人的中心？的注意力或他们的词汇的一部分。这个项目将研究如何听觉线索可以在一个上下文适当的方式整合时，平衡线索参加谈话。Building on Edge，et al.，我们将把目标语言的语境词汇学习扩展到声音类别的语境学习。我们将通过调整重要的评分系统（已被发现对于驾驶时的动态视觉显示效果良好）来确定应获取哪些声音类别，以反映学习者的听觉注意力服务？的目标和上下文的重要性。 最后，我们将设计和创建一个用户界面，用于学习上下文音频类别的基础上，这一先前的工作是在一个移动的设置在会话过程中使用。这个奖项下的东亚和太平洋夏季研究所计划支持美国研究生的夏季研究，是由美国国家科学基金会和韩国国家研究基金会共同资助。

The Korean orthography makes clear the relationship between written and spoken language to facilitate phonological decoding of its written form. When a person learns a language, they learn to represent the sounds of the language in meaningful categories. Insofar as dyslexia is a struggle with mapping sounds to their written form, the expression of dyslexia in the Korean language is likely to differ significantly from other languages such as English or Spanish. This project proposes to design and create a user interface accessible in a mobile context that facilitates phonological awareness in the Korean language. The research will be performed in collaboration with Dr. Joonhwan Lee of the Human Computer Interaction and Design Lab at Seoul National University in Korea. The project will inform development of a lightweight dyslexia screener that could be deployed by nonexperts (for free or minimal cost) from around the world to support access to needed resources for a person with dyslexia. The work will advance research areas as language-based assistive technology, human-computer interaction for individuals with cognitive disabilities, and crowdsourcing and will contribute to identifying individuals with dyslexia irrespective of their native language to help make the web accessible to persons with language impairments from around the world.Prior work highlights a role for a system that can help a person implicitly learn sound categories that are specific to a target language, though may not be at the center of a person?s attention or part of their lexicon. This project will investigate how auditory cues can be integrated in a contextually appropriate manner when balancing cues with attending to conversation. Building on Edge, et al., we will extend contextual vocabulary learning of a target language to contextual learning of sound categories. We will determine what sound categories should be acquired by adapting a scoring system of importance that has been found to work well for dynamic visual displays when driving, to an auditory attention service that reflects the learner?s goals and contextual importance. Finally, we will design and create a user interface for learning contextual audio categories based off this prior work to be used in a mobile setting during conversation.This award under the East Asia and Pacific Summer Institutes program supports summer research by a U.S. graduate student and is jointly funded by NSF and the National Research Foundation of Korea.