Collaborative Research: Automatic Text-Simplification and Reading-Assistance to Support Self-Directed Learning by Deaf and Hard-of-Hearing Computing Workers

虽然美国缺乏计算和IT专业人员，在这些职业中，聋人和重听人的代表性不足。DHH美国人的英语阅读技能存在很大的差异，他们在IT行业面临挑战，在整个工作生涯中需要定期提高技能。 这项跨学科的研究将侧重于研究自动文本简化技术作为阅读援助，以帮助DHH个人跟上快速变化的技术，通过自我导向的学习，在正式的课堂环境之外。 研究团队由自然语言处理（NLP），人机交互（HCI），无障碍和聋人STEM教育研究方面的专家组成。为该项目开发的资源和技术将适用于其他语言和文本域（例如，为非专业读者提供医疗信息），使广大人群受益（例如儿童、非母语人士、有阅读障碍的人）。针对特定用户群体的先前文本简化研究集中在初步数据收集或经典NLP方法，而且几乎没有人机交互研究探索过阅读辅助系统的设计方案。该项目将填补这一关键的研究空白，并将调查提高DHH计算工作者技能的学习和阅读辅助需求，影响阅读辅助工具可用性的设计参数，针对特定读者群体和技术类型的文本简化的新培训数据和方法，自动和基于人类的评估方法，以及这些工具对教学法学习的影响。这些方法将包括与DHH计算工作者的访谈和调查研究，设计变体的原型设计和测试，并行简化语料库的创建，DHH个人对词典和文本的可读性注释，领域适应的NLP研究和基于语法的神经机器翻译用于文本简化，与DHH学生和国家聋人技术研究所（NTID）计算机相关课程的应届毕业生一起观察原型的真实部署该奖项反映了NSF的法定使命，并通过使用基金会的知识价值和更广泛的影响审查标准进行评估，被认为值得支持。

While there is a shortage of computing and IT professionals in the U.S., there is underrepresentation of people who are Deaf and Hard of Hearing (DHH) in such careers. There is great diversity in the English reading skills among DHH Americans, who face challenges in the IT industry where regular upskilling is required throughout the working career. This interdisciplinary research will focus on studying automatic text-simplification technologies as reading assistance to help DHH individuals keep up with rapidly changing technologies through self-directed learning, outside of a formal classroom setting. The research team consists of experts in natural language processing (NLP), human-computer interaction (HCI), accessibility, and Deaf STEM education research. The resources and technologies developed for this project will be adaptable to other languages and text domains (e.g. medical information for lay readers), benefiting a wide range of populations (e.g. children, non-native speakers, people with reading disabilities).Prior text-simplification research for specific user groups focused on preliminary data collection or classical NLP methods, and little HCI research has explored design options for reading-assistance systems. This project will fill this critical gap in research and will investigate the learning and reading-assistance needs of upskilling DHH computing workers, design parameters influencing usability of reading-assistance tools, new training data and methods for text simplification tailored to specific reader groups and technical genres, automatic and human-based evaluation methods, and the impact of such tools on heutagogical learning. The methods will include interview and survey research with DHH computing workers, prototyping and testing of design variations, creation of parallel simplification corpora, readability annotation of lexicon and texts by DHH individuals, NLP research on domain adaptation and syntax-based neural machine translation for text simplification, and observation of real-world deployment of a prototype with DHH students and recent graduates from computing-related programs at the National Technical Institute for the Deaf (NTID).This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.