Research on Development of the Barrier-Free Math Editor

我们研究如何在语音输出（日语和英语）的帮助下获取数学信息。在此基础上，在数学文档编辑器的日语和英语版本中加入语音输出功能的接口；“InftyEditor”被开发出来。使用它们，日本和英语国家的视障人士不仅可以访问，而且可以编写或编辑科学文件，包括数学表达式，并为自己提供语音输出。对数学表达式语音输入系统进行了基础研究。我们研究了基于Unicode的统一盲文编码设计的新方法，使其能够在统一的编码系统中一致地处理从普通文本到高技术文档的所有领域。在此基础上，制定了第二版《日文统一盲文码》。它与《统一英文盲文编码》完全兼容，使我们能够开发盲文文件与印刷文件之间的双向计算机翻译系统。开发了数学表达式的手写输入界面和科学文献的OCR系统。使用我们的数学OCR系统“Infty Reader”，可以识别包括特殊字符和符号在内的技术材料。识别结果可以转换为各种可访问的格式，如XML、MATHML、HTML、PDF等。特别是，视障人士可以使用带有语音输出的数学编辑器“Chatty Infty”来访问XML格式的文本。通过结合Chatty Infty和Infty Reader，我们构建了一个系统，使视障人士能够自己访问印刷的科学文献。此外，利用触觉显示器或盲文压花机，我们实现了一个新的环境，视障人士可以在没有任何视力正常的人的帮助下纠正识别错误。

We study how to access mathematical information with the aid of speech output (in Japanese and English) only. Based on that, interfaces to incorporate a function of speech output into the Japanese and English versions of our mathematical document editor; "InftyEditor" were developed. Using them, visually disabled persons in Japan and English-speaking countries not only can access but also can write or edit scientific documents including math expressions with speech output for themselves. A basic research on speech-input system for math expressions was also done.We study new methodology to design the unified Braille code based on the Unicode so that it can consistently treat all areas ranging from ordinary texts to highly technical documents in the unique code system. Based on it, the second version of "the Unified Japanese Braille Code" was developed. It completely compatible with "the Unified English Braille Code" and allows us to develop the bidirectional computerized-translation system between documents in Braille and in print.The handwriting-input interface for math expressions and the OCR system for scientific documents were also developed. Using our math OCR system, "Infty Reader," one can recognize technical materials including special characters and notations. The recognition results can be converted into various accessible formats such as XML,MATHML,HTML,PDF and so on. In particular, visually disabled persons can access ones in XML format by using our math editor with speech output, "Chatty Infty."By combining Chatty Infty and Infty Reader, we constructed a system to allow visually disabled persons to access scientific documents in print for themselves. Furthermore, using a tactile display or a Braille embosser, we realize a new environment in which visually disabled persons can correct recognition errors without any help by sighted people.