Research on Development of the Barrier-Free Math Editor

我们研究如何访问数学信息的帮助下，语音输出（日语和英语）。在此基础上，开发了将语音输出功能纳入日语和英语版本的数学文档编辑器“InftyEditor”的接口。日本和英语国家的视力残疾人不仅可以使用它们，还可以自己编写或编辑科学文件，包括带有语音输出的数学表达式。本文还对数学表达式的语音输入系统进行了基础研究，研究了基于Unicode的统一盲文编码的设计方法，使其能够在统一的编码系统中处理从普通文本到高技术文档的所有领域。在此基础上，开发了第二版“日本统一盲文代码”。该系统与“统一英语盲文编码”完全兼容，可以实现盲文文档与印刷文档的双向计算机翻译，还可以开发数学表达式的手写输入接口和科技文档的OCR系统。使用我们的数学OCR系统“Infty Reader”，可以识别包括特殊字符和符号在内的技术材料。识别结果可转换为XML、MATHML、HTML、PDF等多种无障碍格式。视障人士可使用我们的数学编辑器“Chatty Infty.“通过结合Chatty Infty和Infty Reader，我们构建了一个系统，允许视力残疾人自己访问印刷的科学文件。此外，使用触觉显示器或盲文阅读器，我们实现了一个新的环境，在这个环境中，视力残疾人可以在没有视力正常人帮助的情况下纠正识别错误。

We study how to access mathematical information with the aid of speech output (in Japanese and English) only. Based on that, interfaces to incorporate a function of speech output into the Japanese and English versions of our mathematical document editor; "InftyEditor" were developed. Using them, visually disabled persons in Japan and English-speaking countries not only can access but also can write or edit scientific documents including math expressions with speech output for themselves. A basic research on speech-input system for math expressions was also done.We study new methodology to design the unified Braille code based on the Unicode so that it can consistently treat all areas ranging from ordinary texts to highly technical documents in the unique code system. Based on it, the second version of "the Unified Japanese Braille Code" was developed. It completely compatible with "the Unified English Braille Code" and allows us to develop the bidirectional computerized-translation system between documents in Braille and in print.The handwriting-input interface for math expressions and the OCR system for scientific documents were also developed. Using our math OCR system, "Infty Reader," one can recognize technical materials including special characters and notations. The recognition results can be converted into various accessible formats such as XML,MATHML,HTML,PDF and so on. In particular, visually disabled persons can access ones in XML format by using our math editor with speech output, "Chatty Infty."By combining Chatty Infty and Infty Reader, we constructed a system to allow visually disabled persons to access scientific documents in print for themselves. Furthermore, using a tactile display or a Braille embosser, we realize a new environment in which visually disabled persons can correct recognition errors without any help by sighted people.