Research and Developing in Teaching Environment using Board Writing for the Visually Impaired

首先，我们开发了手写字符识别系统，该系统工作在Windows个人计算机上的虚拟黑板上。然而，该系统的输入区域设置在个人计算机的显示器上，它工作在连接了传感元件的真正的黑/白板上。该系统识别用于高等数学/物理教育课程中的汉字汉字和数学表达式。识别速度足以满足实时使用的要求。然而，日语文本是在水平和垂直方向上书写的，该系统只分析水平书写。此外，每个日语字符都应该写一个固定的框架，数学表达式也写在同一个框架中。其次，针对教科书、助学书、试卷和自然科学领域的版面分析，提出了一种文档模型描述方法。每个区域都包含数学表达式。研究了用于版面分析的版面元素(文本、图形、表格、数学表达式和文档逻辑结构)，并开发了版面分析识别系统。考虑到其他应用程序，我们选择了XML文件作为内部文件结构和输出文件。如今，PDF正在成为一种流行的数字文件，因此我们开发了针对视障人士的科学PDF文件的文本信息提取系统。在不久的将来，这项技术将被应用于从PDF中提取图形，并将提取的图形转换为视障人士的触觉数据。但前两项都在研究和开发中，我们与国际委员会共同定义了国际标准盲文编码UEBC。UEBC于2004年4月被采用，我们考虑了与我们开发的系统和UEBC的一致性，我们的内部格式采用了新的代码定义。

First, we developed the hand-write character recognition system, which works on a virtual black board on the Windows personal computer. However the input area of this system set on the display of the personal computer, it works on a real black/white board which is attached a sensing element. This system recognizes Chinese character called Kanji and mathematical expressions, which is used in higher mathematic/physic education courses. The recognition speed is sufficient for real time use. However Japanese text is written in horizontal and vertical direction, this system analyzes only horizontal writing. Also each Japanese character should be written a fixed frame, the mathematical expressions are written in a same frame. So there are little restrictions when we write same mathematical expressions.Second, we developed document model description method for layout analysis about schoolbook, study-aid book and examination papers and natural science area. Each area contains mathematical expressions. We researched layout elements (text, figure, table, mathematical expressions, and logical structure of document) for layout analysis, and developed its recognizing system. We choose XML file as an internal file structure and an output file considering other application programs. Nowadays, PDF is becoming a popular digital file, so we developed extracting text information system from scientific PDF file for visually impaired. Near the future, this technology is applied for extracting figures from PDF, and extracted figures are translated tactile data for visually impaired.However, previous two items are research and developing, we defined international standard braille code called UEBC with international committee. The UEBC is adapted in April 2004, we considered consistency with our developed systems and UEBC, a new code definition is applied our internal format.