A System for Matching Mathematical Formulas Spoken during a Lecture with Those Displayed on Screen for Use in Remote Transcription
A System for Matching Mathematical Formulas Spoken during a Lecture with Those Displayed on Screen for Use in Remote Transcription
复制标题
一种将讲座期间所说的数学公式与屏幕上显示的数学公式进行匹配以用于远程转录的系统
DOI：
10.1007/978-3-642-31522-0_21
复制
发表时间：
2012
期刊：
影响因子：
--
通讯作者：
Hiroki Minagawa
中科院分区：
文献类型：
--
作者：
Yoshinori Takeuchi;Hironori Kawaguchi;Noboru Ohnishi;Daisuke Wakatsuki;Hiroki Minagawa
描述了一种用于提取和匹配在讲座期间口头呈现的数学公式与同时显示在讲座室屏幕上的数学公式的系统。演讲者说出并显示在屏幕上的每个数学公式都被提取出来并显示给抄写员。调查显示，在一个有许多数学公式的讲座中，大约80%的公式都是在屏幕上说出来和指出来的，这意味着该系统可以帮助抄写员正确抄写高达80%的公式。语音识别系统用于从演讲者的语音中提取公式，并且分析棒状指针末端的轨迹的系统用于从投影图像中提取公式。这些信息被组合起来，用于将指向的公式与说出的公式相匹配。在使用实际讲座的测试中，该系统提取并匹配了71.4%的口头和显示的数学公式，并以89.4%的精度将其转录。
A system is described for extracting and matching mathematical formulas presented orally during a lecture with those simultaneously displayed on the lecture room screen. Each mathematical formula spoken by the lecturer and displayed on the screen is extracted and shown to the transcriber. Investigation showed that, in a lecture in which many mathematical formulas were presented, about 80% of them were both spoken and pointed to on the screen, meaning that the system can help a transcriber correctly transcribe up to 80% of the formulas presented. A speech recognition system is used to extract the formulas from the lecturer’s speech, and a system that analyzes the trajectory of the end of the stick pointer is used to extract the formulas from the projected images. This information is combined and used to match the pointed-to formulas with the spoken ones. In testing using actual lectures, this system extracted and matched 71.4% of the mathematical formulas both spoken and displayed and presented them for transcription with a precision of 89.4%.