A Study on Supporting Transcribers for Remote PC Transcription

点击翻译按钮获取中文摘要

In this research, we propose a method solving the problem of captioning when an instructor utters a mathematical formula with different interpretations, using remote PC transcription system. We adopt an approach to extract an image corresponding uttered mathematical formula from lecture slides. This method uses a fact that a instructor usually points a mathematical formula on the slide when he/she utters it. We use speech recognition software to detect pronunciations of mathematical formula. Then, we extract pointing gestures from the images of the lecture. We have conducted experiments by using recorded audio-visual signals from a real lecture. Experimental result shows that recall ratio is about 70% and relevance ratio 91%.