Collaborative Research: Tablet PC based Indexed Captioned Searchable Videos for STEM Coursework

计算机科学(31)这个合作项目通过增加索引、字幕和搜索功能来改进对视频信息的访问。该项目的目标是自动生成增强的讲课视频，具有逻辑索引点、文本标题和关键字搜索功能，并根据学生在多个系和机构的本科生STEM课程工作中的学习结果和生活情况评估其有用性。这些带有索引、字幕和可搜索的平板电脑视频(ICS视频)的部署和评估涉及多个校区的计算机科学、生物学和生物化学以及地球科学等30多门不同的课程。此外，自动字幕可以极大地提高主流视频对聋人和听力障碍学生的有用性。当地一所聋哑学校对ICS视频的可及性进行了调查。智力优势：这些ICS视频的主要特点是：1)索引点：录制的视频讲座有一个逻辑索引点列表，每个索引点以快照的形式代表一个视频片段；2)文字说明：整个音频流，包括讲座和学生互动，在单独的面板中以文本形式呈现；3)关键字搜索：显示音频中包含搜索关键字的视频片段，按关键字频率排序；以及4)评估：在一系列学科中对数千名学生进行严格的评估。广泛的影响：该软件是公开提供的，并向任何感兴趣的教育机构提供支持。该项目为STEM课程的在线交付提出了一种新的、强大的模式。ICS视频有可能通过使主流授课材料变得容易获得，对远程教育和聋人教育产生更大的变化。

Computer Science (31)This collaborative project improves access to information in videos by adding indexing, captioning, and search capability. The project goal is to automatically generate enhanced lecture videos, with logical index points, text captions, and keyword search capability, and evaluate their usefulness in light of students' learning outcomes and life situations in undergraduate STEM coursework across multiple departments and institutions. Deployment and evaluation of these Indexed, Captioned, and Searchable Tablet PC videos (ICS videos) spans more than 30 distinct courses in Computer Science, Biology & Biochemistry, and Geosciences at multiple campuses. In addition, automated captioning can dramatically increase the usefulness of main-stream videos for deaf and hearing-impaired students. The accessibility of ICS videos is investigated with a local school for deaf students. Intellectual Merit: Key features of these ICS videos are: 1) Index points: Recorded video lectures have a list of logical index points, each in the form of a snapshot representing a video segment; 2) Text captions: The entire audio stream, including the lecture and student interaction, is presented as text in a separate panel; 3) Keyword search: Video segments that contain search keywords in the audio are displayed, sorted by keyword frequency; and 4) Evaluation: A rigorous evaluation is conducted in a range of disciplines with thousands of students.Broader Impacts: The software is publicly available and support is provided to any interested educational institution. The project proposes a new and powerful model for online delivery of STEM coursework. ICS videos have the potential to make even more dramatic changes to distance education and education for the deaf by making mainstream lecture material accessible.