Collaborative Research: Tablet PC-Based Indexed Captioned Searchable Videos for STEM Coursework

计算机科学（31）这个合作项目通过添加索引，字幕和搜索功能来改善对视频信息的访问。该项目的目标是自动生成增强的讲座视频，具有逻辑索引点，文本标题和关键字搜索功能，并根据学生在多个部门和机构的本科STEM课程中的学习成果和生活情况评估其有用性。这些索引，标题和可搜索的平板电脑视频（ICS视频）的部署和评估跨越了多个校区的计算机科学，生物学，生物化学和地球科学的30多个不同的课程。此外，自动字幕可以大大提高主流视频对聋人和听力受损学生的有用性。ICS视频的可访问性进行了调查，与当地学校的聋哑学生。智力优势：这些ICS视频的主要特点是：1）索引点：录制的视频讲座有一个逻辑索引点列表，每个索引点以快照的形式表示一个视频片段; 2）文本标题：整个音频流，包括讲座和学生互动，在单独的面板中以文本形式呈现; 3）关键字搜索：音频中包含搜索关键词的视频片段将被显示，并按关键词频率排序; 4）评估：在数千名学生的一系列学科中进行严格的评估。该软件是公开的，并向任何感兴趣的教育机构提供支持。该项目提出了一个新的和强大的模型，用于在线交付STEM课程。综合服务社的录像有可能使远程教育和聋人教育发生更大的变化，因为它使主流讲座材料可以获得。

Computer Science (31)This collaborative project improves access to information in videos by adding indexing, captioning, and search capability. The project goal is to automatically generate enhanced lecture videos, with logical index points, text captions, and keyword search capability, and evaluate their usefulness in light of students' learning outcomes and life situations in undergraduate STEM coursework across multiple departments and institutions. Deployment and evaluation of these Indexed, Captioned, and Searchable Tablet PC videos (ICS videos) spans more than 30 distinct courses in Computer Science, Biology & Biochemistry, and Geosciences at multiple campuses. In addition, automated captioning can dramatically increase the usefulness of main-stream videos for deaf and hearing-impaired students. The accessibility of ICS videos is investigated with a local school for deaf students. Intellectual Merit: Key features of these ICS videos are: 1) Index points: Recorded video lectures have a list of logical index points, each in the form of a snapshot representing a video segment; 2) Text captions: The entire audio stream, including the lecture and student interaction, is presented as text in a separate panel; 3) Keyword search: Video segments that contain search keywords in the audio are displayed, sorted by keyword frequency; and 4) Evaluation: A rigorous evaluation is conducted in a range of disciplines with thousands of students.Broader Impacts: The software is publicly available and support is provided to any interested educational institution. The project proposes a new and powerful model for online delivery of STEM coursework. ICS videos have the potential to make even more dramatic changes to distance education and education for the deaf by making mainstream lecture material accessible.