SBIR Phase II: Filmmaking for Everyone: Computational Video Editing

SBIR 第二阶段：适合所有人的电影制作：计算视频编辑

• 批准号: 1950115
• 负责人: Genevieve Patterson
• 金额: $ 74.86万
• 依托单位: TRASH INC.
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2020
• 资助国家: 美国
• 起止时间: 2020-04-01 至 2020-11-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1950115&HistoricalAwards=false
• 关键词: SBIR; Phase; II; Filmmaking; Everyone

The broader impacts of this Small Business Innovation Research (SBIR) Phase II project enable improved user-generated video content. Video online platforms have radically changed how people communicate, learn, and inspire. Unfortunately, many potentially inspiring videos are lost or never shared due to an inability to edit them into compelling vignettes. Most tools for editing video are expensive, difficult to learn, and time-consuming. This project’s research enables consumers or nascent businesses to make polished, professional videos with a single phone click through the use of computational cinematography and techniques from deep learning and artificial intelligence (AI). The delivered software solution will produce high-quality edited footage within minutes, compared with a human editor requiring hours. This project combines the analysis of video using computer vision with editing algorithms to empower new creators to participate in this fast-growing medium. This Small Business Innovation Research (SBIR) Phase II project will produce AI-powered software for automatically editing raw video footage into quality short films on a mobile phone platform. The proposed project will integrate advanced computational video manipulation, computer vision, and audio recognition. The prototype AI editor will select relevant content from source footage and synchronize it to music, using only the restricted computational resources of a typical mobile platform. The AI makes decisions based on the video content, the music content, and narrative editing styles learned from a large dataset of similar films. This project will deliver AI-based editing technology that trims and arranges input footage based on the spoken dialogue in the input videos.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

这项小型企业创新研究（SBIR）II期项目的广播公司影响了改进的用户生成的视频内容。视频在线平台已根本改变了人们的交流，学习和启发方式。不幸的是，由于无法将其编辑为引人注目的小插曲，许多潜在的启发视频被丢失或从未分享。大多数用于编辑视频的工具都是昂贵的，难以学习的，而且耗时。该项目的研究使消费者或新生的企业能够通过单个电话点击使用计算摄影和人工智能（AI）的计算摄影和技术来制作精美的专业视频。与需要数小时的人类编辑相比，交付的软件解决方案将在几分钟之内产生高质量的编辑录像。该项目使用计算机视觉和编辑算法将视频分析结合在一起，以使新创作者能够参与这种快速增长的媒介。这项小型企业创新研究（SBIR）II期项目将生产以AI为动力的软件，以自动将原始视频录像编辑到移动电话平台上的优质短片中。拟议的项目将集成高级计算视频操作，计算机视觉和音频识别。原型AI编辑器将仅使用典型移动平台的受限计算资源从源素材中选择相关内容，并将其同步到音乐。 AI根据视频内容，音乐内容以及从类似电影的大数据集中学到的叙事编辑样式做出决定。该项目将提供基于AI的编辑技术，以基于输入视频中的口语对话来修剪和安排输入素材。该奖项反映了NSF的法定任务，并通过使用该基金会的知识分子和更广泛的影响评估标准来通过评估来通过评估来获得珍贵的支持。