Autonomous Systems for Sound Integration and GeneratioN (ASSIGN)

声音集成和生成的自主系统 (ASSIGN)

• 批准号: 102904
• 金额: $ 24.22万
• 依托单位: RPPTV LIMITED
• 依托单位国家: 英国
• 项目类别: Collaborative R&D
• 财政年份: 2017
• 资助国家: 英国
• 起止时间: 2017 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=102904
• 关键词: Autonomous; Systems; Sound; Integration; GeneratioN

In immersive media and game sound design, the biggest challenge is the effort required to source the sounds and integrate them with the timeline and visual content. We propose an intelligent decision-making system in a system that generates sounds (with their immersive context) from other sensor data. The Autonomous Systems for Sound Integration and GeneratioN (ASSIGN) project exploits innovative vision-based object recognition technologies to control sound synthesis techniques, so that captured video information can drive sound generation, placement and perspective. This parallels visual effects and computer games, where rendering is driven by high level information, e.g., if a man drops a glass, we see it falling in the virtual world of the game, film or augmented reality. The animation is a property of the object, and sound effects should follow this same paradigm. The business potential is compelling, since ASSIGN could revolutionise the sound design process. Outputs will include a prototype for autonomous sound effect generation, with market analysis, business models and road map to launch a commercial service.

在身临其境的媒体和游戏声音设计中，最大的挑战是需要努力寻找声音来源，并将它们与时间线和视觉内容相结合。我们提出了一个智能决策系统，在一个系统中，从其他传感器数据生成声音(及其身临其境的上下文)。声音集成和生成自主系统(ASSIGN)项目利用创新的基于视觉的对象识别技术来控制声音合成技术，以便捕获的视频信息可以驱动声音的生成、放置和透视。这与视觉效果和电脑游戏类似，在电脑游戏中，渲染是由高级信息驱动的，例如，如果一个人掉了一个杯子，我们可以看到它掉在游戏、电影或增强现实的虚拟世界中。动画是对象的属性，音效应该遵循同样的范例。商业潜力是令人信服的，因为Assign可以彻底改变合理的设计流程。产出将包括自主音效生成的原型，以及推出商业服务的市场分析、商业模式和路线图。