Distributed audio and video analysis for real-time web communication

点击翻译按钮获取中文摘要

Frozen Mountain Software, a British Columbia based company, provides solutions for real-time audio and video streaming to customers in over 51 countries. Through the use of Web Real Time Communication (WebRTC) based services and software development kits (SDK) Frozen Mountain enables organizations to incorporate advanced features such as WebRTC streaming, screen sharing and shared whiteboards into their applications. Recent developments in distributed audio and video analysis has led to the ability to perform the complex task of deep learning on audio and video. Through this collaboration researchers at Simon Fraser University along with developers at Frozen Mountain will develop novel methods to perform distributed analysis on video and audio streams while preserving the stringent latency constraints of real-time communication. The outcome of this collaboration will develop technology with the ability to perform complex analysis of video and audio streams to facilitate the creation of a suite of tools with use cases such as real-time language translation and sentiment analysis.