Multimedia Analysis for Unsupervised Dubbing In Entertainment (MAUDIE)

随着目前在世界各地运营的众多流媒体视频服务的提供，故事片和电视剧正在被比以往任何时候都更多的观众所喜爱。这导致了对使用字幕和配音将字幕改编成多种语言的高质量专业服务的需求显著增加。在字幕中，翻译的文本显示在图片上，而配音中，屏幕上的演员的声音被外语演讲者取代。内容所有者采取的最流行的方法是字幕，因为这平均占为相同内容配音成本的10%。然而，消费者受众变得越来越挑剔，流媒体视频服务提供商发现，越来越有必要为越来越多的国家提供高质量的配音。媒体娱乐服务联盟(MESA)最近的研究表明，2016年欧洲、中东和非洲地区在配音上花费了约14亿美元，预计这一数字每年将以10%以上的速度增长。传统上，配音主要由在每个国家运营的独立、专门的配音工作室完成。这些设施提供录音空间、控制室、设备和一批内部专家，以便开展项目工作。每个这样的录音棚都聘请了配音演员，这些演员大多住在附近，因此可以参加录音会议，而不会产生大量的旅行和生活费。随着最近需求的增长，由于这些专门的配音工作室及其关键员工的有限，娱乐业现在面临着用于创作外语配音的能力和人才的严重短缺。2017年，该财团的合作伙伴和老牌字幕服务提供商Zoo Digital开始提供一种新的颠覆性配音方法，利用云计算来显著提高行业能力。尽管如此，仍然存在一个根本的制约因素，因为监督每个录音会话所需的有经验的配音导演的可获得性有限。该项目将使用机器学习研究的最新进展，以便使大部分配音导演的角色自动化。这将意味着配音人员将能够在没有监督的情况下执行他们的工作，并由自动化软件近乎实时地提供对他们的计时准确性和表现的批判性评估。这将为大幅增加高质量配音能力铺平道路，以满足不断扩大的行业需求。“

"With the availability of numerous streaming video services that now operate around the world, feature films and TV series are being enjoyed by much larger audiences than ever before. This has led to a significant surge in demand for high quality, professional services to adapt titles into multiple languages using both subtitling, where translated text is displayed over the picture, and dubbing, where the voices of on-screen actors are replaced by foreign language speakers.The most popular approach taken by content owners is subtitling, since this is on average 10% of the cost of dubbing the same content. However, consumer audiences are becoming more and more discerning, and the providers of streaming video services are finding that it is increasingly necessary to provide high quality voice dubs for a growing number of countries. Recent research by the Media Entertainment Services Alliance (MESA) indicates that around $1.4bn was spent in EMEA on dubbing in 2016, a figure that is expected to grow at a rate of more than 10% annually.Traditionally, dubbing has been fulfilled predominantly by independent, dedicated dubbing studios that operate in each country. These provide recording spaces, control rooms, equipment and a staff of in-house specialists to work on projects. Each such studio engages the services of voice actors, most of whom reside nearby and can therefore attend recording sessions without incurring significant travel and subsistence expenses.With the recent growth in demand, the entertainment industry now faces a significant shortfall in capacity and talent used to create foreign language dubs due to the limited availability of these dedicated dubbing studios and their key staff.In 2017, ZOO Digital, a partner in the consortium and established provider of subtitling services, began offering a new disruptive approach to dubbing that utilises cloud computing to significantly increase industry capacity. Despite this, there remains a fundamental constraining factor due to the limited availability of experienced _dubbing directors_ who are needed to oversee each recording session.This project will use recent advances in machine learning research in order to automate much of the role of the dubbing director. This will mean that voice actors will be able to perform their work unsupervised, with critical appraisal of their timing accuracy and performance provided in near-real time by automation software. This will pave the way for a substantial increase in capacity for high quality dubbing to meet the expanding industry requirements."