Multimedia Analysis for Unsupervised Dubbing In Entertainment (MAUDIE)

“随着现在世界各地运营的众多流媒体视频服务的可用性，故事片和电视剧的观众比以往任何时候都多。这导致了对高质量、专业服务的需求大幅增长，这些服务可以通过字幕和配音将字幕翻译成多种语言。字幕翻译是将翻译后的文本显示在画面上，配音则是将屏幕上的演员的声音换成讲外语的人。内容所有者最常用的方法是字幕翻译，因为这平均占相同内容配音成本的10%。然而，消费者观众变得越来越挑剔，流媒体视频服务提供商发现越来越有必要为越来越多的国家提供高质量的语音配音。媒体娱乐服务联盟（梅萨）最近的研究表明，2016年EMEA地区的配音支出约为14亿美元，预计这一数字将以每年10%以上的速度增长。传统上，配音主要由独立的、专门的配音工作室在每个国家开展业务。这些设施提供录音空间、控制室、设备和内部专家工作人员，以开展项目。每一个这样的工作室都有配音演员的服务，他们中的大多数人都住在附近，因此可以参加录制会议，而不需要承担大量的旅行和生活费用。随着最近需求的增长，娱乐行业现在面临着用于创建外语配音的能力和人才的严重短缺，因为这些专门的配音工作室及其主要工作人员的数量有限。作为该联盟的合作伙伴和字幕服务的成熟提供商，开始提供一种新的颠覆性的配音方法，利用云计算来显着提高行业能力。尽管如此，由于需要监督每个录制会话的经验丰富的配音导演有限，仍然存在一个基本的限制因素。该项目将使用机器学习研究的最新进展，以自动化配音导演的大部分角色。这意味着配音演员将能够在无人监督的情况下完成工作，自动化软件将近乎实时地对他们的计时准确性和表现进行严格评估。这将为大幅增加高质量配音能力铺平道路，以满足不断扩大的行业需求。"

"With the availability of numerous streaming video services that now operate around the world, feature films and TV series are being enjoyed by much larger audiences than ever before. This has led to a significant surge in demand for high quality, professional services to adapt titles into multiple languages using both subtitling, where translated text is displayed over the picture, and dubbing, where the voices of on-screen actors are replaced by foreign language speakers.The most popular approach taken by content owners is subtitling, since this is on average 10% of the cost of dubbing the same content. However, consumer audiences are becoming more and more discerning, and the providers of streaming video services are finding that it is increasingly necessary to provide high quality voice dubs for a growing number of countries. Recent research by the Media Entertainment Services Alliance (MESA) indicates that around $1.4bn was spent in EMEA on dubbing in 2016, a figure that is expected to grow at a rate of more than 10% annually.Traditionally, dubbing has been fulfilled predominantly by independent, dedicated dubbing studios that operate in each country. These provide recording spaces, control rooms, equipment and a staff of in-house specialists to work on projects. Each such studio engages the services of voice actors, most of whom reside nearby and can therefore attend recording sessions without incurring significant travel and subsistence expenses.With the recent growth in demand, the entertainment industry now faces a significant shortfall in capacity and talent used to create foreign language dubs due to the limited availability of these dedicated dubbing studios and their key staff.In 2017, ZOO Digital, a partner in the consortium and established provider of subtitling services, began offering a new disruptive approach to dubbing that utilises cloud computing to significantly increase industry capacity. Despite this, there remains a fundamental constraining factor due to the limited availability of experienced _dubbing directors_ who are needed to oversee each recording session.This project will use recent advances in machine learning research in order to automate much of the role of the dubbing director. This will mean that voice actors will be able to perform their work unsupervised, with critical appraisal of their timing accuracy and performance provided in near-real time by automation software. This will pave the way for a substantial increase in capacity for high quality dubbing to meet the expanding industry requirements."