Transformative technology and demonstrator for immersive and naturalistic video communication

沉浸式自然视频通信的变革性技术和演示

• 批准号: 10035113
• 金额: $ 15.94万
• 依托单位: POMMELHORSE LTD
• 依托单位国家: 英国
• 项目类别: Collaborative R&D
• 财政年份: 2022
• 资助国家: 英国
• 起止时间: 2022 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=10035113
• 关键词: Transformative; technology; demonstrator; immersive; naturalistic

It is well understood that when communicating with others, only 50% of the information we share lies in the words and our tone, and the rest in visual cues such as gaze, body language and our expressions. Video communication today falls significantly short in capturing and communicating these visual cues and hence typically falls short when considered as an alternative to meeting face-to-face, especially for more important and critical communications. This is often due to the non-real feeling of video communication, and poor perspective of view.The project involves research, exploration and development of a technology that enables significant improvements to the experience of video communication, by performing real-time manipulation of video streams, that helps capture and communicate these visual cues. The project aims to realise this in a mass market way and have a meaningful impact to all users of video communication. This enables the transition of more face-to-face interactions to digital ones, and in turn reduce the need for unnecessary travel, positively impacting global carbon reduction targets, and help more people achieve greater economic impact without having to co-locate in overpopulated cities. This will be a significant economic benefit to the UK and internationally.The majority of the project work focuses on deep technology and algorithmic development, pushing the state-of-the-art in machine learning based real-time signal processing.

众所周知，在与他人交流时，只有我们共享的50％的信息在于单词和语气，其余的在视觉线索中，例如凝视，肢体语言和我们的表情。今天的视频通信在捕获和传达这些视觉提示时大大落后，因此当被视为面对面的替代方案时，通常会缺乏，尤其是对于更重要和重要的沟通。这通常是由于视频传播的非真实感觉以及对观点的不良视角所致。该项目涉及通过对视频流进行实时操纵的研究，探索和开发，该技术可以对视频传播的体验进行重大改进，这有助于捕获和传达这些视觉提示。该项目旨在以大众市场的方式实现这一目标，并对所有视频传播的用户产生有意义的影响。这使更多的面对面互动过渡到数字互动，进而减少了对不必要的旅行的需求，对全球减少碳减少目标产生积极影响，并帮助更多的人实现更大的经济影响，而无需在人口过剩的城市中共同设置。这将是英国和国际上的重大经济利益。大多数项目工作着重于深度技术和算法开发，从而推动了基于机器学习的实时信号处理的最先进。