End-to-End Perceptual Quality-Of-Experience Measurement and Optimization to Reshape Modern Video Communication Systems

端到端感知体验质量测量和优化重塑现代视频通信系统

• 批准号: RGPIN-2018-04712
• 负责人: Wang, Zhou
• 金额: $ 11.07万
• 依托单位: University of Waterloo
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2022
• 资助国家: 加拿大
• 起止时间: 2022-01-01 至 2023-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=751670
• 关键词: End; Perceptual; Quality; Experience; Measurement

With the arrival of the “era of experience”, enriching and enhancing perceptual experience in consuming digital video content delivered to our TVs, tablets and smartphones has become a central goal of modern video distribution systems. However, recent surveys indicated that the poor video quality-of-experience (QoE) of end users has become a major threat to the video service ecosystem. This presents an urgent and pervasive research challenge, where video distributors require effective mechanisms that can not only help gain instantaneous awareness of the QoE of individual consumers, but also perform strategic optimizations to improve visual QoE in a cost-effective way. The challenge becomes even more pronounced with the growing popularity of novel media format such as ultra high-definition, high dynamic range, wide color gamut, and high frame rate videos, as well as videos created for augmented reality and virtue reality viewing experiences.The long-term research objective of this project is to develop theories and critical technologies for unified end-to-end visual QoE measurement, optimization and intelligence solutions that, if successful, will reshape how videos are distributed through global multimedia distribution networks and meanwhile improve everyone's everyday viewing experience. Specifically, we will develop a series of objective QoE measurement algorithms that produce consistent QoE measures in real-time for various media content types. We will use these novel QoE measures to optimize video distribution system designs, focusing on QoE-driven video coding, streaming and quality enhancement. We will also develop deep learning technologies for QoE assessment and QoE-driven optimizations. Subjective QoE testing will be conducted to validate and improve the performance of the algorithms being developed.The project will be carried out by a world leading research team that has a strong track record of making outstanding research contributions, evidenced by numerous prestigious awards and recognitions as well as publications in top journals and conferences with top citations. The team also has extensive experience collaborating with leading industrial partners and organizations.This project will help strengthen Canada's reputation, impact and global leadership in the field of image processing and multimedia communications. It will also help produce a significant number of HQPs who are expected to join Canada's workforce in academic, industrial and government R&D organizations. The developed technologies will be transferred to Canadian industrial partners' products and services. As such, Canadian companies will benefit significantly for increased revenue and improved competitiveness in the global market, and meanwhile create new jobs in the information technology sector. Thus it has the potential to make a lasting impact on Canada's economy.

随着“体验时代”的到来，丰富和增强传送到我们的电视、平板电脑和智能手机的消费数字视频内容的感知体验已成为现代视频分发系统的中心目标。然而，最近的调查表明，终端用户的视频体验质量（QoE）差已成为视频服务生态系统的主要威胁。这提出了一个紧迫而普遍的研究挑战，视频分发商需要有效的机制，不仅可以帮助获得个人消费者的QoE的即时意识，而且还可以执行战略优化，以提高视觉QoE的成本效益的方式。随着超高清、高动态范围、宽色域、高帧率等新型媒体格式以及增强现实、虚拟现实等观看体验视频的日益普及，这一挑战变得更加突出。本项目的长期研究目标是开发统一的端到端视觉QoE测量理论和关键技术，如果成功，将重塑全球多媒体分发网络中的视频分发方式，同时改善每个人的日常观看体验。具体而言，我们将开发一系列客观的QoE测量算法，为各种媒体内容类型实时生成一致的QoE测量。我们将使用这些新的QoE措施来优化视频分发系统设计，重点关注QoE驱动的视频编码，流媒体和质量增强。我们还将开发用于QoE评估和QoE驱动优化的深度学习技术。该项目将由一个世界领先的研究团队进行，该团队拥有卓越的研究贡献记录，并在顶级期刊和会议上发表了众多着名的奖项和论文，并获得了顶级引用。该团队还拥有与领先的工业合作伙伴和组织合作的丰富经验。该项目将有助于加强加拿大在图像处理和多媒体通信领域的声誉、影响力和全球领导地位。它还将帮助培养大量HQP，预计他们将加入加拿大学术、工业和政府研发组织的劳动力队伍。开发的技术将转移到加拿大工业伙伴的产品和服务中。因此，加拿大公司将大大受益于增加收入和提高在全球市场的竞争力，同时在信息技术部门创造新的就业机会。因此，它有可能对加拿大经济产生持久的影响。