Checksum-aided video error correction for real-time, streaming and broadcast video applications

适用于实时、流媒体和广播视频应用的校验和辅助视频纠错

• 批准号: RGPIN-2017-05412
• 负责人: Coulombe, Stéphane
• 金额: $ 2.4万
• 依托单位: École de technologie supérieure
• 依托单位国家: 加拿大
• 项目类别: Discovery Grants Program - Individual
• 财政年份: 2020
• 资助国家: 加拿大
• 起止时间: 2020-01-01 至 2021-12-31
• 项目状态: 已结题
• 来源: https://www.nserc-crsng.gc.ca/ase-oro/Details-Detailles_eng.asp?id=710792
• 关键词: Checksum; aided; video; error; correction

In the recent years, we have witnessed an impressively rapid deployment of video devices, applications and systems, and the growth of video will only intensify in the coming years with emerging technologies such as 4K/8K Ultra HD formats, video devices for remote monitoring and control of machinery, transport and healthcare, virtual and augmented reality, and other devices resulting from the emerging Internet of Things. However, transmission errors over unreliable networks (e.g. wireless and satellite) cause significant visual impairments or dramatically reduce the effectiveness of networks (e.g. by causing retransmissions). Such errors significantly degrade the user's quality of experience (QoE) in most real-time and near real-time video applications. The main objective of this research program is to investigate low-complexity solutions to the problem of video error correction, which can be realistically integrated into communication systems. Specifically, the applicant and his team will study a new application layer video error correction approach, which has the potential to fully repair damaged video packets under reasonable error conditions. This approach consists in exploiting the protocol's checksum information, currently used only to detect errors, to correct errors. The applicant and his team will achieve the main objective through three research activities. First, in the context of real-time video, they will investigate how the checksum information can be exploited in a list decoding approach, which attempts to decode various candidate corrected video packets until a valid (decodable) packet is found, to dramatically reduce the number of candidates to consider and, therefore, the computational complexity. Second, in the context of near-real-time video streaming, they will investigate how the checksum can be used to limit the number of retransmissions by combining the information of a damaged packet with its retransmitted damaged version(s) to produce a repaired packet. Finally, in the context of video broadcasting using forward error correction (FEC) (redundant information), they will investigate how the checksum can be used in conjunction with FEC to produce a repaired packet. The technologies conceived in this research program will be validated on current as well as future video standards. The advances provided by this research will bring significant improvements in the quality and efficiency of video services and enable the emergence of unprecedented media experiences. As for their previous projects, Canada will strongly benefit from the intellectual property and commercialization of these technologies and from the training of highly qualified personal in the fast growing field of video processing and applications.

近年来，我们目睹了视频设备、应用程序和系统的快速部署，并且随着 4K/8K 超高清格式、用于远程监控和控制机械、运输和医疗保健的视频设备、虚拟和增强现实以及新兴物联网产生的其他设备等新兴技术的出现，视频的增长只会在未来几年加剧。然而，不可靠网络（例如无线和卫星）上的传输错误会导致严重的视觉障碍或显着降低网络的有效性（例如导致重新传输）。在大多数实时和近实时视频应用中，此类错误会显着降低用户的体验质量 (QoE)。 该研究计划的主要目标是研究视频纠错问题的低复杂度解决方案，该解决方案可以实际集成到通信系统中。具体来说，申请人和他的团队将研究一种新的应用层视频纠错方法，该方法有可能在合理的错误条件下完全修复损坏的视频数据包。该方法包括利用协议的校验和信息（当前仅用于检测错误）来纠正错误。 申请人及其团队将通过三项研究活动实现主要目标。首先，在实时视频的背景下，他们将研究如何在列表解码方法中利用校验和信息，该方法尝试解码各种候选校正视频数据包，直到找到有效（可解码）数据包，以显着减少要考虑的候选数量，从而降低计算复杂性。其次，在近实时视频流的背景下，他们将研究如何通过将损坏数据包的信息与其重传的损坏版本相结合来使用校验和来限制重传次数，以生成修复的数据包。最后，在使用前向纠错 (FEC)（冗余信息）的视频广播背景下，他们将研究如何将校验和与 FEC 结合使用来生成修复的数据包。该研究计划中设想的技术将根据当前和未来的视频标准进行验证。 这项研究取得的进展将显着提高视频服务的质量和效率，并实现前所未有的媒体体验。至于他们之前的项目，加拿大将从这些技术的知识产权和商业化以及快速增长的视频处理和应用领域的高素质人才培训中受益匪浅。