SBIR Phase I: Domain and Network Aware High Definition (HD) Videoconferencing

SBIR 第一阶段：域和网络感知高清 (HD) 视频会议

• 批准号: 0637517
• 负责人: Milton Chen
• 金额: --
• 依托单位: VSee Lab
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2007
• 资助国家: 美国
• 起止时间: 2007-01-01 至 2007-12-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0637517&HistoricalAwards=false
• 关键词: SBIR; Phase; Domain; Network; Aware

This Small Business Innovation Research (SBIR) Phase I proposal aims to create a low bandwidth streaming algorithm for high definition (HD) videoconferencing. The ultimate goal is a software system that achieves less than 150 msec one-way end-to-end delay (the typical delays of telephone) for 1280x720 @ 30 fps video at 512 Kbps (the typical upload speeds of high-end consumer broadband). Most videoconferencing systems today stream video at 1/10 of HD resolution. At such resolution, it is often difficult to see facial expressions.Commercial HD products are currently only available in hardware. These systems all require network speeds beyond the limits of broadband. This research aims to develop videoconferencing software for broadband. Faces and whiteboards are the two most common elements of interest in a videoconference. This research will combine real-time network sensing and the domain knowledge of how people perceive facial expressions, whiteboards, and nondescript background to create a unique compression/streaming algorithm. The input video is segmented into different regions. The whiteboard and background will be enhanced for sharpness using novel super resolution techniques. Two core technologies will be developed: 1) perceptual resolution enhancement of whiteboard and background, and 2) network adaptive HD streaming. Although the concepts just described have been explored in principle by thousands of researches over the last few decades, previous efforts did not result in any HD products.

这项小型企业创新研究（SBIR）第一阶段提案旨在为高清（HD）视频会议创建一个低带宽流算法。最终的目标是一个软件系统，实现小于150毫秒的单向端到端延迟（电话的典型延迟）为1280x720@30 fps的视频在512 Kbps（高端消费者宽带的典型上传速度）。如今，大多数视频会议系统都以1/10的高清分辨率传输视频。在这样的分辨率下，通常很难看到面部表情。商业高清产品目前只能在硬件上使用。 这些系统都需要超过宽带限制的网络速度。本研究旨在开发宽带视频会议软件。 面孔和白板是视频会议中最常见的两个元素。这项研究将结合联合收割机的实时网络传感和人们如何感知面部表情，白板，和不伦不类的背景领域的知识，创造一个独特的压缩/流算法。输入视频被分割成不同的区域。白板和背景将使用新的超分辨率技术增强清晰度。将开发两项核心技术：1）白板和背景的感知分辨率增强，2）网络自适应高清流媒体。尽管在过去的几十年里，数千项研究原则上已经探索了刚才描述的概念，但以前的努力并没有产生任何HD产品。