SBIR Phase I: A Cloud Client Service for Next Generation of Mobile Computing, Leveraging Low Latency Video Encoder Algorithms

这个小型企业创新研究（SBIR）第一阶段项目的更广泛的影响/商业潜力将是实现各种低延迟视频应用，这些应用在今天是不可能的。 其中最有趣的是在云计算领域，其中互联网上某处数据中心的服务器远程运行客户端的应用程序，并将逐帧视频传输给客户端的观众。 这允许一个非常便宜的客户端设备，只包括一个视频解码器和一个输入，如鼠标垫，而图形或计算密集型任务运行在强大的服务器上的云，可以根据需要租用给客户端。 这种服务器-客户端模型也可以在公司或学校内部使用，大大简化了IT需求。 对于高安全性的应用程序，还有一个优势，因为所有数据都是远程存储的。 用户的设备上没有任何本地内容会受到损害。 像这样的云计算服务已经上线，但它们可以运行的应用程序的范围受到缺乏良好的低延迟视频编码的限制。 解决这个问题为人们购买、维护和使用个人电脑和软件开辟了一个全新的模式。这个小型企业创新研究（SBIR）第一阶段项目研究了实时超低延迟视频压缩技术。 该研究的目标是使视频能够通过诸如互联网、蜂窝电话网络、卫星网络等通信介质进行编码和传输，使得视频可以在接收端观看，而从其在源处被编码时起不超过1帧的延迟。 最好的和最新的行业标准视频压缩规范，称为H.265，将被用作一个框架，这样产生的压缩视频可以很容易地解码广泛可用的软件或硬件。 将开发和测试用于监测和调整压缩视频比特率的框架工具和技术，以实现低延迟目标，同时保持压缩视频的高视觉质量。 这项研究的结果将是一组算法，可用于设计的H.265视频编码器，将实现低延迟的目标，以及这些算法的局限性的表征，使其适用于各种现实世界的机会可以评估。

The broader impact/commercial potential of this Small Business Innovation Research (SBIR) Phase I project will be to enable various low latency video applications that are not possible today. One of the most interesting is in the area of cloud computing, in which a server in a data center somewhere on the Internet runs a client's application remotely, and delivers the frame-by-frame video to the client's viewer. This allows for a very cheap client device, consisting of just a video decoder and an input such as a mouse pad, while graphic or compute intensive tasks run on powerful servers in the cloud that can be leased to the client on an as-needed basis. This server-client model could also be used internally at a company or school, greatly simplifying IT requirements. And for high security applications there is also an advantage, as all data is stored remotely. There is nothing local on the user's device to be compromised. Cloud computing services such as these are already coming on line, but the range of applications they can run is limited by the lack of good low latency video encoding. Solving this problem opens up a whole new paradigm of how people purchase, maintain and use personal computers and software.This Small Business Innovation Research (SBIR) Phase I project investigates techniques for real-time ultra low latency video compression. The goal of the research is to enable the encoding and transmission of video over a communications medium such as the Internet, cell phone network, satellite network, etc. such that the video may be viewed at the receiving end with no more than 1 frame of latency from when it was encoded at the source. The best and newest industry-standard video compression specification, called H.265, will be used as a framework such that the resulting compressed video can be readily decoded by widely available software or hardware. Framework tools and techniques to monitor and adjust the bit rate of the compressed video will be developed and tested to achieve the low latency goals while maintaining high visual quality of the compressed video. The result of this research will be a set of algorithms that can be used in the design of an H.265 video encoder that will achieve the low latency goal, as well as a characterization of the limitations of these algorithms such that their applicability to various real-world opportunities can be assessed.