EAGER: REAQTIVE - Resource Aggregation and Quality Tradeoffs for Integration of Video projector Ensembles

本研究的目的是集成多个质量受限的基于手机的微型投影仪，以创建高质量的输出并改善用户在多媒体会话期间的观看体验，即，观看视频或共享多媒体演示。所提出的方法是开发编码和解码方案，以允许灵活的分割流媒体交付，考虑到图像分区的显示器的数量，并适应一系列的分辨率，帧速率和设备功率资源。此外，将研究跨多个设备集成显示同步和视频/音频流同步的新颖同步方案。当前的多投影机注册技术需要针对低质量微型投影机的资源和质量敏感性进行修改。该项目提出了一种用于便携式多媒体设备的资源管理、设备同步和视频编码/解码的新范式，以协同地为用户提供增强的观看体验，其中“增强”指的是帧速率、图像分辨率、亮度、音频质量，以及节省电力以实现更长时间的观看。该范例通过在视频显示中引入空间分集而与无线通信中的MIMO概念并行。MIMO提高了数据速率和/或信号质量，本项目的成果有望提高图像分辨率和/或亮度。所提出的范例将允许多个用户汇集移动的便携式设备的资源，以在任何地方、任何时间产生更高质量、能量/资源高效的输出。这将影响用户在特定环境中的“移动”，从社交环境中的媒体共享到现场需要更高质量图像输出的第一响应者和紧急工作人员。

The objective of this research is to integrate multiple quality-constrained cell-phone-based pico-projectors as to create quality output and improve the viewing experience of users 'on the go' during a multimedia session, i.e., watching a video, or sharing a multimedia presentation. The proposed approach is to develop coding and decoding schemes to allow flexible split stream media delivery that takes into account the number of displays for image partitioning and accommodates a range of resolutions, frame rates, and device power resources. Additionally, novel synchronization schemes that integrate display synchronization and video/audio stream synchronization across multiple devices will be investigated. Current multi-projector registration techniques need to be modified for resource and quality sensitivity for use in low-quality pico-projectors.The project proposes a new paradigm of resource management, device synchronization and video coding/decoding for portable multimedia devices to collaboratively deliver an enhanced viewing experience for users, where 'enhanced' refers to frame rate, image resolution, brightness, audio quality, and power savings for longer viewing. This paradigm parallels the MIMO concept in wireless communications by introducing spatial diversity in video display. MIMO enhances the data rate and/or the signal quality, the results of this project is expected to enhance the image resolution and/or brightness.The proposed paradigm will allow multiple users to pool the resources of mobile portable devices to produce a higher quality, energy/resource efficient output, anywhere, anytime. This will impact users 'on the go' in ad hoc settings, ranging from media sharing in social milieus to first responders and emergency workers requiring higher quality image output in the field.