EAGER: REAQTIVE - Resource Aggregation and Quality Tradeoffs for Integration of Video projector Ensembles

本研究的目的是集成多个质量受限的基于手机的微型投影仪，以创建高质量的输出，并改善用户在多媒体会话（即观看视频或共享多媒体演示）中“移动”的观看体验。提出的方法是开发编码和解码方案，以允许灵活的分割流媒体传输，考虑到用于图像分区的显示器数量，并适应一系列分辨率，帧速率和设备电源资源。此外，将研究跨多个设备集成显示同步和视频/音频流同步的新型同步方案。目前的多投影机配准技术需要在资源和质量敏感性方面进行改进，以便在低质量的微型投影机中使用。该项目为便携式多媒体设备提出了一种新的资源管理、设备同步和视频编码/解码范例，以协同为用户提供增强的观看体验，其中“增强”指的是帧速率、图像分辨率、亮度、音频质量和更长时间观看的节能。该范例通过在视频显示中引入空间分集，与无线通信中的MIMO概念相似。MIMO提高了数据速率和/或信号质量，本项目的成果有望提高图像分辨率和/或亮度。所提出的范例将允许多个用户汇集移动便携设备的资源，以在任何地点、任何时间产生更高质量、能源/资源效率的输出。这将影响到在特定环境中“忙碌”的用户，从社交环境中的媒体分享到现场需要更高质量图像输出的第一响应者和紧急救援人员。

The objective of this research is to integrate multiple quality-constrained cell-phone-based pico-projectors as to create quality output and improve the viewing experience of users 'on the go' during a multimedia session, i.e., watching a video, or sharing a multimedia presentation. The proposed approach is to develop coding and decoding schemes to allow flexible split stream media delivery that takes into account the number of displays for image partitioning and accommodates a range of resolutions, frame rates, and device power resources. Additionally, novel synchronization schemes that integrate display synchronization and video/audio stream synchronization across multiple devices will be investigated. Current multi-projector registration techniques need to be modified for resource and quality sensitivity for use in low-quality pico-projectors.The project proposes a new paradigm of resource management, device synchronization and video coding/decoding for portable multimedia devices to collaboratively deliver an enhanced viewing experience for users, where 'enhanced' refers to frame rate, image resolution, brightness, audio quality, and power savings for longer viewing. This paradigm parallels the MIMO concept in wireless communications by introducing spatial diversity in video display. MIMO enhances the data rate and/or the signal quality, the results of this project is expected to enhance the image resolution and/or brightness.The proposed paradigm will allow multiple users to pool the resources of mobile portable devices to produce a higher quality, energy/resource efficient output, anywhere, anytime. This will impact users 'on the go' in ad hoc settings, ranging from media sharing in social milieus to first responders and emergency workers requiring higher quality image output in the field.