EAGR: Perceptually Optimized Semantic Media Adaptation for Mobile Device Access

这个项目开发了一个语义媒体适应计划的移动的访问的信息是感知优化的用户使用小显示移动的设备享受语义相关的媒体内容。研究团队探索了计算机视觉、媒体编码和传输、无线网络、移动终端、和人类视觉感知，以解决缩小高分辨率的丰富内容与尺寸受限的移动终端访问之间的差距的挑战。本项目的智力价值在于探索和开发（1）中的几项相关技术。有限的用户界面媒体语义提取;（2）容量和资源受限的媒体内容适配;（3）适配的媒体到小型移动的设备的感知优化的递送和显示。研究团队通过无缝集成来自传统上相互作用较少的不同研究领域的技术来解决这些问题。该项目弥合了移动的多媒体搜索和访问中的语义鸿沟和用户意图鸿沟。首先，语义自适应的创新方案可以扩展到任何基于语义相关特征的媒体搜索应用。 其次，高分辨率媒体内容对小型移动终端的适配在无线移动的接入媒体网关中起着关键作用。最后，感知优化显示在移动的设备上的调查将开辟一个新的研究途径，了解移动的用户如何感知丰富的媒体内容与小显示器。

This project develops a semantic media adaptation scheme for mobile access of information that is perceptually optimized for users to enjoy semantically relevant media content using small display mobile devices. The research team explores seamless integration of multidisciplinary technologies from computer vision, media coding and transmission, wireless networking, mobile device, and human visual perception to tackle the challenges in closing the gap between rich content in high resolution and size limited mobile device access.The intellectual merit of this project lies in the exploration and development of several relevant techniques in (1) Limited user interface media semantic extraction; (2) Capacity and resource constrained media content adaptation; (3) Perceptually optimized delivery and display of adapted media to small sized mobile devices. The research team addresses these issues by seamless integration of technologies from different research fields that traditionally have less interaction. The project bridges both semantic gap and user intention gap in mobile multimedia search and access. First, the innovative scheme of semantic adaptation can be extended for any media search application based on semantically relevant characteristics. Second, the adaptation of high resolution media content for small sized mobile device plays a key role in media gateway for wireless mobile access. Finally, the investigation of perceptual optimized display on mobile devices shall open up a new research avenue to understand how mobile users perceive rich media content with small displays.