EAGR: Perceptually Optimized Semantic Media Adaptation for Mobile Device Access

EAGR：针对移动设备访问的感知优化语义媒体适应

• 批准号: 0964797
• 负责人: Chang Wen Chen
• 金额: $ 6万
• 依托单位: SUNY at Buffalo
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2010
• 资助国家: 美国
• 起止时间: 2010-04-01 至 2011-03-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0964797&HistoricalAwards=false
• 关键词: EAGR; Perceptually; Optimized; Semantic; Media

This project develops a semantic media adaptation scheme for mobile access of information that is perceptually optimized for users to enjoy semantically relevant media content using small display mobile devices. The research team explores seamless integration of multidisciplinary technologies from computer vision, media coding and transmission, wireless networking, mobile device, and human visual perception to tackle the challenges in closing the gap between rich content in high resolution and size limited mobile device access.The intellectual merit of this project lies in the exploration and development of several relevant techniques in (1) Limited user interface media semantic extraction; (2) Capacity and resource constrained media content adaptation; (3) Perceptually optimized delivery and display of adapted media to small sized mobile devices. The research team addresses these issues by seamless integration of technologies from different research fields that traditionally have less interaction. The project bridges both semantic gap and user intention gap in mobile multimedia search and access. First, the innovative scheme of semantic adaptation can be extended for any media search application based on semantically relevant characteristics. Second, the adaptation of high resolution media content for small sized mobile device plays a key role in media gateway for wireless mobile access. Finally, the investigation of perceptual optimized display on mobile devices shall open up a new research avenue to understand how mobile users perceive rich media content with small displays.

该项目开发了一种用于移动信息访问的语义媒体适配方案，该方案对用户使用小型显示移动设备享受语义相关的媒体内容进行了感知优化。该研究团队探索了计算机视觉、媒体编码与传输、无线网络、移动设备和人类视觉感知等多学科技术的无缝集成，以解决高分辨率丰富内容与大小受限移动设备访问之间的差距。本项目的智力优势在于探索和开发了以下几项相关技术：(1)有限用户界面媒体语义提取；(2)容量和资源受限的媒体内容适配；(3)感知优化的适配媒体在小型移动设备上的传输和显示。研究团队通过无缝集成来自传统上互动较少的不同研究领域的技术来解决这些问题。该项目在移动多媒体搜索和访问中弥合了语义鸿沟和用户意图鸿沟。首先，语义适配的创新方案可以扩展到基于语义相关特征的任何媒体搜索应用。其次，针对小型移动设备的高分辨率媒体内容适配在无线移动接入的媒体网关中起着关键作用。最后，移动设备上感知优化显示的研究将开辟一条新的研究途径，以了解移动用户如何使用小屏幕感知富媒体内容。