Research on Multimedia Content Production for telelecture between China and Japan

中日电视直播多媒体内容制作研究

• 批准号: 13650434
• 负责人: ZHU Qing
• 金额: $ 2.3万
• 依托单位: Waseda University
• 依托单位国家: 日本
• 项目类别: Grant-in-Aid for Scientific Research (C)
• 财政年份: 2001
• 资助国家: 日本
• 起止时间: 2001 至 2002
• 项目状态: 已结题
• 来源: https://kaken.nii.ac.jp/grant/KAKENHI-PROJECT-13650434/
• 关键词: Telelecturing system; Image compression; Content retrieval; Web based multimedia lecture system; Multimedia database; Content creation system; Webマルチメディア教材システム; テキスト教材検索; 翻訳辞書の作成

This research covered a model system for telelecture application between China and Japan in the first year. Issues on a) system environment, b) media input flow, c) feature extraction and description of multimedia were investigated. And in the second year, a telecturing system between Beijing University of technology and Waseda University was designed and implemented based on the first year's result. Using the implemented web-based multimedia lecture system, 2 major topics, a) accessibility enhancement to the requested content and material and b) improvement of data transmission, were studied in the following 4 subjects.1. Rotation and shift free Content-based image retrieval method: As a new feature "disorder matrix" was defined as an independent parameter from rotation and spatial shift of the content. Using disorder matrix and global color histogram, fast selection of matching candidates has become possible. From the simulation experiments, the proposed algorithm's efficiency in cal … More culation time and robustness was confirmed.2. Progressive image coding scheme based on DCT coefficients: We have developed a new progressive image coding scheme, by combining DCT and SPECK algorithm. The new scheme's most advantageous point is its low computational cost and will be applicable for content browsing on the low performance terminals.3. Implementation of eXtensible Lecture On Demand based on LML (Lecture Markup Language): LML is designed to enable multimedia synchronization as SMIL and based on XML. In this research, Lecture on Demand system was implemented using LML and carried out subjective evaluation on XML. In this research, Lecture on Demand system was implemented using LML and carried out subjective evaluation test of the system.4. Intelligent multimedia content generation systems: In this study, 2 systems were designed and implemented as an application of image processing and feature description technologies, which were a) higher resolutional ROI (Region of Interest) image generation system by video mosaicing and b) high efficient web-based video authoring system using camera working parameters. These two systems provide more functions than the user's tool's capabilities by the help of image processing technologies and will be useful especially in various telelecturing occasions. Less

本研究在第一年涵盖了中日两国间电讯应用模式系统。研究了a)系统环境、b)媒体输入流程、c)多媒体特征提取与描述等问题。第二年，在第一年成果的基础上，设计并实现了北京工业大学和早稻田大学的远程通信系统。利用已实现的基于web的多媒体讲座系统，在以下4个学科中研究了两大主题：a)提高所要求的内容和材料的可访问性和b)改进数据传输。基于内容的图像检索方法：将“无序矩阵”作为一种新的特征，定义为独立于内容的旋转和空间移动的参数。利用无序矩阵和全局颜色直方图，可以快速选择匹配候选对象。仿真实验表明，该算法具有较好的计算效率和较好的鲁棒性。基于DCT系数的图像递进编码方案：将DCT与SPECK算法相结合，提出了一种新的图像递进编码方案。该方案最大的优点是计算成本低，适用于低性能终端上的内容浏览。基于LML （Lecture Markup Language）的可扩展随需应变讲座的实现：LML的设计目的是实现基于XML的SMIL多媒体同步。本研究采用LML实现了按需授课系统，并对XML进行了主观评价。本研究采用LML实现了按需讲座系统，并对系统进行了主观评价测试。智能多媒体内容生成系统：作为图像处理和特征描述技术的应用，本研究设计并实现了两个系统：a)基于视频拼接的高分辨率感兴趣区域（ROI）图像生成系统和b)基于摄像机工作参数的高效基于web的视频创作系统。这两种系统借助图像处理技术提供了比用户工具功能更多的功能，尤其在各种教学场合非常有用。少

项目成果

小舘 亮之他: "スポーツ中継映像データベースのカメラワーク情報による特徴解析手法"日本データベース学会Letters. 1. 32-35 (2003)

Akiyuki Kodate 等人：“使用体育广播视频数据库的摄像机工作信息的特征分析方法”日本数据库通讯协会 (Database Society of Japan Letters) 1. 32-35 (2003)。

富永 英義, 他: "Camera Working Parameter Extraction Methods in MPEG2 Video Considering Camera Shake"Proc.of Picture Coding Symposium 2001. 275-278 (2001)

Hideyoshi Tominaga 等：“考虑相机抖动的 MPEG2 视频中的相机工作参数提取方法”Proc.of Picture Coding Symposium 2001. 275-278 (2001)

富永 英義他: "平面静止画の領域適応高精細ディジタル化を実現した高能率ビデオモザイク法"電子情報通信学会論文誌D-II. Vol.85. 563-574 (2002)

Hideyoshi Tominaga 等人：“实现平面静止图像的区域自适应高清数字化的高效视频拼接方法” IEICE Transactions D-II。

朱 青他: "視頻流技術及其応用"測控技術. 21. 1-4 (2002)

朱清等：“可视电流技术及其应用”测控技术. 21. 1-4 (2002)。

朱 青, 他: "DCT-Based Approach to Progressive Image Coding"ACTA ELECTRONICA SINICA(中国電子学報). Vol. 30 No. 12A. 2105-2107 (2002)

Qing Zhu等人：“基于DCT的渐进式图像编码方法”，电子学报，第30卷，第12A期（2002年）。