CAREER: Research and Development of Advanced Visual Information Systems

本研究探讨先进视觉资讯系统（维斯）的整合设计方法。该方法探讨了各种重要的维斯设计问题之间的最大协同作用-可视化数据索引，压缩，操作和存储。该方法利用纹理、颜色、形状等多种图像特征的综合特征映射对图像内容进行检测和索引，为基于内容的图像查询提供了有效的方法。压缩域技术被探索用于提取低级别的图像特征。提出了一种改进的四叉树数据结构，用于基于特征的分割和异构特征集成。基于先前的工作，有效的图像处理算法（例如，图像滤波和模板匹配）也直接在压缩域中开发，以便寻求最小的实现复杂度。本文还研究了在实时分层存储系统中存储多分辨率编码视频数据的策略。所有的研究成果将被纳入哥伦比亚大学高级图像实验室的大规模集成维斯测试平台。 在教育方面，正在开发视觉信号处理和多媒体技术领域的新课程和课程。还正在开发一个先进的多媒体试验平台，以支持研究和教育活动。

This research investigates an integrated approach to the design of advanced visual information systems (VIS). The approach explores the maximum synergy among various important VIS design issues - visual data indexing, compression, manipulation, and storage. An integrated feature map combining multiple image features such as texture, color, and shape is used to detect and index image content, and provide useful methods for content-based image query. Compressed-domain techniques are explored for extracting low-level image features. A modified quad-tree data structure is proposed to be used in feature-based segmentation and heterogeneous feature integration. Based on the prior work, efficient image manipulation algorithms (e.g., image filtering and template matching) are also being developed directly in the compressed domain, in order to seek the minimum implementation complexity. Strategies for storing multi-resolution encoded visual data in real-time hierarchical storage systems are also studied. All research results will be incorporated into an large-scale integrated VIS testbed at the Advanced Imag e Lab of Columbia University. On the educational front, new courses and curriculum in the area of visual signal processing and multimedia technology are being developed. An advanced multimedia testbed is also being developed for supporting research and educational activities.