A Cluster Infrastructure to Support Retrieval, Management and Visualization of Massive Amounts of Data

该项目旨在为数据密集型应用开发一个基础设施，旨在建立一个集群和显示墙基础设施，以促进在支持检索，查询，建模和可视化的大量数据在广泛的场景系统的实验研究。该基础设施由一组具有图形功能的工作站、快速网络基础设施、高分辨率显示墙和专用文件服务器组成，支持三个研究项目：Exploiting the Hidden Web、大型科学可视化和建模与渲染大型3D环境。第一个项目搜索、索引和查询隐藏的Web数据。通常，通过超链接访问网页的爬虫程序，如果不搜索各个网站，就无法找到所需的信息。这个项目开发技术，使爬虫浏览隐藏的网页，建立一个搜索引擎，允许这些数据被查询。第二个方面涉及适用于非常大的科学数据集的可视化技术的发展。该研究包括开发用于科学可视化的核外算法、并行图形和可伸缩显示技术、新颖的绘制算法和更好的可视化建模原语。该项目希望构建可视化系统，有效地将可视化需求与可用的硬件资源分离，允许在任何合理的设备上可视化任意大的数据集。第三个项目着眼于现实世界的物体和场景的模型，从中可以受益的应用包括娱乐，培训和模拟，特效，法医记录分析，远程呈现和远程步行。这项工作需要解决与注册和清理原始数据相关的昂贵的优化问题，以及用于实时渲染的高分辨率显示。该基础设施可以建立可视化和几何计算以及WebDB实验室;这反过来又会使许多学生受益。一个外联部分已经到位;该研究目前支持几个女性和少数民族。此外，两个新的相关课程正在开发中

This project, developing an infrastructure for data intensive applications, aims at establishing a cluster and display-wall infrastructure to facilitate experimental research in systems that support retrieval, querying, modeling, and visualization of massive amounts of data in a broad range of scenarios. The infrastructure, consisting of a cluster of graphics-capable workstation with fast network infrastructure, a high-resolution display wall, and a dedicated file server, supports three research projects: Exploiting the Hidden Web, Large Scientific Visualization, and Modeling and Rendering Large 3D Environments.The first project searches, indexes, and queries the hidden Web data. Often crawlers, which visit pages by following hyperlinks, cannot find needed information without searching the individual sites. This project develops techniques to enable a crawler to navigate through hidden pages, building a search engine that allows these data to be queried. The second relates to the development of visualization technology that is suitable for very large scientific datasets. This research includes the development of out-of-core algorithms for scientific visualization, parallel graphics and scalable-display technology, novel rendering algorithms, and better visualization modeling primitives. The project expects to build visualization systems that effectively decouple the visualization requirements from the available hardware resources, allowing visualization of arbitrarily large datasets on any reasonable device. The third project looks into models of real-world objects and scenes from which applications such as entertaining, training and simulation, special effects, analysis of forensic records, telepresence, and remote walkthroughs can benefit. This work requires tackling expensive optimization problems related to registering and cleaning raw data, and high-resolution display for real-time rendering.This infrastructure enables the establishing of a lab in Visualization and Geometric Computing and WebDB; which in turn will benefit many students. An outreach component is in place; the research currently supports several female and minorities. Moreover, two new related courses are under development