CRI: High-Performance Infrastructure for Data-Intensive Stream Processing Technologies

该项目为几个数据密集型流处理应用程序获取和部署基础设施，支持以下核心项目：-ETL：使用创新的内存驻留流水线处理技术的高性能数据仓库负载和维护策略；-D-CAPE：支持在线计划适应和优化策略的连续流处理技术，协调运行时查询工作负载重新分配与磁盘溢出；-RAINDROP: XML流上可扩展的Xquery处理，在自动机式处理、特定于流的多查询优化和特定于XML的负载减少方面提供了新的进展。随着对可扩展流处理的突破的期望，这项工作影响了需要实时流监控的应用程序，例如监测环境条件的变化（例如，建筑物中的烟雾，需要关注或药物治疗的医疗条件，以及关键的军政府等）。该项目还处理了便携式计算机、无线通信和高带宽带来的挑战和机遇，在这些环境中，大容量（以兆字节计）的流数据源可能随时随地存在。更广泛的影响：基础设施加强了研究和教育的整合。WPI以其以项目为导向的本科教育而闻名，所有本科生都必须进行为期一年的高级研究项目，即专业资格项目（MQP）。该集群为这些学生、教师和研究生提供服务。

This project, acquiring and deploying infrastructure for several data-intensive stream processing applications, supports the following core projects:-ETL: High-performance data warehouse load and maintenance strategies using innovative memory-resident pipelined processing techniques;-D-CAPE: Continuous stream processing technologies supporting on-line plan adaptation and optimization strategies coordinating run-time query workload re-distribution versus disk spilling; -RAINDROP: Scalable Xquery processing over XML streams offering novel advances in automata-style processing, in stream-specific multi-query optimization, and in XML-specific load shedding.With expectations of break-throughs in scalable stream handling, the work impacts applications that require real-time stream monitoring, such as monitoring for changes in environmental conditions (e.g., smoke in buildings, medical conditions that require attention or medication, and critical military government, etc.). The project also deals with the challenges and opportunities raised by portable computers, wireless communications, and high bandwidth, environments where high volumes (in the order of tera-bytes) of stream data sources may be present anywhere and at any instant.Broader Impact: The infrastructure enhances the integration of research and education. WPI is known for its project-oriented undergraduate education, where all undergraduates must conduct a year-long senior level research project, the Major Qualifying Project (MQP). The cluster services these students as well as the faculty, and graduate students.