CSR-CSI: XStream, a Distributed Stream Processor for Heterogeneous Sensor Systems

越来越多的用于科学、工程、工业和医疗应用的嵌入式传感器网络使用的传感器每秒可捕获数千或数百万个样本。XStream是一个面向信号的流处理系统，旨在有效地分析这些高速数据流，目标是结合联合收割机信号处理和异步事件流处理操作的应用。 相对于将每个样本作为单独元组处理的商业流数据库，XStream的面向信号的优化产生1000倍的性能改进。 这个单节点的原型正在扩展到支持分布式操作的混合物的无线传感器节点，用户界面设备和有线服务器农场组成的异构网络。这些扩展包括支持分布式计算和网络存储的网络协议和组件，对多核、多处理器服务器系统的改进支持，以及根据需要对WaveScript查询语言进行修改以表达和实现这些功能。 为了巩固和验证XStream的设计，这些新功能正在进行生物声学动物定位研究的现场部署中进行测试。XStream将扩展流数据库技术和高速传感器系统的最新技术水平。 此外，XStream将成为构建交互式和反应式传感系统的强大工具，广泛应用于科学研究、工业和医疗系统以及国防和国土安全。 XStream的源代码将被公开使用，我们已经在与生物学家和医学研究人员合作，将XStream应用于他们的领域。

A growing class of embedded sensor networks deployed for scientific, engineering, industrial, and medical applications use sensors that, in aggregate, capture thousands or millions of samples per second. XStream is a signal-oriented stream processing system designed to analyze these high-rate data streams effectively and efficiently, targeting applications that combine signal processing and asynchronous event-stream processing operations.The prototype XStream system demonstrates very high performance on a single-node system. XStream's signal-oriented optimizations yield 1000x performance improvements relative to commercial streaming databases that would process each sample as a separate tuple. This single-node prototype is being extended to support distributed operation in a heterogeneous network comprised of a mixture of wireless sensor nodes, user interface devices, and wired server farms. These extensions include network protocols and components to support distributed computation and in-network storage, improved support for multi-core, multi-processor server systems, and modifications to the WaveScript query language as needed to express and implement these features. To ground and validate the XStream design, these new features are being tested in fielded deployments implementing a bio-acoustic animal localization study.XStream will extend the state of the art in both streaming database technology and high-rate sensor systems. In addition, XStream will become a powerful tool for building interactive and reactive sensing systems, with broad application to scientific inquiry, industrial and medical systems, and defense and homeland security. The XStream source code will be released for public use and we are already working with biologists and medical researchers to apply XStream in their domains.