COLLABORATIVE RESEARCH: Data Mining Meets I/O Performance Evaluation: Advanced Statistical Tools for Analyzing Bursty Traffic

该合作研究项目包括卡内基梅隆大学的Christos Faloutsos和Ngai Hang Chang（奖励0083148）以及加州圣克鲁斯大学的Tara Madhyastha（奖励0083130），其目标是开发和应用统计和数据挖掘工具来分析突发时间序列，重点是I/O流量优化。这个跨学科团队包括计算机科学、计算机工程和统计学方面的研究人员，以及行业合作者。该方法由三部分组成：(1)采用先进的统计工具“ARFIMA”方法；(2)小波和相关的“80-20定律”来模拟磁盘流量；(3)将这些模型整合到所谓的“活动磁盘”中，目标是构建自调优、自适应的磁盘子系统。研究结果将促进数据挖掘和统计以及磁盘设计。一个易于使用的工具包“T-REX”将有助于I/O和系统设计，处理突发流量，以及更好的缓冲和预取。T-REX工具包背后的理论将基于新的数据挖掘算法和统计方法，这些方法可以模拟自相似的时间序列（如web和网络流量，除了I/O流量）。研究小组与数据库、数据挖掘和磁盘制造工业集团有着密切的联系，这将有助于测试研究工具包及其技术转让。可以预期，T-REX系统将极大地帮助磁盘子系统的设计，对存储行业产生有益的影响。

The goal of this collaborative research project involving Christos Faloutsos and Ngai Hang Chang at Carnegie Mellon (award 0083148) and Tara Madhyastha at U of Cal Santa Cruz (award 0083130) is to develop and apply statistical and datamining tools to analyze bursty time sequences, with emphasis on I/O traffic optimization. The interdisciplinary team includes researchers in computer science, computer engineering and statistics, and industry collaborators. The approach has three parts: (1) advanced statistical tools using the ``ARFIMA'' method; (2) wavelets and the related ``80-20 law'' to model disk traffic; and (3) incorporation of these modelsinside the so-called ``Active Disks'', with the goal to build self-tuning, adaptive disk subsystems.The results will advance data mining and statistics as well as disk design. An easy-to-use toolkit "T-REX" will aid in I/O and systems design, handling bursty traffic, and better buffering and prefetching. The theory behind the T-REX toolkit will be based on new data mining algorithms and statistical methods that model self-similar time sequences (like web and network traffic,in addition to I/O traffic). The research team has strong ties with database, data mining and disk manufacturing industrial groups, and this will aid in testing the research toolkit and its technology transfer. It can be expected that the T-REX system will significantly aid the design of disk sub-systems with beneficial impact on the storage industry.