Mathematical Sciences: Produce a World Wide Web Program of the Conference on Statistical ChallengeÐ and Possible Approaches in the Analysis of Massive Data Sets

建议：DMS 95-22317 PI：约翰·亚历山大研究所：国家科学院标题：在海量数据集分析中产生统计挑战和可能的方法会议的万维网计划摘要由国家研究理事会应用和理论统计委员会主办的关于统计和海量数据集的研讨会，重点是如何有效地处理需要统计分析的海量数据。在许多实际情况下，研究人员面临着标准统计技术的不足，无法处理当前数据集的爆炸性增长，在这些数据集中，观测数量很容易达到千兆甚至兆兆字节的范围。许多最流行的方法所依据的统计假设，如数据的“同质性”，在这些情况下可能完全是错误的，从而使常见的统计工具无效，甚至危险。一个相应的问题是当前许多问题中维度数量的增长。同样，在不同的时代开发的标准方法，在许多情况下甚至早于计算机，不足以应对这些挑战。统计和海量数据集研讨会探讨了海量数据集带来的挑战，并在各种现实世界和当前紧迫的应用领域中这样做，包括大气、生物和地球科学、商业和营销、生态学以及工程和技术。以这些领域为背景，确定了关于共同需求的具体的跨学科研究问题，包括相关的统计原理、计算方面、数据分析和海量数据集的可视化。研讨会上，科学家们展开了热烈的讨论。这些讨论不容易以传统的出版会议记录形式记录下来。相反，这些活动是通过制作讲习班的录像带并随后通过万维网(WWW)传播来捕捉和分发的。这种新的传播方式将实际讨论的好处及时带给了广泛的受众。

Proposal: DMS 95-22317 PI: John Alexander Institution: National Academy of Sciences Title: Produce a World Wide Wed Program of the Conference on Statistical Challenges and Possible Approaches in the Analysis of Massive Data Sets ABSTRACT The workshop on Statistics and Massive Data Sets, hosted by the Committee on Applied and Theoretical Statistics of the National Research Council, focuses on how to deal effectively with massive amounts of data that need statistical analyses. In numerous practical contexts, researchers are confronted with the inadequacy of standard statistical techniques to handle the explosion in the size of current data sets, where the number of observations can easily run into the giga- and even terabyte ranges. Statistical assumptions underlying many of the most popular methods, such as "homogeneity" of the data, may simply be wrong in these cases, thus rendering common statistical tools ineffective and even dangerous. A corresponding problem is the growth in the number of dimensions in many current problems. Again standard approaches, which were developed in a different era, even predating the computer in many cases, are not powerful enough for these challenges. The workshop on Statistics and Massive Datasets explores the challenges presented by massive data sets, and does so in the context of a variety of real world and currently pressing application areas, including the atmospheric, biological and geo sciences, business and marketing, ecology, and engineering and technology. With these areas as a backdrop, specific over-arching multi-disciplinary research issues on common needs, including relevant statistical principles, computational aspects, data analysis, and visualization of massive data sets are identified. The workshop involves highly animated discussions among scientists. These discussions are not easily captured in a traditional published proceedings format. In contrast, the activities are capture d and distributed via the preparation of a videotape of the workshop followed by a World Wide Web (WWW) dissemination. This new dissemination method brings the benefit of the actual discussions to a wide audience in a timely fashion.