Where the Ocean Meets the Cloud: Ad Hoc Longitudinal Analysis of Massive Mesh Data

海洋与云相遇的地方：海量网格数据的临时纵向分析

• 批准号: 1153728
• 负责人: Claudio Silva
• 金额: $ 11.65万
• 依托单位: Polytechnic University of New York
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2011
• 资助国家: 美国
• 起止时间: 2011-06-01 至 2013-01-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1153728&HistoricalAwards=false
• 关键词: Where; Ocean; Meets; Cloud; Ad

Science is becoming a data management problem. Advancements in sensing and computational modeling have dramatically increased data acquisition rates, establishing queries -- "in ferro" experiments -- as an essential method of scientific discovery alongside in situ, in vitro, and in silico experiments. Unfortunately, the infrastructure to design and conduct in ferro experiments over massive datasets has not kept pace with our collective ability to create these datasets. Computational modelers, who have long enjoyed the benefits of a research focus on creating larger and faster CPU farms, now face terabytes of simulation results in which deep insights into the health of the planet remain locked. The key is seamlessness: to interactively analyze these data, quantitatively and qualitatively, without regard to boundaries manifesting from time and space domains, physical location, hardware architecture, storage medium, or file organization.This project is building a new infrastructure that uses the CluE platform to allow ad hoc, longitudinal query and visualization of massive ocean simulation results at interactive speeds. This infrastructure leverages and extends two existing systems: GridFields, a library for general and efficient manipulation of simulation results; and VisTrails, a comprehensive platform for scientific workflow, collaboration, visualization, and provenance. By cloud-enabling these systems, the proposed infrastructure provides: (1) seamless access to the 10 year history of simulation results at interactive speeds; (2) an architecture and execution strategy that exploit both remote cloud and local desktop resources; and (3) a provenance capture and manipulation platform that enables repeatability, code reuse, forensics, and collaboration.

科学正在成为一个数据管理问题。 传感和计算建模的进步大大提高了数据采集率，建立查询-“铁”实验-作为一个重要的方法，科学发现旁边的原位，体外和在硅片实验。 不幸的是，在大规模数据集上设计和进行铁实验的基础设施并没有跟上我们创建这些数据集的集体能力。 长期以来，计算建模人员一直享受着研究重点是创建更大、更快的CPU场的好处，现在他们面临着TB级的模拟结果，其中对地球健康状况的深刻见解仍然被锁定。关键是无缝：以交互方式对这些数据进行定量和定性分析，而不考虑时间和空间域、物理位置、硬件架构、存储介质或文件组织的边界。该项目正在构建一个新的基础设施，该基础设施使用CluE平台，以交互速度对大量海洋模拟结果进行特定的纵向查询和可视化。该基础设施利用并扩展了两个现有系统：GridFields，一个用于通用和高效操作模拟结果的库; VisTrails，一个用于科学工作流，协作，可视化和出处的综合平台。通过云支持这些系统，拟议的基础设施提供：（1）以交互速度无缝访问10年的模拟结果历史;（2）利用远程云和本地桌面资源的架构和执行策略;以及（3）实现可重复性，代码重用，取证和协作的起源捕获和操作平台。