MRI: Development of PetaShare: A Distributed Data Archival, Analysis and Visualization System for Data Intensive Collaborative Research

综述分析：主要研究仪器计划FY06建议#：CNS 06-19843PI(S)：科萨，特夫菲克·艾伦，加布里埃尔·D.；塞德尔，爱德华；特利，罗伯特·R；威丘森，E.威廉姆斯机构：路易斯安那州立大学巴吞鲁日，洛杉矶70803-2701标题：核磁共振/开发：开发数据密集型协作研究的分布式数据归档、分析和可视化系统评级：E、V、V、V小组排名：竞争性(C)结果：RecommendAmount请求：957,678美元请求金额：957,678美元建议的项目：该项目开发了一个用于数据密集型协作研究的分布式数据归档、分析和可视化工具(称为PetaShare)，实现了对底层数据共享、归档和检索机制的透明处理，并使科学家可以根据需要使用数据进行分析和可视化。该仪器的设计可扩展到PB级，满足了科学家在大数据生成、共享和协作方面的迫切需求。与现有方法不同，PetaShare将数据资源和与数据访问相关的任务视为一流实体，就像计算资源和计算任务一样，它将数据资源和与数据访问相关的任务视为一级实体，就像计算资源和计算任务一样，而不仅仅是计算的副作用。预期的关键技术包括数据感知存储系统和数据感知调度器，它们负责管理数据资源和调度用户的数据任务，透明地执行这些任务。该仪器支持来自不同领域的许多重要的数据密集型应用，包括海岸和环境建模、地理空间分析、生物信息学、医学成像、流体动力学、石油工程、数值相对论和高能物理。更广泛的影响：该系统补充了EPSCoR州五个互联园区的高性能计算资源，促进了其中的跨学科研究。除了直接服务和促进研究，PetaShare还为数百名学生的培训做出了贡献。该系统极有可能提高风暴潮模型和飓风跟踪预测的准确性和效率，从而能够快速有效地应对可能影响到世界上数百万人的灾害。

Review Analysis: Major Research Instrumentation (MRI) Program FY06Proposal #: CNS 06-19843PI(s): Kosar, Tevfik Allen, Gabrielle D.; Seidel, Edward; Twilley, Robert R.; Wischusen, E. WilliamInstitution: Louisiana State University Baton Rouge, LA 70803-2701Title: MRI/Dev: Dev. of PetaShare: A Distributed Data Archival, Analysis and Visualization System for Data Intensive Collaborative ResearchRatings: E, V, V, V Panel Ranking: Competitive (C) Result: RecommendAmount Req: $ 957,678 Amount Rec: $ 957,678Project Proposed:This project, developing a distributed data archival, analysis, and visualization instrument (called PetaShare) for data intensive collaborative research, enables transparent handling of underlying data sharing, archival, and retrieval mechanisms and makes data available to the scientist for analysis and visualization on demand. Designed to scale to the petabyte level, the instrument responds to an urgent need of scientists working with large data generation, sharing, and collaboration requirements. Involving five universities in the state (LSU, LaTech, Tulane, ULL, and UNO), the infrastructure consists of three layers of storage distributed at multiple sites:Primary very high speed RAM storage for data visualization;Secondary disk storage for data analysis and processing; andTertiary tape storage for data archival and long term studies.Unlike existing approaches, PetaShare treats data resources and the tasks related to data access as first class entities just like computational resources and compute tasks, and not simply the side effect of computation. Expected key technologies include data-aware storage systems and data-aware schedulers, which take the responsibility of managing data resources and scheduling data tasks from the user, performing these tasks transparently. The instrument supports many important data intensive applications from different fields, including coastal and environmental modeling, geospatial analysis, bioinformatics, medical imaging, fluid dynamics, petroleum engineering, numerical relativity, and high energy physics. Broader Impact: The system complements the high-performance computing resources at the five interconnected campuses in this EPSCoR state, boosting interdisciplinary research among them. In addition to directly servicing and promoting research, PetaShare contributes in the training of hundreds of students. The system exhibits a high potential of increasing the accuracy and efficiency of storm surge models and hurricane tracking predictions, thereby enabling rapid and effective disaster responses that could affect millions of people in the world.