SI2-SSE: SciDB - A Scientific DataManagement System

SI2-SSE：SciDB - 科学数据管理系统

• 批准号: 1047955
• 负责人: Michael Stonebraker
• 金额: $ 50万
• 依托单位: Massachusetts Institute of Technology
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2010
• 资助国家: 美国
• 起止时间: 2010-09-15 至 2014-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1047955&HistoricalAwards=false
• 关键词: SI2; SSE; SciDB; Scientific; DataManagement

Current relational database systems (RDBMSs) were engineered for the business data processing market, and not for scientific users (e.g, astronomers, physicists, chemists, oceanographers, or earth scientists). By and large, science users either grumble and use RDBMSs or, more often, "roll their own" data management software. Significant projects, such as the Large Hadron Collider (LHC) and the NASA Mission to Planet Earth, have spent millions of dollars on custom software systems, with limited applicability to other projects. As such, after a generation of science applications, there is limited shared data management infrastructure. SciDB is a project focused on building an open-source DBMS focused on the needs of science users. We have developed the requirements of SciDB based on a close collaboration with a number of scientists. Data management features include a nested array data model (rather than the tabular model of RDBMSs) with operations attuned to scientific data, a no-overwrite storage model (allowing interaction with historical results), and support for uncertainty, named versions and provenance information. At this point, there is a distributed team of 17 programmers and scientists working actively on the design and implementation of SciDB, assisted by an advisory committee of 15 scientists. This team is primarily focused on the research issues surrounding the design of SciDB, and most contributors are involved in the project as volunteers or are paid by their individual organizations. A demo of the first working proof-of-concept SciDB prototype was given at the VLDB conference in August 2009, and a first public release of SciDB is planned for September 2010. The purpose of this NSF grant is to enhance SciDB with additional science-oriented features, including time travel, versions, uncertainty and provenance. With NSF?s help, we expect to develop a full-function system by the end of the grant period.

当前的关系数据库系统 (RDBMS) 是为业务数据处理市场设计的，而不是为科学用户（例如天文学家、物理学家、化学家、海洋学家或地球科学家）设计的。总的来说，科学用户要么抱怨并使用 RDBMS，要么更常见的是“推出自己的”数据管理软件。大型强子对撞机 (LHC) 和 NASA 地球任务等重大项目已在定制软件系统上花费了数百万美元，但对其他项目的适用性有限。 因此，经过一代科学应用之后，共享数据管理基础设施是有限的。 SciDB 是一个专注于构建满足科学用户需求的开源 DBMS 的项目。我们在与众多科学家的密切合作的基础上制定了 SciDB 的要求。 数据管理功能包括嵌套数组数据模型（而不是 RDBMS 的表格模型），其操作适合科学数据、无覆盖存储模型（允许与历史结果交互）以及对不确定性、命名版本和出处信息的支持。 目前，有一个由 17 名程序员和科学家组成的分布式团队，在由 15 名科学家组成的咨询委员会的协助下，积极致力于 SciDB 的设计和实现。该团队主要关注围绕 SciDB 设计的研究问题，大多数贡献者都是作为志愿者参与该项目，或者由其个人组织付费。第一个工作概念验证 SciDB 原型在 2009 年 8 月的 VLDB 会议上进行了演示，并计划于 2010 年 9 月首次公开发布 SciDB。 NSF 拨款的目的是通过额外的面向科学的功能（包括时间旅行、版本、不确定性和出处）来增强 SciDB。 在 NSF 的帮助下，我们预计在资助期结束时开发出一个全功能的系统。