Collaborative Research: Scalable Data Management Using Metadata and Provenance

协作研究：使用元数据和来源的可扩展数据管理

• 批准号: 0937938
• 负责人: Ethan Miller
• 金额: $ 55.3万
• 依托单位: University of California-Santa Cruz
• 依托单位国家: 美国
• 项目类别: Continuing Grant
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-10-01 至 2013-09-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0937938&HistoricalAwards=false
• 关键词: Collaborative; Research; Scalable; Data; Management

This project is developing new techniques for identifying and managing files, replacing tree-structured file names with content- and metadata- based search access. By leveraging existing work in search and recognizing the explosion in the volume of data stored, this project enables users to find and access their data in natural and intuitive ways, based on the files' contents, tags the user has assigned, system metadata, and provenance (information about the file's origins). This research targets high-end computing (HEC) users, who manage billions of files generated by measurement devices, experimentation, or scientific workflows. The techniques and system developed are also applicable to general-purpose computing.Realizing this goal requires advances in several areas. First, the project is designing and developing fast, scalable mechanisms to gather, maintain and index the large volume of metadata and provenance that HEC applications and users generate. This project is also exploring search algorithms that operate on graph structures, enabling users to find files "near" their current workspace. To enable users to access this functionality, the project is developing a new "language" that facilitates the kind of searches that users need.

该项目正在开发用于识别和管理文件的新技术，用基于内容和元数据的搜索访问替换树结构化的文件名。 通过利用现有的工作来搜索并识别存储的数据量的爆炸，该项目使用户可以根据文件的内容，标签用户分配的标签，系统元数据和出处（有关文件的起源）来查找和访问其数据。这项研究针对高端计算（HEC）用户，他们管理通过测量设备，实验或科学工作流产生的数十亿个文件。 开发的技术和系统也适用于通用计算。实现此目标需要在多个领域的进步。 首先，该项目正在设计和开发快速，可扩展的机制，以收集，维护和索引HEC应用程序和用户生成的大量元数据和出处。 该项目还在探索在图形结构上运行的搜索算法，使用户能够“接近”其当前工作空间找到文件。 为了使用户访问此功能，该项目正在开发一种新的“语言”，以促进用户需要的搜索。