课题基金 / 基金详情

SHF: Small: Collaborative Research: Modeling and Analyzing Big Data on Peta- and Exascale Distributed Systems Supported by MapReduce Methodologies

SHF: Small: Collaborative Research: Modeling and Analyzing Big Data on Peta- and Exascale Distributed Systems Supported by MapReduce Methodologies
SHF:小型:协作研究:在 MapReduce 方法支持下对 Peta 和 Exascale 分布式系统上的大数据进行建模和分析
批准号:
1318417
负责人:
Pietro Cicotti
金额:
$6.9万
依托单位国家:
美国
项目类别:
Standard Grant
财政年份:
2013
资助国家:
美国
项目状态:
已结题
起止时间:
2013-09-01 至 2017-08-31

项目摘要

项目成果

Pietro Cicotti的其他基金

相似基金

相关文献

中文摘要
翻译
目前的千万亿级平台可以执行大规模模拟,并以前所未有的速度生成海量数据。随着艾级平台的引入,预计这些费率将会上升。越来越多的数据的产生给科学家们带来了新的挑战,他们正在努力分析、分类和选择具有科学意义的结果。当非常大量的数据记录位于分布式存储系统中的大量节点上时,即使是少量的比较也可能代价高昂,甚至不可能。因此,需要新的方法来分析大规模的科学数据集。本项目的目标是开发一种变革性的分析方法,以分布式的方式在今天和未来的亿级系统上模拟大型科学数据集的属性。研究活动包括:(1)通过使用空间缩减技术设计用于以并行方式对嵌入在分布式数据中的属性进行编码的新算法;(2)通过使用诸如MapReduce之类的分布式范例来设计用于对这些属性进行聚类和分类的新算法;(3)在结构生物学和天文学中部署针对不同数据集的算法;以及(4)针对新兴存储技术的结果性能和准确性对算法进行调整。该分析方法将为科学界提供基础设施和工具,以确定可用于预测类成员资格的特征;在数据集中找到重复模式;并根据特定特征或属性确定类成员关系。通过以可扩展的方式有效而准确地捕获科学信息,这些基础设施和仪器将打破数据集中化的传统限制,并允许科学家克服与所考虑的数据的完全分布式性质相关的困难。该项目的教育部分通过让本科生和研究生参与研究活动并将大数据分析整合到特拉华大学的本科课程中,促进计算建模和分析技术以及数据密集型算法和平台的培训和学习。该项目编制的研究型教材将通过项目门户网站以及XSEDE和超级计算(SC)会议的教程向科学界提供。
英文摘要
Current petascale platforms can perform large-scale simulations and generate massive amounts of data at unprecedented rates. These rates are expected to increase as exascale platforms are introduced. The generation of more and more data presents new challenges for scientists who struggle with the analysis, sorting, and selection of scientifically meaningful results. When very large amounts of data records are located across a large number of nodes in a distributed memory system, even a small number of comparisons can be costly or even impossible. Therefore, new methodologies are necessary to analyze large scientific datasets at scale.The goal of this project is to develop a transformative analysis method to model the properties of large scientific datasets in a distributed manner on petascale systems today and exascale systems in the future. The research activity includes (1) the design of new algorithms for encoding properties embedded in distributed data in a parallel manner by using space reduction techniques; (2) the design of new algorithms for clustering and classifying these properties by using distributed paradigms such as MapReduce; (3) the deployment of the algorithms for diverse datasets in structural biology and astronomy; and (4) the tuning of the algorithms for both result performance and accuracy on emerging storage technologies. The analysis method will provide the scientific community with infrastructures and instrumentations to identify features that can be used to predict class memberships; find recurrent patterns in datasets; and identify class memberships from a specific feature or property. By effectively and accurately capturing scientific information in a scalable manner, these infrastructures and instrumentations will break the traditional constraint of data centralization and allow scientists to overcome the difficulties associated with the fully distributed nature of the data considered.The project's educational component promotes training and learning in computational modeling and analysis techniques as well as data-intensive algorithms and platforms by involving undergraduate and graduate students in research activities and integrating big data analytics into the undergraduate curriculum at the University of Delaware. The research-based educational materials developed in this project will be made available to the scientific community through the project portal and through tutorials at XSEDE and Supercomputing (SC) conferences.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
EAGER: Advanced DAta Movement ANalysis Toolkit (ADAMANT)
  • 批准号:
    1451598
  • 项目类别:
    Standard Grant
  • 资助金额:
    $9.0万
  • 财政年份:
    2014
  • 负责人:
    Pietro Cicotti
  • 依托单位:
国内基金
海外基金
昼夜节律性small RNA在血斑形成时间推断中的法医学应用研究
  • 批准号:
  • 项目类别:
    省市级项目
  • 资助金额:
    --
  • 批准年份:
    2024
  • 负责人:
  • 依托单位:
tRNA-derived small RNA上调YBX1/CCL5通路参与硼替佐米诱导慢性疼痛的机制研究
  • 批准号:
  • 项目类别:
    省市级项目
  • 资助金额:
    10.0万元
  • 批准年份:
    2022
  • 负责人:
    张祥忠
  • 依托单位:
Small RNA调控I-F型CRISPR-Cas适应性免疫性的应答及分子机制
Small RNAs调控解淀粉芽胞杆菌FZB42生防功能的机制研究
  • 批准号:
    31972324
  • 项目类别:
    面上项目
  • 资助金额:
    58.0万元
  • 批准年份:
    2019
  • 负责人:
    高学文
  • 依托单位: