课题基金 / 基金详情

Collaborative Research: SDCI Net: Policy-driven Large Scale Data Access Framework with Light-weight Performance Monitoring and Estimation

Collaborative Research: SDCI Net: Policy-driven Large Scale Data Access Framework with Light-weight Performance Monitoring and Estimation
合作研究:SDCI Net:策略驱动的大规模数据访问框架,具有轻量级性能监控和估计
批准号:
1127101
负责人:
Ann Chervenak
金额:
$60.0万
依托单位国家:
美国
项目类别:
Standard Grant
财政年份:
2011
资助国家:
美国
项目状态:
已结题
起止时间:
2011-08-01 至 2015-01-31

项目摘要

项目成果

Ann Chervenak的其他基金

相似基金

相关文献

中文摘要
翻译
大规模的科学应用预计将在未来5到10年内产生艾字节的数据。随着科学数据以前所未有的数量和速度收集,大型科学合作的成功将要求它们为大型用户社区提供分布式数据访问,并提高数据访问的灵活性和可靠性。为了满足这些要求,科学合作越来越多地通过高速网络将大型数据集复制到多个站点。这项工作的主要目标是开发和部署一个通用的数据访问框架的科学合作,提供轻量级的性能监测和估计,细粒度和自适应的数据传输管理,并执行网站和虚拟组织的资源共享政策。轻量级机制将从数据移动工具收集监视信息,而不会对共享资源施加额外的负载。数据传输管理机制将基于每个传输的性能估计来选择传输属性,并且当由于存储、网络和其他资源上的动态负载而观察到性能变化时,将调整这些属性。最后,使用虚拟组织关于复制和资源分配的政策的政策驱动的资源管理将平衡用户对数据新鲜度的要求与资源的负荷。智力上的优点:该小组将产生一个软件框架,该框架将提高分布式科学合作的能力,为大量用户提供对复制数据集的有效访问;该框架将联合收割机组合细粒度的转移管理、来自策略驱动的资源管理的转移建议以及轻量监视。更广泛的影响:拟议的发展将促进越来越依赖复制和共享不断增长的数据集的许多领域的科学进步。
英文摘要
Large-scale science applications are expected to generate exabytes of data over the next 5 to 10 years. With scientific data collected at unprecedented volumes and rates, the success of large scientific collaborations will require that they provide distributed data access with improved data access latencies and increased reliability to a large user community. To meet these requirements, scientific collaborations are increasingly replicating large datasets over high-speed networks to multiple sites. The main objective of this work is to develop and deploy a general-purpose data access framework for scientific collaborations that provides lightweight performance monitoring and estimation, fine-grained and adaptive data transfer management, and enforcement of site and Virtual Organization policies for resource sharing. Lightweight mechanisms will collect monitoring information from data movement tools without putting extra loads on the shared resources. Data transfer management mechanisms will select transfer properties based on each transfer's performance estimation and will adapt those properties when observed performance changes due to the dynamic load on storage, network and other resources. Finally, policy-driven resource management using Virtual Organization policies regarding replication and resource allocation will balance user requirements for data freshness with the load on resources.Intellectual merit: The team will produce a software framework that will improve the ability of distributed scientific collaborations to provide efficient access to replicated datasets by a large community of users; this framework will combine fine-grained transfer management, transfer advice from policy-driven resource management, and light-weight monitoring. Broader impact: The proposed development will facilitate scientific advances in many domains that increasingly depend on replication and sharing of ever-growing datasets.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
DC: Medium: Intelligent Data Placement in Support of Scientific Workflows
  • 批准号:
    0905032
  • 项目类别:
    Standard Grant
  • 资助金额:
    $81.0万
  • 财政年份:
    2009
  • 负责人:
    Ann Chervenak
  • 依托单位:
Career: The Personal Terabyte Disk: Managing and Exploiting Large Future Magnetic Disks
  • 批准号:
    9702609
  • 项目类别:
    Continuing Grant
  • 资助金额:
    $20.5万
  • 财政年份:
    1997
  • 负责人:
    Ann Chervenak
  • 依托单位:
国内基金
海外基金
Research on Quantum Field Theory without a Lagrangian Description
  • 批准号:
    24ZR1403900
  • 项目类别:
    省市级项目
  • 资助金额:
    --
  • 批准年份:
    2024
  • 负责人:
    SATOSHI NAWATA
  • 依托单位:
Cell Research
Cell Research
Cell Research (细胞研究)