Performance- and Energy-Aware HEC Storage Stacks
Performance- and Energy-Aware HEC Storage Stacks
批准号:
0937854
负责人:
Erez Zadok
金额:
$65.2万
依托单位:
依托单位国家:
美国
项目类别:
Standard Grant
财政年份:
2009
资助国家:
美国
项目状态:
已结题
起止时间:
2009-09-01 至 2013-08-31
中文摘要
高端计算(HEC)系统是为性能而设计的,而不是能源效率。近年来,HEC用户发现,随着能源成本的增加,网络和磁盘已成为显著的瓶颈;更糟糕的是,科学工作量差异很大,需要在HEC集群的不同部分进行操作,因此不可能了解瓶颈在哪里,哪里浪费了能源。本项目使用实际的集群配置和现实的科学工作负载,探索存储堆栈配置对功率和性能的影响。该研究遵循三个重点:跟踪和分析、自适应集群重构和新的存储软件堆栈。(1)收集和分析的痕迹,结合性能和能源数据在一组大的科学工作负载:I/O-,网络-,内存-和cpu密集型。研究了三种流行的科学集群配置,改变了许多配置参数。(2)正在开发工具来动态调整集群的配置以适应给定的工作负载,以便在运行长期科学实验或模拟之前优化功率和性能。(3)专门为科学工作负载优化电源和性能而开发的新操作系统软件:新的轻量级文件系统和磁盘I/O调度器。该项目的长期成果有助于社会在不过度损害性能的情况下节省计算能源。
英文摘要
High-End Computing (HEC) systems are designed for performance, not energy efficiency. In recent years, HEC users have found that as energy costs increase, network and disks have become significant bottlenecks; worse, scientific workloads vary wildly, exercising different parts of HEC clusters, making it impossible to understand where the bottlenecks are and where energy is being wasted.This project explores the impact of storage-stack configurations on power and performance, using actual cluster configurations and realistic scientific workloads. The research follows three thrusts: tracing and analysis, adaptive cluster reconfiguration, and new storage software stacks.(1) Traces are collected and analyzed which combine both performance and energy data on a large set of scientific workloads: I/O-, network-, memory-, and CPU-intensive. Three popular scientific cluster configurations are investigated, varying many configuration parameters. (2) Tools are being developed to dynamically adapt a cluster's configurations to a given workload, so as to optimize power and performance prior to running long-term scientific experiments or simulations. (3) New operating systems software is developed specifically to optimize power and performance for scientific workloads: a new lightweight file system and disk I/O scheduler.The long-term results of this project help society save energy in computing without unduly hurting performance.
期刊论文(0)
专著(0)
科研奖励(0)
会议论文
Collaborative Research: CyberTraining: Implementation: Medium: FOUNT: Scaffolded, Hands-On Learning for a Data-Centric Future
-
批准号:2230078
-
项目类别:Standard Grant
-
资助金额:$17.49万
-
财政年份:2022
-
负责人:Erez Zadok
-
依托单位:
Collaborative Research: CNS Core: Medium: Secure, Reliable, and Efficient Long-Term Storage
-
批准号:2106263
-
项目类别:Continuing Grant
-
资助金额:$71.73万
-
财政年份:2021
-
负责人:Erez Zadok
-
依托单位:
Collaborative Research: CNS Core: Medium: Optimizing Storage Caches via Adaptive and Reconfigurable Tiering
-
批准号:2106434
-
项目类别:Continuing Grant
-
资助金额:$53.33万
-
财政年份:2021
-
负责人:Erez Zadok
-
依托单位:
CNS Core: III: Medium: Collaborative Research: Optimizing and Understanding Large Parameter Spaces in Storage Systems
-
批准号:1900706
-
项目类别:Continuing Grant
-
资助金额:$82.31万
-
财政年份:2019
-
负责人:Erez Zadok
-
依托单位:
FMitF: Track I: NLP-Assisted Formal Verification of the NFS Distributed File System Protocol
-
批准号:1918225
-
项目类别:Standard Grant
-
资助金额:$74.83万
-
财政年份:2019
-
负责人:Erez Zadok
-
依托单位:
Collaborative Research: CI-SUSTAIN: National File System Trace Repository
-
批准号:1729939
-
项目类别:Standard Grant
-
资助金额:$12.99万
-
财政年份:2017
-
负责人:Erez Zadok
-
依托单位:
Student Travel Support for the 13th USENIX File and Storage Technologies conference (FASTI 2015)
-
批准号:1522834
-
项目类别:Standard Grant
-
资助金额:$2.0万
-
财政年份:2015
-
负责人:Erez Zadok
-
依托单位:
CSR: Medium: Collaborative Research: Workload-Aware Storage Architectures for Optimal Performance and Energy Efficiency
-
批准号:1302246
-
项目类别:Standard Grant
-
资助金额:$51.39万
-
财政年份:2013
-
负责人:Erez Zadok
-
依托单位:
BIGDATA: Small: DCM: Collaborative Research: An efficient, versatile, scalable, and portable storage system for scientific data containers
-
批准号:1251137
-
项目类别:Standard Grant
-
资助金额:$44.43万
-
财政年份:2013
-
负责人:Erez Zadok
-
依托单位:
TTP: Small: NFS4Sec: An Extensible Security Layer for Network Storage
-
批准号:1223239
-
项目类别:Standard Grant
-
资助金额:$48.68万
-
财政年份:2012
-
负责人:Erez Zadok
-
依托单位:
Student Travel Support for the First USENIX Workshop on Sustainable Information Technology (SustainIT 2010)
-
批准号:0968748
-
项目类别:Standard Grant
-
资助金额:$1.0万
-
财政年份:2010
-
负责人:Erez Zadok
-
依托单位:
CSR---PDOS: Support for Atomic Sequences of File System Operations
-
批准号:0614784
-
项目类别:Standard Grant
-
资助金额:$56.17万
-
财政年份:2006
-
负责人:Erez Zadok
-
依托单位:
HEC: File System Tracing, Replaying, Profiling, and Analysis on HEC Systems
-
批准号:0621463
-
项目类别:Standard Grant
-
资助金额:$76.03万
-
财政年份:2006
-
负责人:Erez Zadok
-
依托单位:
CSR---AES: Runtime Monitoring and Model Checking for High-Confidence System Software
-
批准号:0509230
-
项目类别:Continuing Grant
-
资助金额:$83.0万
-
财政年份:2005
-
负责人:Erez Zadok
-
依托单位:
A Layered Approach to Securing Network File Systems
-
批准号:0310493
-
项目类别:Continuing Grant
-
资助金额:$40.0万
-
财政年份:2003
-
负责人:Erez Zadok
-
依托单位:
CAREER: An In-Kernel Runtime Execution Environment for User-Level Programs
-
批准号:0133589
-
项目类别:Continuing Grant
-
资助金额:$40.0万
-
财政年份:2002
-
负责人:Erez Zadok
-
依托单位:
国内基金
海外基金
度量测度空间上基于狄氏型和p-energy型的热核理论研究
-
批准号:QN25A010015
-
项目类别:省市级项目
-
资助金额:--
-
批准年份:2025
-
负责人:高晋
-
依托单位: