HaRD: The Wisconsin Hierarchically-Redundant, Decoupled Storage Project

点击翻译按钮获取中文摘要

The Wisconsin Hierarchically-Redundant, Decoupled storage project (HaRD)investigates the next generation of storage software for hybrid Flash/diskstorage clusters. The main objective of the project is to improve theperformance of storage in a variety of diverse scenarios, including newapplication environments such as photo storage as found in Facebook andFlickr, high-end scientific processing as found in government labs, andlarge-scale data processing such as that found in Google and Microsoft. TheHaRD project focuses on three key issues in order to improve performance ofthese important applications: client-side Flash-based RAID and file-systemintegration, server-side memory reduction and multicore scheduling offile-system tasks, and scheduled network transfers. HaRD pulls together thesetechnologies into a synthesized whole through three targeted storage systems:a scalable photo server, a high-performance checkpoint subsystem, and animproved file system for MapReduce workloads. The impact of this project issignificant, as HaRD helps to shape the storage software architecture of thenext generation of cloud computing services, which are of increasing relevanceto both industry and society at large.