SHF:AF:Small:Collaborative Research:RESAR: Robust, Efficient, Scalable, Autonomous Reliable Storage for the Cloud

SHF:AF:Small:协作研究：RESAR：稳健、高效、可扩展、自主可靠的云存储

• 批准号: 1219163
• 负责人: Darrell Long
• 金额: $ 37.47万
• 依托单位: University of California-Santa Cruz
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2012
• 资助国家: 美国
• 起止时间: 2012-07-01 至 2016-06-30
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=1219163&HistoricalAwards=false
• 关键词: SHF; AF; Small; Collaborative; Research

With the growth of cloud computing and the changing manner in which individuals and businesses interact with data, it is increasingly important to manage data efficiently and reliably. The RESAR project tackles the problem of building ever-larger data stores, and offers a novel approach to reducing the energy impact of such increases in scale while allowing easier management and adaptation of the system as it ages. In other words, RESAR offers a means to gracefully adapt a storage system to offer increased reliability or performance as demanded by the systems' age or administrator's requirements. This project develops, studies, and optimizes reliable, energy-efficient storage needed in modern data centers and large-scale data storage environments, and allows such storage systems to gracefully increase its performance and reliability while efficiently scaling to millions of storage devices.For storage systems to be feasible and manageable at increasing scales, need to be self-healing and self-optimizing, able to adapt to aging and new components whilst dynamically recovering from inevitable component failures. Cloud computing promises savings in staffing as the volume of work in a data center would be distributed over fewer, but better trained staff. While the increasing scale of such data centers offers greater opportunities for energy-saving measures to become more effective, such scales rapidly increase fears of individual components failing. This demands that such large scale storage systems be arranged in such a way as to offer an ability to survive the failure of multiple components, and to do so with minimal management overheads.To survive the increasingly likely component failures (brought about by the increasing numbers of components in ever-growing data warehouses), storage systems typically employ some form of data replication or redundancy scheme. This strategy not only protects data against loss, but also allows faster access. Unfortunately, doubling or tripling the number of storage devices (or entire data centers) comes at a considerable cost. Alternatively, a site could use erasure correcting codes that provide protection against device failures while only increasing hardware demands by a smaller increment. But such erasure correcting schemes offer limited scalability and can complicate the implementation and self-management of a system considerably. The RESAR approach is to employ novel erasure codes that allow faster layout restructuring, while offering increased scalability, and improved reliability over competing schemes. RESAR allows for restructuring on the fly, and as such, has the added benefit of being complementary to data relocation tasks necessary for routine maintenance and optimization.Cloud computing and data centers are taking hold as technologies with great promise for cheaper, more flexible, and more energy-efficient information processing. RESAR enables cheaper, more reliable, automated and more easily scaled storage systems. RESAR offers a novel graph representation of a failure tolerance scheme that allows the construction of flexible, dynamically reconfigurable, parity-based redundancy schemes that are well-suited for cloud storage infrastructure. By offering the benefits of more highly-convolved erasure coding schemes, whilst remaining simple and efficient, RESAR offers a new path to self-organizing large-scale storage systems. The resulting systems are more maintainable, easily reconfigured for increasing levels of reliability on-demand, and more cost effective. This efficiency further extends to reduced maintenance and energy demands.

随着云计算的发展以及个人和企业与数据交互方式的变化，高效可靠地管理数据变得越来越重要。RESAR项目解决了建立越来越大的数据存储的问题，并提供了一种新颖的方法来减少这种规模增加对能源的影响，同时允许更容易的管理和适应系统的老化。换句话说，RESAR提供了一种方法，可以优雅地调整存储系统，以根据系统的年龄或管理员的需求提供更高的可靠性或性能。该项目开发、研究和优化了现代数据中心和大规模数据存储环境所需的可靠、节能的存储，使这些存储系统能够优雅地提高其性能和可靠性，同时有效地扩展到数百万个存储设备。为了使存储系统在不断增长的规模下可行和可管理，需要自我修复和自我优化，能够适应老化和新组件，同时从不可避免的组件故障中动态恢复。云计算承诺节省人员，因为数据中心的工作量将分配给更少但训练有素的员工。虽然这类数据中心的规模不断扩大，为节能措施变得更加有效提供了更多机会，但这种规模迅速增加了对单个组件失效的担忧。这就要求如此大规模的存储系统以这样一种方式来安排，即提供在多个组件出现故障时仍能存活下来的能力，并以最小的管理开销来做到这一点。为了应对日益可能出现的组件故障（由不断增长的数据仓库中的组件数量不断增加所导致），存储系统通常采用某种形式的数据复制或冗余方案。这种策略不仅可以防止数据丢失，还可以加快访问速度。不幸的是，将存储设备（或整个数据中心）的数量增加一倍或三倍需要付出相当大的代价。或者，站点可以使用擦除纠错码，它提供了防止设备故障的保护，同时只以较小的增量增加硬件需求。但是这种擦除校正方案提供有限的可伸缩性，并且可能使系统的实现和自我管理相当复杂。RESAR方法是采用新颖的擦除码，允许更快的布局重组，同时提供更高的可扩展性，并提高了竞争方案的可靠性。RESAR允许动态重构，因此，它具有补充日常维护和优化所需的数据重定位任务的额外好处。云计算和数据中心作为一种技术正在成为主流，它们有望实现更便宜、更灵活、更节能的信息处理。RESAR使更便宜、更可靠、自动化和更容易扩展的存储系统成为可能。RESAR为容错方案提供了一种新颖的图形表示，允许构建灵活的、动态可重构的、基于奇偶校验的冗余方案，这些方案非常适合云存储基础设施。通过提供更复杂的擦除编码方案的好处，同时保持简单和高效，RESAR为自组织大规模存储系统提供了一条新的途径。由此产生的系统更易于维护，更容易重新配置，以提高按需可靠性水平，并且更具成本效益。这种效率进一步延伸到减少维护和能源需求。