CSR: Medium: Rethinking Distributed SSD Storage Systems
CSR:中:重新思考分布式 SSD 存储系统
基本信息
- 批准号:1763546
- 负责人:
- 金额:$ 100万
- 依托单位:
- 依托单位国家:美国
- 项目类别:Continuing Grant
- 财政年份:2018
- 资助国家:美国
- 起止时间:2018-08-15 至 2022-07-31
- 项目状态:已结题
- 来源:
- 关键词:
项目摘要
Modern storage technologies, such as solid-state disks (SSDs), have increased their capacity by increasing density: representing more digital bits in the same physical media. To do so, their margin of error for representing data has shrunk, and the resulting bit error rate has risen. While disks employ error correcting codes to mask such bit errors, these error rates rise as disk blocks age, by being (over)written, and eventually the disk fails. Thus, as density has risen, disks' expected lifetimes have plunged. This research rethinks how to build scalable and cost-effective storage through a cross-layer design to the storage stack.For most datacenter applications, objects are already replicated between multiple devices, and this application-layer redundancy can be leveraged for increased reliability. This research thus explores a new approach for end-to-end reliability for SSD storage systems: datacenter flash devices should be far less reliable and push error visibility and correction up to the distributed application layer. The design challenges and implications of providing such a holistic, cross-layer approach are explored through three research thrusts: at the individual disk layer, at the local file system, and at the distributed storage system layer.By extending the lifecycle of disks by several orders of magnitude, this research has the potential for the adoption of new SSD storage technologies, significant cost savings, and enabling new applications to use SSDs. Due to the plunging lifecycles of newer generations of SSD technologies, large datacenter applications have been unable to integrate these new generations in a number of scenarios (e.g., workloads with heavy write rates, including databases and caches). Given this research's potential for orders of magnitude of reliability improvements, it provides a potential path out from this reliability cliff of the hardware.Code, data, and results relating to this research will be made available via a git repository, hosted publicly at https://github.com/princeton-sns/crosslayer-storage/. Materials will be available throughout the Award term and at least five years following it.This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.
现代存储技术,如固态硬盘(SSD),通过增加密度来增加容量:在相同的物理介质中表示更多的数字位。 为了做到这一点,它们表示数据的误差幅度缩小了,结果误码率上升了。 虽然磁盘采用纠错码来掩盖这样的位错误,但这些错误率随着磁盘块的老化而上升,通过(过)写,最终磁盘出现故障。 因此,随着密度的增加,磁盘的预期寿命会大幅下降。 本研究重新思考如何通过跨层设计来构建可扩展且经济高效的存储堆栈。对于大多数数据中心应用程序,对象已经在多个设备之间复制,并且可以利用此应用程序层冗余来提高可靠性。 因此,这项研究为SSD存储系统的端到端可靠性探索了一种新方法:数据中心闪存设备的可靠性应该远远低于分布式应用程序层,并将错误可见性和纠正推到分布式应用程序层。 通过三个研究重点探讨了提供这种整体的跨层方法的设计挑战和影响:在单个磁盘层、本地文件系统和分布式存储系统层。通过将磁盘的生命周期延长几个数量级,这项研究有可能采用新的SSD存储技术,显著节省成本,并使新的应用程序能够使用SSD。 由于新一代SSD技术的生命周期急剧下降,大型数据中心应用程序无法在许多情况下集成这些新一代技术(例如,具有高写入速率的工作负载,包括数据库和缓存)。 鉴于这项研究的潜在数量级的可靠性改进,它提供了一个潜在的路径从这个可靠性悬崖的硬件.代码,数据,和与这项研究有关的结果将通过一个git存储库,公开托管在https://github.com/princeton-sns/crosslayer-storage/. 材料将在整个奖项期间和至少五年后提供。该奖项反映了NSF的法定使命,并被认为是值得通过使用基金会的知识价值和更广泛的影响审查标准进行评估的支持。
项目成果
期刊论文数量(1)
专著数量(0)
科研奖励数量(0)
会议论文数量(0)
专利数量(0)
Who's Afraid of Uncorrectable Bit Errors? Online Recovery of Flash Errors with Distributed Redundancy
- DOI:
- 发表时间:2019
- 期刊:
- 影响因子:27.8
- 作者:Amy Tai;Andrew Kryczka;Shobhit O. Kanaujia;K. Jamieson;M. Freedman;Asaf Cidon
- 通讯作者:Amy Tai;Andrew Kryczka;Shobhit O. Kanaujia;K. Jamieson;M. Freedman;Asaf Cidon
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
数据更新时间:{{ journalArticles.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ monograph.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ sciAawards.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ conferencePapers.updateTime }}
{{ item.title }}
- 作者:
{{ item.author }}
数据更新时间:{{ patent.updateTime }}
Michael Freedman其他文献
Fighting from the Pulpit: Religious Leaders and Violent Conflict in Israel
讲坛上的战斗:以色列的宗教领袖和暴力冲突
- DOI:
- 发表时间:
2019 - 期刊:
- 影响因子:3.1
- 作者:
Michael Freedman - 通讯作者:
Michael Freedman
From String Nets to Nonabelions
- DOI:
10.1007/s00220-009-0757-9 - 发表时间:
2009-02-14 - 期刊:
- 影响因子:2.600
- 作者:
Lukasz Fidkowski;Michael Freedman;Chetan Nayak;Kevin Walker;Zhenghan Wang - 通讯作者:
Zhenghan Wang
Marriage promotion and missing men: African American women in a demographic double bind.
婚姻促进和男性失踪:处于人口双重困境的非裔美国女性。
- DOI:
- 发表时间:
2004 - 期刊:
- 影响因子:2.2
- 作者:
S. Lane;Robert H. Keefe;R. Rubinstein;B. Levandowski;Michael Freedman;A. Rosenthal;D. Cibula;M. Czerwiński - 通讯作者:
M. Czerwiński
Vote with your rabbi: The electoral effects of religious institutions in Israel
与你的拉比一起投票:以色列宗教机构的选举影响
- DOI:
- 发表时间:
2020 - 期刊:
- 影响因子:2.3
- 作者:
Michael Freedman - 通讯作者:
Michael Freedman
Rhetorics of Radicalism
激进主义的言论
- DOI:
10.1177/0003122419859519 - 发表时间:
2019 - 期刊:
- 影响因子:9.1
- 作者:
Daniel Karell;Michael Freedman - 通讯作者:
Michael Freedman
Michael Freedman的其他文献
{{
item.title }}
{{ item.translation_title }}
- DOI:
{{ item.doi }} - 发表时间:
{{ item.publish_year }} - 期刊:
- 影响因子:{{ item.factor }}
- 作者:
{{ item.authors }} - 通讯作者:
{{ item.author }}
{{ truncateString('Michael Freedman', 18)}}的其他基金
Collaborative Research: CNS CORE: Medium: The Case for Blended Storage
合作研究:CNS CORE:Medium:混合存储案例
- 批准号:
2106530 - 财政年份:2021
- 资助金额:
$ 100万 - 项目类别:
Continuing Grant
BIGDATA: Small: DCM: JetStream: A Flexible Distributed System for Online and In-Place Data Analysis
BIGDATA:小型:DCM:JetStream:用于在线和就地数据分析的灵活分布式系统
- 批准号:
1250990 - 财政年份:2013
- 资助金额:
$ 100万 - 项目类别:
Standard Grant
TC: Large: Collaborative Research: Facilitating Free and Open Access to Information on the Internet
TC:大型:合作研究:促进互联网上信息的自由和开放获取
- 批准号:
1111734 - 财政年份:2012
- 资助金额:
$ 100万 - 项目类别:
Continuing Grant
CAREER: Towards Scalable Datacenter Services with Strong Robustness Guarantees
职业生涯:实现具有强大稳健性保证的可扩展数据中心服务
- 批准号:
0953197 - 财政年份:2010
- 资助金额:
$ 100万 - 项目类别:
Continuing Grant
FIA: Collaborative Research: NEBULA: A Future Internet That Supports Trustworthy Cloud Computing
FIA:合作研究:NEBULA:支持可信云计算的未来互联网
- 批准号:
1040708 - 财政年份:2010
- 资助金额:
$ 100万 - 项目类别:
Continuing Grant
NeTS: Medium: A SCAFFOLD for Service Centric Networking
NeTS:Medium:以服务为中心的网络的支架
- 批准号:
0904729 - 财政年份:2009
- 资助金额:
$ 100万 - 项目类别:
Standard Grant
NeTS: Medium: Collaborative Research: Designing a Content-Aware Internet Ecosystem
NeTS:媒介:协作研究:设计内容感知的互联网生态系统
- 批准号:
0904860 - 财政年份:2009
- 资助金额:
$ 100万 - 项目类别:
Standard Grant
Collaborative Research: NeTS-ANET: A Network Architecture for Federated Virtual/Physical Worlds
合作研究:NeTS-ANET:联合虚拟/物理世界的网络架构
- 批准号:
0831374 - 财政年份:2008
- 资助金额:
$ 100万 - 项目类别:
Continuing Grant
Mathematical Sciences: Low Dimensional Topology
数学科学:低维拓扑
- 批准号:
9208054 - 财政年份:1992
- 资助金额:
$ 100万 - 项目类别:
Continuing Grant
Mathematical Sciences: Low Dimensional Topology
数学科学:低维拓扑
- 批准号:
8901412 - 财政年份:1989
- 资助金额:
$ 100万 - 项目类别:
Continuing Grant
相似海外基金
Collaborative Research: CNS Core: Medium: Rethinking Multi-User VR - Jointly Optimized Representation, Caching and Transport
合作研究:CNS 核心:媒介:重新思考多用户 VR - 联合优化表示、缓存和传输
- 批准号:
2212200 - 财政年份:2022
- 资助金额:
$ 100万 - 项目类别:
Continuing Grant
Collaborative Research: CNS Core: Medium: Rethinking Multi-User VR - Jointly Optimized Representation, Caching and Transport
合作研究:CNS 核心:媒介:重新思考多用户 VR - 联合优化表示、缓存和传输
- 批准号:
2212201 - 财政年份:2022
- 资助金额:
$ 100万 - 项目类别:
Continuing Grant
Collaborative Research: SaTC: CORE: Medium: Rethinking the Fundamentals of Tunneling Technologies for Security, Privacy, and Usability
协作研究:SaTC:核心:中:重新思考隧道技术的安全性、隐私性和可用性的基础知识
- 批准号:
2141512 - 财政年份:2022
- 资助金额:
$ 100万 - 项目类别:
Continuing Grant
Collaborative Research: SaTC: CORE: Medium: Rethinking Fuzzing for Security
协作研究:SaTC:核心:中:重新思考安全性模糊测试
- 批准号:
2213727 - 财政年份:2022
- 资助金额:
$ 100万 - 项目类别:
Standard Grant
Collaborative Research: CNS Core: Medium: Rethinking Multi-User VR - Jointly Optimized Representation, Caching and Transport
合作研究:CNS 核心:媒介:重新思考多用户 VR - 联合优化表示、缓存和传输
- 批准号:
2212202 - 财政年份:2022
- 资助金额:
$ 100万 - 项目类别:
Continuing Grant
Collaborative Research: SaTC: CORE: Medium: Rethinking the Fundamentals of Tunneling Technologies for Security, Privacy, and Usability
协作研究:SaTC:核心:中:重新思考隧道技术的安全性、隐私性和可用性的基础知识
- 批准号:
2141547 - 财政年份:2022
- 资助金额:
$ 100万 - 项目类别:
Continuing Grant
Rethinking Cultured Meat (CM) Growth Medium: Can Grassland Plant-Derived Supplements Sustainably Support CM Production?
重新思考培养肉 (CM) 生长培养基:草原植物源补充剂能否可持续支持 CM 生产?
- 批准号:
2749680 - 财政年份:2022
- 资助金额:
$ 100万 - 项目类别:
Studentship
SaTC: CORE: Medium: Collaborative: Rethinking Access Pattern Privacy: From Theory to Practice
SaTC:核心:媒介:协作:重新思考访问模式隐私:从理论到实践
- 批准号:
2128519 - 财政年份:2021
- 资助金额:
$ 100万 - 项目类别:
Standard Grant
Collaborative Research: SaTC: CORE: Medium: Rethinking Fuzzing for Security
协作研究:SaTC:核心:中:重新思考安全性模糊测试
- 批准号:
2031377 - 财政年份:2020
- 资助金额:
$ 100万 - 项目类别:
Standard Grant
SaTC: CORE: Medium: Collaborative: Rethinking Access Pattern Privacy: From Theory to Practice
SaTC:核心:媒介:协作:重新思考访问模式隐私:从理论到实践
- 批准号:
2001041 - 财政年份:2020
- 资助金额:
$ 100万 - 项目类别:
Standard Grant