CSR: Small: Managing and Indexing Exascale Archival Storage Systems

CSR：小型：管理和索引百亿亿次归档存储系统

• 批准号: 0917396
• 负责人: Ethan Miller
• 金额: $ 48.91万
• 依托单位: University of California-Santa Cruz
• 依托单位国家: 美国
• 项目类别: Standard Grant
• 财政年份: 2009
• 资助国家: 美国
• 起止时间: 2009-09-01 至 2013-08-31
• 项目状态: 已结题
• 来源: https://www.nsf.gov/awardsearch/showAward?AWD_ID=0917396&HistoricalAwards=false
• 关键词: CSR; Small; Managing; Indexing; Exascale

This award is funded under the American Recovery and Reinvestment Act of 2009 (Public Law 111-5).As our society stores ever-increasing quantities of digital data and abandons analog storage, we must be able to manage, organize, and preserve digital data for decades or longer. Maintaining access to large-scale digital archives will be critical in enabling future generations to access the medical records, personal information, photographs, and other data that we are generating and storing digitally. However, current approaches to archival storage are ill-suited to long-term preservation because they do not cope well with evolution of device technologies and rely upon centralized search indexes that do not scale well and are prone to failure.This project is exploring techniques that allow the management of large-scale archives containing 105?106 intelligent power-managed storage devices connected by a network. These techniques allow seamless evolution of the archival storage system by integrating new devices and removing old, inefficient devices. The research is also developing approaches to index data in the archive, allowing users to quickly find the data they need by maintaining indexes on each device and routing queries to the devices that might contain relevant data. These techniques will allow archives to scale to hundreds of thousands of devices, allowing them to contain the vast digital legacy we are leaving to our descendants.This research will guide the design of archives that are power-efficient and can gracefully evolve as storage technology changes. Additionally, the project will train both undergraduates and graduate students in the problems facing digital archiving, an area of critical importance.

该奖项是根据2009年《美国回收与再投资法》（公法111-5）资助的。由于我们的社会商店不断增加数量的数字数据和放弃模拟存储，因此我们必须能够管理，组织和保存数字数据数十年或更长时间。 保持大规模数字档案的访问对于使后代访问我们正在以数字方式生成和存储的医疗记录，个人信息，照片和其他数据至关重要。 但是，当前的档案存储方法不适合长期保存，因为它们不能很好地与设备技术的发展相符，并且依靠集中式搜索索引，这些索引的规模不佳并且容易失败。该项目正在探索允许包含105个智能电动存储设备网络的大型档案的管理技术，该技术由网络连接到一个智能的电动储存设备。 这些技术可以通过集成新设备并卸下旧的，效率低下的设备来无缝发展档案存储系统。 该研究还正在开发存档中索引数据的方法，使用户可以通过在每个设备上维护索引并将查询路由到可能包含相关数据的设备来快速找到所需的数据。 这些技术将允许档案扩展到数十万个设备，从而允许它们包含我们留给我们后代的庞大数字遗产。这项研究将指导随着存储技术的变化而设计的档案效率，可以优雅地发展的档案。 此外，该项目将培训本科生和研究生在数字档案中面临的问题，这是至关重要的领域。