Optimised Data Storage Caching with High Availability Data Delivery within a Distributed Storage Network

在分布式存储网络中优化数据存储缓存和高可用性数据传输

• 批准号: EP/C014987/1
• 负责人: Xiaohong Peng
• 金额: $ 20.3万
• 依托单位: Aston University
• 依托单位国家: 英国
• 项目类别: Research Grant
• 财政年份: 2006
• 资助国家: 英国
• 起止时间: 2006 至 无数据
• 项目状态: 已结题
• 来源: https://gtr.ukri.org/projects?ref=EP%2FC014987%2F1
• 关键词: Optimised; Data; Storage; Caching; Availability

The current technologies and network architectures for the storage network support high quality multimedia data delivery for mobile or remote computing users in the distributed or wireless environments but at a high cost of ownership. As more and more network subscribers join existing distributed storage network the costs of maintaining the reliability and data delivery performance will grow significantly. The research proposal is focussed on a novel distributed storage architecture which addresses the concerns over scalability, reliability and speed. We aim to tackle these problems by introducing a combined strategy for the storage network to efficiently distribute data objects over the storage nodes through intelligent caching, eliminate the need for retransmission by properly controlling packet loss, and subsequently ensure reliable and speedy delivery of high-quality data to mobile computing users. In the new storage system proposed, storage nodes or multiple mirror sites store a sub-set of properly encoded packets of the files with a substantially large size. Upon the request of a file at an access node, the neighbouring nodes will contribute their sub-set of the packets towards the reconstruction of the file requested. This scheme saves storage space, distributes traffic loads across different links, and enables reliable data transfer from source nodes to the clients in parallel. It is intended that the performance gains achieved by using the new scheme will be examined against the costs and overheads involved for different types and scales of applications. The research will be carried out at Aston University and partnered by Xyratex, a technology and market leader in the OEM storage network industry.

用于存储网络的当前技术和网络架构支持在分布式或无线环境中为移动的或远程计算用户提供高质量的多媒体数据递送，但是拥有成本高。随着越来越多的网络用户加入现有的分布式存储网络，维护可靠性和数据传输性能的成本将显着增加。该研究建议的重点是一种新的分布式存储架构，解决了可扩展性，可靠性和速度的关注。我们的目标是解决这些问题，通过引入一个组合策略的存储网络，以有效地分布数据对象的存储节点，通过智能缓存，消除需要通过适当控制数据包丢失的重传，并随后确保可靠和快速交付的高质量的数据到移动的计算用户。在提出的新的存储系统中，存储节点或多个镜像站点存储具有相当大的大小的文件的适当编码的分组的子集。当在接入节点处请求文件时，相邻节点将贡献它们的分组的子集来重建所请求的文件。该方案节省了存储空间，将流量负载分布在不同的链路上，并实现了从源节点到客户端的并行可靠数据传输。当局打算根据不同类别和规模的应用所涉及的成本和间接费用，研究采用新计划所取得的成效。这项研究将在阿斯顿大学进行，并与OEM存储网络行业的技术和市场领导者Xyratex合作。