Accelerating NFS/CIFS to produce a tenfold performance improvement for Office/Database applications over the WAN/Grid

本提案的重点是研究应用程序如何最好地利用增加的传输带宽。将建立端到端可用带宽估计模型，以缩小已利用带宽与可用带宽之间日益扩大的差距。本实验室开发了一个核心引擎jetFS，它融合了分布式文件系统技术和高性能数据传输技术，以满足基于WAN/网格的虚拟组织的需求。在实际测试中，jetFS比传统协议高出2-25倍。开发的jetFS的源代码有40000行，我们花了四年多的时间在EPSRC/DTI项目面向网格存储的背景下开发和改进它。这项工作已经被IEEE计算机汇刊接受发表。在本提案中，我们将通过结合已开发的多流jetFS引擎来实现NFS/CIFS的替代协议（a-NFS/CIFS），以加速文件共享流量。随着与现有IT基础设施完全兼容的加速和安全的a-NFS/CIFS，计算机用户可以在互联网上打开和共享远程文件（如vi， Emacs, MySQL, OpenOffice Writer/Impress/Calc, MS Office Word/PowerPoint/Excel），而无需安装新的软件，升级到任何新的平台或改变他们的工作方式。人们认为，a-NFS/CIFS扩展了已建立的互联网架构和协议，以满足当前的需求，并通过对现有数据通信协议的少量版本控制，定位于适应网格计算的未来需求。由此产生的a-NFS/CIFS将在GPL下作为开源提供和支持，从而加强英国主导的开源产品在全球市场上的竞争力。

This proposal focuses on studying how applications can best take advantage of the increased transfer bandwidth. A model for end-to-end available bandwidth estimation will be established to close the growing gap between the utilized bandwidth and available bandwidth. In our lab, a core engine jetFS has been developed, which melds distributed file system technology with high performance data transfer techniques to meet the needs of WAN/Grid-based virtual organizations. In a real-world test, jetFS beats classic protocols by 2-25 times. The source code of the developed jetFS is of 40,000 lines in length and we have spent four plus man years in developing and revamping it within the context of an EPSRC/DTI project Grid-oriented Storage . This work has already been accepted for publication in IEEE Transactions on Computers. In this proposal, we will implement NFS/CIFS's alternative protocols (a-NFS/CIFS) by incorporating the developed multi-streamed jetFS engine to accelerate the file sharing traffic. With the accelerated and secure a-NFS/CIFS that remain fully compatible with the existing IT infrastructures, computer users can open and share remote files (such as vi, Emacs, MySQL, OpenOffice Writer/Impress/Calc, and MS Office Word/PowerPoint/Excel) on the Internet without having to install new software, upgrade to any new platform or change the way they work. The a-NFS/CIFS are believed to extend established Internet architectures and protocols to meet the immediate needs and are positioned to adapt to the future needs of Grid computing through the minor versioning provision of the existing data communication protocols. The resulting a-NFS/CIFS will be made available and supported as open-source under the GPL, strengthening the competitiveness of the UK-led open-source products in the global market.