Wrangler's user environment: A software framework for management of data-intensive computing system
Wrangler's user environment: A software framework for management of data-intensive computing system
复制标题
Wrangler的用户环境：用于管理数据密集型计算系统的软件框架
DOI：
10.1109/bigdata.2015.7364043
复制
发表时间：
2015
期刊：
影响因子：
--
通讯作者：
D. Stanzione
中科院分区：
文献类型：
--
作者：
Christopher Jordan;David Walling;Weijia Xu;S. Mock;N. Gaffney;D. Stanzione
基于NAND闪存的存储系统的容量和性能的增长已经改变了面向数据的计算系统的面貌。这些系统在使用方式上变得更加强大和灵活。这些变化增加了潜力，也增加了用户的复杂性。虽然许多系统试图通过增加更多的存储缓存层来隐藏这种复杂性，但Wrangler系统的设计却走了一条不同的路线，而是选择构建一个简单而灵活的基于web的界面，允许用户根据自己的服务和软件需求轻松配置这个复杂的数据计算系统。这允许用户在最适合其工作流的环境中工作，同时最佳地利用系统的高性能和高容量存储系统。该界面还允许用户为项目安排长期的预留容量，即“数据活动”。最后，对系统进行了设计，以支持系统的数据存储和共享能力，以实现这些关键方面的数据研究。我们讨论了系统上三个现有工作流的功能，以突出该环境为数据研究人员提供的多样性和灵活性。
The growth in the capacity and capability of NAND Flash based storage systems have changed the face of data oriented computational systems. These systems have become both more capable and flexible in how they are used. With these changes comes both increased potential and user complexity. While many systems attempt to hide this complexity through the addition of more layers of storage caches, the design of the Wrangler system went a different route, choosing instead to build a simple yet flexible web based interface to allow users to easily configure this complex data computing system based on their service and software needs. This allows users to work in the environments best suited to their workflows while optimally utilizing the systems high performance and high capacity storage systems. This interface also allows users to schedule long term periods of reserved capacity, "data campaigns", for projects. Finally, the system has been designed to support the data storage and sharing capacities of the system to enable these key aspects of data research. We discuss the capabilities with respect to three already existing workflows on the system to highlight the diversity and flexibility provided by this environment to data researchers.