CAREER: of Computational and Data Access Scheduling in NOWs

工作站网络（NOW）已经成为科学计算的主要基础设施。 NOWS目前用于提供桌面顺序计算和可视化、批量顺序作业的高吞吐量机会计算以及专用并行计算。 此外，我们设想NOW被用来存储和检索数据集，使用科学数据库管理系统（DBMS），提供并行程序的机会计算，允许大型磁盘驻留数据集的交互式可视化。 目前的知识状态提供了大部分的工具，使这种设想的NOW使用，但缺乏所需的调度策略。 为了纠正这一点，该项目将： * 设计新的调度算法来处理工作站作业、批量机会顺序作业和批量机会并行作业的混合工作负载。 * 描述科学数据库管理系统工作负载的特征，并设计如何最好地将科学数据库管理系统集成到NOW中。 * 确定如何最好地集成索引技术，以支持大型磁盘驻留数据集的交互式可视化。 * 制定系统范围的调度政策，认识到NOW使用的所有方面。 这些策略的目标是为所有并发运行的应用程序（包括计算、可视化和数据访问）提供良好的聚合性能。 拟议的工作将开发NOW性能的综合分析和模拟模型，包括所有上述因素，以确定如何优化整体性能，并将开发系统的工作原型。

Networks of workstations (NOWs) have been emerged as a primary infrastructure for scientific computing. NOWS are currently used to provide desktop sequential computing and visualization, high throughput opportunistic computing of batched sequential jobs, and dedicated parallel computing. In addition, we envision NOWs being used to store and retrieve data sets using scientific database management systems (DBMSs), provide opportunistic computation of parallel programs, allow interactive visualization of large disk resident data sets. The current state of knowledge provides most of the tools to enable this envisioned NOW usage, but lacks the needed scheduling policies. To remedy this, this project will: * Devise new scheduling algorithms to handle mixed workloads of workstations jobs, batched opportunistic sequential jobs, and batched opportunistic parallel jobs. * Characterize scientific DBMS workloads and develop designs on how best to integrate scientific DBMSs into the NOW. * Determine how best to integrate indexing techniques to provide support for interactive visualization of large disk resident data sets. * Develop system wide scheduling policies that are cognizant of all aspects of NOW usage. The goal of such policies is to provide good aggregate performance of all concurrently running applications including computation, visualization, and data access. The proposed work will develop comprehensive analytical and simulation models of NOW performance, including all of the above factors, to determine how to optimize overall performance and will develop a working prototype of the system.