SI2-SSE: TestRig 2.0

计算、建模和数字收集的进步导致科学数据集的规模呈指数级增长。这种“大数据”正在改变科学发现的过程。然而，许多科学工作流程需要通过互联网等网络将数据传输到最佳位置进行分析和协作。不幸的是，科学家们经常在这些网络上遇到性能问题。为了解决这些问题，研究人员依靠网络运营中心（NOC）工程师的专业知识进行诊断和解决。解决这些问题通常需要用户和工程师之间的交互周期，即使不是几周，也可能持续几天，严重阻碍了科学工作流程。该项目被称为TestRig 2.0，将通过部署一个简单易用的系统来缩短这个周期，该系统将自动收集各种重要的网络诊断信息。TestRig 2.0将分发动态生成的测试环境，这些环境针对NOC工程师的特定需求进行了调整。TestRig 2.0将自动对基础设施运行一系列测试，收集结果，并将其传输回NOC工程师。TestRig 2.0还将对收集到的数据进行粗略分析，以便工程师对收集到的指标有初步的了解。在这个项目中，匹兹堡超级计算中心（PSC）的研究人员提出建立一个系统TestRig 2.0，它将快速轻松地收集广泛的重要网络诊断信息。该系统包括一个集中管理服务器，它动态地创建和配置客户端光盘映像文件（如ISO 9660所定义）。该服务器将位于PSC;它将通过免费订阅模式向多个地理位置不同的NOC提供TestRig 2.0服务。这些可引导映像将提供已知良好的TCP堆栈配置和系统环境。TestRig 2.0将使用此基线环境对perfSONAR监测基础设施执行测试，并收集其他相关数据。客户将对生成的数据进行初始自动化粗略分析，以便工程师对数据进行初步了解。然后将得到的分析和原始数据打包并传输回相应的NOC进行分析。客户端ISO创建过程将包括唯一的动态生成的公钥/私钥对。此密钥对将用于客户端ISO的身份验证、分发管理和用户/测试管理。快速收集相关数据将使研究人员能够专注于他们的研究，而不是为网络工程师进行测试，从而增强科学发现的过程。该系统为收集后数据分析的使用和发展提供了一个框架，将降低对各类支助人员进行有效网络诊断所需的门槛。

Advances in computation, modeling, and digital collection have led to an exponential growth in the size of scientific data sets. This 'Big Data' is transforming the process of scientific discovery. However, many scientific workflows require that the data be transferred, via networks like the Internet, to an optimal location for analysis and collaboration. Unfortunately, scientists often encounter performance problems on these networks. To resolve these problems, researchers depend on the expertise of engineers at Network Operations Centers (NOCs) for diagnosis and resolution. Resolving these problems often requires a cycle of interactions between the user and engineer that can last for days if not weeks, seriously hindering the scientific workflow. This project, known as TestRig 2.0, will short circuit this cycle by deploying a simple, easy to use system that will automatically collect a wide variety of important network diagnostic information. TestRig 2.0 will distribute dynamically generated test environments that are tuned to the specific needs of NOC engineers. TestRig 2.0 will automatically runs a series of tests against the infrastructure, collect the results, and transfer them back to the NOC engineer. TestRig 2.0 will also conducted a coarse analysis of the collected data so as to give the engineers some initial insight into the collected metrics.In this project, researchers at Pittsburgh Supercomputing Center (PSC) propose to build a system, TestRig 2.0, that will quickly and easily gather a wide range of important network diagnostic information. This system includes a centralized management server that dynamically creates and configures client optical disk image files (as defined by ISO 9660). This server will be at PSC; it will provide TestRig 2.0 services to multiple geographically diverse NOCs via a free subscription model. These bootable images will provide a known good TCP stack configuration and system environment. TestRig 2.0 will use this baseline environment to perform tests against the perfSONAR monitoring infrastructure and also collect other pertinent data. The resulting data will undergo an initial automated coarse analysis by the client in order to provide engineers initial insight into the data. The resulting analysis and raw data will then be packaged and transferred back to the appropriate NOC for analysis. The client ISO creation process will include a unique dynamically generated public/private key pair. This key pair will be used for the authentication of the client ISO, distribution management, and user/test management. The rapid collection of pertinent data will enhance the process of scientific discovery by allowing researchers to focus on their research, instead of running tests for network engineers. By providing a framework for the use and development of post-collection data analysis, the system will lower the bar required for effective network diagnostics across a wide range of support personnel.