SI2-SSE: TestRig 2.0

计算、建模和数字收集方面的进步导致科学数据集的规模呈指数级增长。这种“大数据”正在改变科学发现的过程。然而，许多科学工作流程要求通过互联网等网络将数据传输到最佳位置，以便进行分析和协作。不幸的是，科学家经常在这些网络上遇到性能问题。要解决这些问题，研究人员需要依靠网络运营中心(NOC)工程师的专业知识来进行诊断和解决。解决这些问题通常需要用户和工程师之间的互动周期，这可能会持续几天，如果不是几周的话，会严重阻碍科学工作流程。这个名为TestRig 2.0的项目将通过部署一个简单易用的系统来自动收集各种重要的网络诊断信息，从而缩短这一周期。TestRig 2.0将分发动态生成的测试环境，这些测试环境针对NoC工程师的特定需求进行调整。TestRig 2.0将自动对基础设施运行一系列测试，收集结果，并将结果传输回NOC工程师。TestRig 2.0还将对收集的数据进行粗略分析，以便让工程师对收集的指标有一些初步的了解。在这个项目中，匹兹堡超级计算中心(PSC)的研究人员提议构建一个系统TestRig 2.0，该系统将快速轻松地收集各种重要的网络诊断信息。该系统包括一个集中管理服务器，用于动态创建和配置客户端光盘映像文件(如ISO 9660所定义)。这台服务器将安装在PSC；它将通过免费订阅模式向多个不同地理位置的NOC提供TestRig 2.0服务。这些可引导映像将提供已知良好的TCP堆栈配置和系统环境。TestRig 2.0将使用此基准环境对PerformSONAR监视基础设施执行测试，并收集其他相关数据。生成的数据将由客户进行初步的自动粗略分析，以便为工程师提供对数据的初步了解。最终的分析和原始数据将被打包并传输回适当的NOC进行分析。客户端ISO创建过程将包括唯一的动态生成的公钥/私钥对。该密钥对将用于客户端ISO的身份验证、分发管理和用户/测试管理。相关数据的快速收集将使研究人员能够专注于他们的研究，而不是为网络工程师进行测试，从而加强科学发现的过程。通过为使用和开发收集后数据分析提供一个框架，该系统将降低广泛支助人员进行有效网络诊断所需的门槛。

Advances in computation, modeling, and digital collection have led to an exponential growth in the size of scientific data sets. This 'Big Data' is transforming the process of scientific discovery. However, many scientific workflows require that the data be transferred, via networks like the Internet, to an optimal location for analysis and collaboration. Unfortunately, scientists often encounter performance problems on these networks. To resolve these problems, researchers depend on the expertise of engineers at Network Operations Centers (NOCs) for diagnosis and resolution. Resolving these problems often requires a cycle of interactions between the user and engineer that can last for days if not weeks, seriously hindering the scientific workflow. This project, known as TestRig 2.0, will short circuit this cycle by deploying a simple, easy to use system that will automatically collect a wide variety of important network diagnostic information. TestRig 2.0 will distribute dynamically generated test environments that are tuned to the specific needs of NOC engineers. TestRig 2.0 will automatically runs a series of tests against the infrastructure, collect the results, and transfer them back to the NOC engineer. TestRig 2.0 will also conducted a coarse analysis of the collected data so as to give the engineers some initial insight into the collected metrics.In this project, researchers at Pittsburgh Supercomputing Center (PSC) propose to build a system, TestRig 2.0, that will quickly and easily gather a wide range of important network diagnostic information. This system includes a centralized management server that dynamically creates and configures client optical disk image files (as defined by ISO 9660). This server will be at PSC; it will provide TestRig 2.0 services to multiple geographically diverse NOCs via a free subscription model. These bootable images will provide a known good TCP stack configuration and system environment. TestRig 2.0 will use this baseline environment to perform tests against the perfSONAR monitoring infrastructure and also collect other pertinent data. The resulting data will undergo an initial automated coarse analysis by the client in order to provide engineers initial insight into the data. The resulting analysis and raw data will then be packaged and transferred back to the appropriate NOC for analysis. The client ISO creation process will include a unique dynamically generated public/private key pair. This key pair will be used for the authentication of the client ISO, distribution management, and user/test management. The rapid collection of pertinent data will enhance the process of scientific discovery by allowing researchers to focus on their research, instead of running tests for network engineers. By providing a framework for the use and development of post-collection data analysis, the system will lower the bar required for effective network diagnostics across a wide range of support personnel.