CC*DNI CI Engineer: Adapting Research Workflows to Use Campus Cyberinfrastructure

从生命科学到社会和行为科学的许多领域的研究工作流程正在扩展，需要对更大的数据集进行更多的计算分析。利用本地计算和数据存储资源的工作流必须转换为使用更大的共享计算设施，如UC Berkeley Savio超级计算集群，以及NERSC和XSEDE等国家中心。然而，研究人员一直在努力连接他们的数据源（如实验室仪器，远程数据集等）。在高效、高效的工作流程中共享计算和存储资源。这些障碍包括网络吞吐量差、缺乏数据管理经验、共享计算基础设施和最佳实践等。伯克利研究计算（BRC）计划正在增加网络基础设施工程支持，以吸引研究小组了解他们的需求，并设计和实施有效的工作流程，充分利用校园和国家的计算和数据管理资源。这些研究活动改变了现有的工作流程，以推进特定项目的研究目标，但也提供了其他研究小组可以利用的具体模板，以及未来研究活动的架构模式。BRC CI工程师利用校园资源，包括连接高速州和国家网络链接的科学DMZ，包括加州的高级研究和教育网络（CENIC）和能源科学网络（ESNet），到校园基础设施，包括BRC Savio超级计算集群。BRC CI工程师利用校园在网络、高性能计算和研究数据管理方面的专业知识，以及校园合作伙伴的领域专业知识。随着研究活动的完成和记录，我们将扩大教师对新的可扩展工作流程的理解，并使他们能够解决下一代研究问题。

Research workflows across many domains from life sciences to social and behavioral sciences, are scaling to require more computational analysis of much larger data sets. Workflows that have leveraged local computation and data storage resources must be transformed to use larger shared compute facilities like the UC Berkeley Savio supercomputing cluster, and national centers like NERSC and XSEDE. However, researchers have struggled to connect their data sources (such as laboratory instruments, remote data-sets, etc.) to the shared computation and storage resources in an efficient, productive workflow. Barriers range from poor network throughput, to inexperience with data management and shared computing infrastructure and best practices.The Berkeley Research Computing (BRC) program is adding cyber-infrastructure engineering support to engage research groups to understand their needs, and to design and implement effective workflows that take advantage of campus and national computation and data management resources. These research engagements transform existing workflows to advance project-specific research goals, but also provide concrete templates that other research groups can leverage, and an architectural pattern for research engagement going forward.The BRC CI Engineer leverages campus resources including a Science DMZ that connects high-speed state and national network links, including California's Advanced Research and Education Network (CENIC) and the Energy Sciences Network (ESNet), to campus infrastructure, including the BRC Savio supercomputing cluster. The BRC CI Engineer draws upon campus expertise in networking, high-performance computing, and research data management, as well as the domain expertise of campus partners. As research engagements are completed and documented, we will expand faculty understanding of the new scalable workflows, and enable them to address the next generation of research questions.