Conceptual design of new data integration and process system for KSTAR data scheduling
Conceptual design of new data integration and process system for KSTAR data scheduling
复制标题
DOI：
10.1016/j.fusengdes.2018.01.015
复制
发表时间：
2018-04
影响因子：
1.7
通讯作者：
T. Tak;Jaesic Hong;K. Park;Woongryul Lee;Taegu Lee;Hyunsun Han;G. Kwon;Jinseop Park
中科院分区：
文献类型：
--
作者：
T. Tak;Jaesic Hong;K. Park;Woongryul Lee;Taegu Lee;Hyunsun Han;G. Kwon;Jinseop Park
KSTAR控制和数据采集系统主要使用MDSPlus的数据存储层来存储诊断数据，并使用通道归档器来存储基于EPICS的控制系统数据。除了这些存储系统之外，KSTAR还拥有各种类型的数据，例如来自关系数据库（RDB）的用户日志和来自控制系统的各种类型的日志。需要像 KSTAR 这样的大型科学机器来实现各种类型的用例来调度数据和数据分析。新数据集成和处理系统的目标是根据 KSTAR 事件在脉冲自动化和调度系统 (PASS) 之上设计 KSTAR 数据调度。 KSTAR数据集成系统（KDIS）是利用大数据软件基础设施和框架设计的。 KDIS 处理与 KSTAR EPICS 事件和其他数据源（例如其余 API 和日志）同步的事件，用于集成和处理来自不同数据源的数据以及可视化数据。在本文中，我们解释了 KDIS 的详细设计概念，并演示了该系统的数据调度用例。
The KSTAR control and data acquisition systems mainly use data storage layer of MDSPlus for diagnostic data and channel archiver for EPICS-based control system data. In addition to these storage systems, KSTAR has various types of data such as user logs from Relational Database (RDB) and various types of logs from the control system. A large scientific machine like KSTAR is needed to implement various types of use cases for scheduling data and data analysis. The goal of a new data integration and process system is to design the KSTAR data scheduling on top of the Pulse Automation and Scheduling System (PASS) according to KSTAR events. The KSTAR Data Integration System (KDIS) is designed by using Big Data software infrastructures and frameworks. The KDIS handles events that are synchronized with the KSTAR EPICS events and other data sources such as the rest API and logs for integrating and processing data from different data sources and for visualizing data. In this paper, we explain the detailed design concept of KDIS and demonstrate a data scheduling use case with this system.