Bifrost: a Python/C++ Framework for High-Throughput Stream Processing in Astronomy

Bifrost: a Python/C++ Framework for High-Throughput Stream Processing in Astronomy
复制标题

Bifrost:用于天文学高吞吐量流处理的 Python/C 框架

DOI:
10.1142/s2251171717500076
复制
发表时间:
2017
期刊:
ArXiv
影响因子:
--
通讯作者:
L. Greenhill
L. Greenhill
中科院分区:
--
文献类型:
--
作者:
M. Cranmer;B. Barsdell;D. Price;J. Dowell;H. Garsden;V. Dike;T. Eftekhari;A. Hegedus;J. Malins;K. Obenberger;F. Schinzel;K. Stovall;Gregory B. Taylor;L. Greenhill

文献摘要

参考文献

被引文献

相似文献

具有高吞吐量后端仪器的射电天文观测站需要实时数据处理。虽然计算硬件继续快速发展,但实时处理管道的开发仍然困难且耗时,这可能会限制科学生产力。受此启发,我们开发了Bifrost:一个用于快速管道开发的开源软件框架。(a)Bifrost将高级Python接口与高效的可重新配置数据传输以及用于CPU和GPU处理的计算块库相结合。该框架是可推广的,但最初它强调了高吞吐量射电天文管道的需求,例如处理数据缓冲区的能力,就好像它们是连续流一样,将处理划分为不同数据序列的能力(例如单独的观测),以及从缓冲数据中提取特定间隔的能力。库中的计算模块是为干涉测量、脉冲星去色散等应用而设计的。
Radio astronomy observatories with high throughput back end instruments require real-time data processing. While computing hardware continues to advance rapidly, development of real-time processing pipelines remains difficult and time-consuming, which can limit scientific productivity. Motivated by this, we have developed Bifrost: an open-source software framework for rapid pipeline development.(a) Bifrost combines a high-level Python interface with highly efficient reconfigurable data transport and a library of computing blocks for CPU and GPU processing. The framework is generalizable, but initially it emphasizes the needs of high-throughput radio astronomy pipelines, such as the ability to process data buffers as if they were continuous streams, the capacity to partition processing into distinct data sequences (e.g. separate observations), and the ability to extract specific intervals from buffered data. Computing blocks in the library are designed for applications such as interferometry, pulsar dedisp...
DOI: 10.1088/1538-3873/aa80d2
发表时间: 2018-04-01
影响因子: 3.5
作者:
MacMahon, David H. E.;Price, Danny C.;Woody, Dave
通讯作者: Woody, Dave
DOI: 10.1017/s1743921312024623
发表时间: 2013
期刊: Proceedings of the International Astronomical Union
影响因子: --
作者:
Serylak M
通讯作者: Serylak M