Metadata and data management for the Keck Observatory Archive
Metadata and data management for the Keck Observatory Archive
复制标题
凯克天文台档案馆的元数据和数据管理
DOI：
--
复制
发表时间：
2014
期刊：
影响因子：
--
通讯作者：
G. Berriman
中科院分区：
文献类型：
--
作者：
H. Tran;J. Holt;R. Goodrich;J. Mader;M. Swain;A. Laity;M. Kong;C. Gelino;G. Berriman
2004年，夏威夷的W.M.Keck天文台(WMKO)和加利福尼亚州的NASA系外行星科学研究所(NExScI)合作建立了Keck天文台档案馆(KOA)，将来自WMKO的观测数据存档，WMKO运营着两个经典的10米地面望远镜。来自Keck的观察数据不适合直接接收到归档中，因为原始FITS标头中包含的元数据缺乏正确归档所需的信息。再加上仪器建造者之间的不同标准，以及经典观测所固有的数据的异质性--在经典观测中，观察者完全控制仪器及其观测，这些数据对KOA提出了一些技术挑战。例如，通常很难确定观测是科学目标、天空框架还是天空平坦。还有必要将数据分配给正确的所有者和观测方案，这对于时间域观测和机会目标观测来说可能是一个挑战，或者在两个或更多的主要调查人员共用一个晚上的分开的夜晚。此外，拥有统一和充分的校准对于适当地减少数据是重要的。因此，KOA需要区分科学文件和校准文件，确定可用的校准类型，并将适当的校准文件与每个科学框架相关联。我们描述了我们为成功解决这些困难而开发的方法和工具，将内容添加到FITS标题中并“改造”元数据，以支持Keck数据的归档，特别是那些在设计归档之前获得的数据。凭借成功地将使用世界气象组织所有八个现行仪器进行的观测存档所获得的专业知识，我们从处理这一复杂的不同类元数据阵列中获得了经验教训，这有助于确保不仅为当前而且为未来的仪器顺利获取数据，并为档案用户提供更好的体验。
A collaboration between the W. M. Keck Observatory (WMKO) in Hawaii and the NASA Exoplanet Science Institute (NExScI) in California, the Keck Observatory Archive (KOA) was commissioned in 2004 to archive observing data from WMKO, which operates two classically scheduled 10 m ground-based telescopes. The observing data from Keck is not suitable for direct ingestion into the archive since the metadata contained in the original FITS headers lack the information necessary for proper archiving. Coupled with different standards among instrument builders and the heterogeneous nature of the data inherent in classical observing, in which observers have complete control of the instruments and their observations, the data pose a number of technical challenges for KOA. For example, it is often difficult to determine if an observation is a science target, a sky frame, or a sky flat. It is also necessary to assign the data to the correct owners and observing programs, which can be a challenge for time-domain and target-of-opportunity observations, or on split nights, during which two or more principle investigators share a given night. In addition, having uniform and adequate calibrations are important for the proper reduction of data. Therefore, KOA needs to distinguish science files from calibration files, identify the type of calibrations available, and associate the appropriate calibration files with each science frame. We describe the methodologies and tools that we have developed to successfully address these difficulties, adding content to the FITS headers and "retrofitting" the metadata in order to support archiving Keck data, especially those obtained before the archive was designed. With the expertise gained from having successfully archived observations taken with all eight currently active instruments at WMKO, we have developed lessons learned from handling this complex array of heterogeneous metadata that help ensure a smooth ingestion of data not only for current but also future instruments, as well as a better experience for the archive user.