ATLAS: Big Data Storage and Analytics Tool for ATM Researchers

ATLAS: Big Data Storage and Analytics Tool for ATM Researchers
复制标题

ATLAS：ATM 研究人员的大数据存储和分析工具

DOI：
--
复制
发表时间：
2016
期刊：
影响因子：
--
通讯作者：
Jyotirmaya Nanda
Jyotirmaya Nanda
中科院分区：
--
文献类型：
--
作者：
A. Tyagi;Jyotirmaya Nanda

文献摘要

被引文献

相似文献

本文介绍了空中交通管理（ATM）研究人员的数据仓库和大数据分析工具ATLAS的体系结构和开发。本文描述了该工具开发背后的动机，并提供了开发过程的设计考虑和约束。ATLAS旨在成为一个多层次、多目标的大数据分析工具，从各种ATM数据存储中提取ATM数据，并在可操作的时间内为整体分析做好准备。ATLAS旨在成为各种ATM数据的智能存储库，并允许用户组合数据集，查询和分析它们。用户无需手动下载、清理、摄取和查询一个或多个数据集的一小部分，只需单击一个按钮，就可以使用ATLAS完成所有这些步骤。ATLAS利用了最新的大数据工具和非关系数据库、映射约简、弹性分布式数据集和分布式文件系统存储等技术来优化ATM数据从存储库到用户的流程。工具架构允许部署在私有或公共云基础设施上，并且可以通过充当最终用户ATLAS门户的网站访问。web门户支持原始数据的上传/摄取、数据质量检查、查询数据子集、下载数据，甚至提供REST端点。本文介绍了ATLAS迄今取得的进展。
This paper presents the architecture and development of ATLAS, a data warehousing and Big Data analytics tool for Air Traffic Management (ATM) researchers. The paper describes the motivation behind the development of this tool and provides the design considerations and constraints for the development process. ATLAS is designed to be a multi-level, multiobjective tool for Big Data analysis that extracts ATM data from a variety of ATM data stores and prepares it for holistic analysis within an actionable timeline. ATLAS aims to be an intelligent repository for a variety of ATM data and would allow users to combine datasets, query and analyze them. Instead of downloading, cleaning, ingesting, and querying a small subset of one or multiple datasets, manually, the user could use ATLAS for all those steps with the click of a button. ATLAS leverages on recent Big Data tools and techniques of nonrelational databases, map reduce, resilient distributed datasets, and distributed file system storage to optimize the flow of ATM data from the repository to the user. The tool architecture allows for deployment on private or public cloud infrastructure and can be accessed via a website that acts as ATLAS portal for the end user. The web portal supports upload/ingestion of raw data, data quality checks, querying a subset of data, downloading data, and even provides REST end points. This paper presents the advances made towards ATLAS thus far.