A security framework in G-Hadoop for big data computing across distributed Cloud data centres
A security framework in G-Hadoop for big data computing across distributed Cloud data centres
复制标题
DOI：
10.1016/j.jcss.2014.02.006
复制
发表时间：
2014-08
期刊：
影响因子：
--
通讯作者：
Jiaqi Zhao;Lizhe Wang;J. Tao;Jinjun Chen;Weiye Sun;R. Ranjan;J. Kolodziej;A. Streit;
中科院分区：
文献类型：
--
作者：
Jiaqi Zhao;Lizhe Wang;J. Tao;Jinjun Chen;Weiye Sun;R. Ranjan;J. Kolodziej;A. Streit;
MapReduce被认为是适合大规模数据密集型应用的编程模型。Hadoop框架是一个著名的MapReduce实现，它在集群系统上运行MapReduce任务。G-Hadoop是Hadoop MapReduce框架的扩展，具有允许MapReduce任务在多个集群上运行的功能。然而，G-Hadoop只是简单地重用了Hadoop的用户认证和作业提交机制，该机制是为单个集群设计的。这项工作为G-Hadoop提出了一个新的安全模型。该安全模型基于若干安全解决方案，如公钥加密和SSL协议，并且专门为分布式环境设计。该安全框架通过单点登录方法简化了当前G-Hadoop实现的用户身份验证和作业提交过程。此外，设计的安全框架提供了许多不同的安全机制来保护G-Hadoop系统免受传统攻击。
MapReduce is regarded as an adequate programming model for large-scale data-intensive applications. The Hadoop framework is a well-known MapReduce implementation that runs the MapReduce tasks on a cluster system. G-Hadoop is an extension of the Hadoop MapReduce framework with the functionality of allowing the MapReduce tasks to run on multiple clusters. However, G-Hadoop simply reuses the user authentication and job submission mechanism of Hadoop, which is designed for a single cluster. This work proposes a new security model for G-Hadoop. The security model is based on several security solutions such as public key cryptography and the SSL protocol, and is dedicatedly designed for distributed environments. This security framework simplifies the users authentication and job submission process of the current G-Hadoop implementation with a single-sign-on approach. In addition, the designed security framework provides a number of different security mechanisms to protect the G-Hadoop system from traditional attacks.