Hadoop加速比性能模型研究
发布时间：2018-07-15 20:07
【摘要】：MapReduce编程模型被看作是Hadoop的核心组件,一直以来都受到广泛的应用和研究,但针对Hadoop云平台的性能研究主要集中在配置调优和分布式算法等方面,缺乏对Hadoop加速比性能模型的理论研究.针对此问题提出了Hadoop云平台加速比性能模型,并分别在同构机群和异构机群架构上对该模型进行了分析.针对同构机群提出了3种I/O负载模型,并指出了其对加速比的影响;指出了异构机群不适合做Hadoop云平台的原因及异构性对Hadoop云平台造成的影响.这些研究对Hadoop云计算平台的搭建及如何提高Hadoop云平台加速比性能有很好的指导作用,提供了理论依据.
[Abstract]:MapReduce programming model is regarded as the core component of Hadoop and has been widely used and studied. However, the performance of Hadoop cloud platform is mainly focused on configuration tuning and distributed algorithms. There is a lack of theoretical research on Hadoop speedup performance model. To solve this problem, a speedup performance model of Hadoop cloud platform is proposed, and the model is analyzed on isomorphic cluster and heterogeneous cluster architecture, respectively. Three kinds of I / O load models for isomorphic clusters are proposed, and their effects on acceleration ratio are pointed out, and the reasons why heterogeneous clusters are not suitable for Hadoop cloud platforms and the effects of heterogeneity on Hadoop cloud platforms are pointed out. These studies have a good guidance on how to build Hadoop cloud computing platform and how to improve the speedup performance of Hadoop cloud platform.
【作者单位】： 河南师范大学网络中心;河南师范大学计算机与信息工程学院;
【基金】：河南省基础与前沿技术研究项目(132300410389)
【分类号】：TP302.7
[Abstract]:MapReduce programming model is regarded as the core component of Hadoop and has been widely used and studied. However, the performance of Hadoop cloud platform is mainly focused on configuration tuning and distributed algorithms. There is a lack of theoretical research on Hadoop speedup performance model. To solve this problem, a speedup performance model of Hadoop cloud platform is proposed, and the model is analyzed on isomorphic cluster and heterogeneous cluster architecture, respectively. Three kinds of I / O load models for isomorphic clusters are proposed, and their effects on acceleration ratio are pointed out, and the reasons why heterogeneous clusters are not suitable for Hadoop cloud platforms and the effects of heterogeneity on Hadoop cloud platforms are pointed out. These studies have a good guidance on how to build Hadoop cloud computing platform and how to improve the speedup performance of Hadoop cloud platform.
【作者单位】： 河南师范大学网络中心;河南师范大学计算机与信息工程学院;
【基金】：河南省基础与前沿技术研究项目(132300410389)
【分类号】：TP302.7
【参考文献】
相关期刊论文 前6条
1 孙健;贾晓菁;;Google云计算平台的技术架构及对其成本的影响研究[J];电信科学;2010年01期
2 栾亚建;黄烂，
本文编号：2125235
本文链接：https://www.wllwen.com/kejilunwen/jisuanjikexuelunwen/2125235.html
