基于Hadoop的电信经营数据分析系统的设计与实现

发布时间：2018-04-28 19:48

本文选题：Hadoop + 经营数据分析　；参考：《天津大学》2016年硕士论文

【摘要】：人类已经进入了大数据时代,数据资产成为了企业的核心竞争力,如何围绕电信企业的大数据资产,构建大数据生态系统,以用户体验为导向,创新商业模式,成为了电信企业面临的重要任务。面向电信企业的大数据分析平台,其建设的原则是建设完善的、高性能的、开放的平台;大数据能力平台构建的稳定性是最重要的,重点需要关注部件的性能,以及对某项技术的更新换代。同时提供大数据应用能力开发的开发环境Develop Studio,使大数据合作伙伴能够直接在这个平台上开发应用、发布应用和运行应用。同时,大数据平台的基本架构实现全部云化。基于电信企业对经营分析大数据的需求,本文对基于Hadoop的电信经营分析大数据分析平台的架构进行了设计并对部分功能模块进行了实现。对基于Hadoop的电信运营商大数据平台进行了设计与实现,对此平台的数据、技术架构进行了设计,对架构中的信息整合、数据资产、能力开放等模块进行了设计;,对Hadoop集群在本系统中的应用模式与应用特点进行了设计,对增强的Hadoop架构,以及Hadoop中的HDFS、MapReduce、HBase、MPP等增强功能进行了在系统中的设计。对平台的资源管理模块的实现进行了描述,对运维管控模块进行了实现,尤其对元数据的管理和数据安全进行了详细的实现。实际使用的结果表明,Hadoop架构适合进行电信经营数据的分析统计。本文设计实现的大数据经营分析平台具有很强的实用性。
[Abstract]:Human beings have entered the era of big data, and data assets have become the core competitiveness of enterprises. Has become the telecommunication enterprise to face the important task. Big data's analytical platform for telecommunications enterprises is built on the principle of building a perfect, high performance and open platform. The stability of big data's ability platform is the most important, and the focus is on the performance of components. And the replacement of a technology. At the same time, it provides Develop Studio, a development environment for big data's application capability development, which enables big data partners to develop applications, release applications and run applications directly on this platform. At the same time, big data platform of the basic architecture to achieve all cloud. Based on the requirement of big data, this paper designs the architecture of the analysis platform of the telecom business analysis based on Hadoop and implements some functional modules. This paper designs and implements big data platform of telecom operator based on Hadoop, designs the data and technical framework of this platform, integrates information and data assets in the framework, The application mode and characteristics of Hadoop cluster in this system are designed. The enhanced Hadoop architecture and the enhanced functions such as HDFS MapReduceHBaseMMPP in Hadoop are designed in the system. The implementation of the resource management module of the platform is described, and the operation and maintenance management module is implemented, especially the metadata management and data security are implemented in detail. The practical results show that the Hadoop architecture is suitable for the analysis and statistics of telecom operation data. Big data management analysis platform designed and implemented in this paper has strong practicability.
【学位授予单位】：天津大学
【学位级别】：硕士
【学位授予年份】：2016
【分类号】：F626;TP311.13

【参考文献】