基于Hadoop的云教学资源平台设计与优化

发布时间：2018-01-22 01:24

本文关键词： 云计算虚拟化 Hadoop 教学资源平台优化　出处：《沈阳师范大学》2017年硕士论文　论文类型：学位论文

【摘要】：随着高等院校信息化进程不断的发展进步,使得其教学资源的特征出现了相应的变化。首先在教学资源数量上呈爆炸式增长,其次在资源的数据结构上也呈现出多样性,既有结构化数据,也有非结构化数据。采用传统的基于集中式服务器管理的教学资源平台已经不能满足教学资源的大数据化所带来的需求,这就给我们设计和开发教学资源平台提出了新的挑战。而云计算技术的发展对解决大数据问题有很大的帮助。因此,本论文针对当前高校对教育资源的需求现状,在以Hadoop体系框架为基础的云平台上设计教学资源平台解决实际问题,并对Hadoop平台以及教学资源平台进行测试与优化,对测试与优化结果进行了分析与评价。本文首先阐明了研究基于云计算技术的教学资源平台的理论和实际意义,提出研究背景和研究目的,同时分析了当前国内外对于云计算技术与教育教学领域相结合的研究现状。其次对云计算与教学资源平台的相关技术与理论做了介绍与说明。介绍了云计算技术的体系结构,分析了云计算技术与大数据的关系;介绍了虚拟化技术,以及对Hadoop生态系统进行了阐述与分析。其次,本文阐述了使用VMware软件与Hadoop开源软件在实验机上虚拟计算机集群并搭建完全分布式云平台的过程,之后对搭建完成的云平台进行了简单的运行测试。在云平台之上,本文分析了当前高校对教学资源平台的需求,设计了基于Hadoop框架的教学资源平台。首先对教学资源平台进行功能模块设计,提出总体框架;其次根据对当前教学资源的数据特征与结构的分析,使用不同的数据库管理系统分别处理结构化和非结构化的数据。阐述了使用MySQL设计结构化数据库以及使用HBase设计非结构化数据库的过程;还介绍了该教学资源平台的web界面的设计过程。本文分析了教学资源数据的特点,包括教学资源数据的大小、格式、类型等.针对教学资源数据的特点,结合Hadoop云平台的HDFS存储以及名MapReduce运行进行了有针对性的优化设计并对平台进行基准测试以及对比分析,得出了教学资源数据存储在云平台上的优化的相关结论。最后,本文对平台的整个设计过程进行了总结与评价。以期为云计算技术与教学资源应用相结合的相关研究提供理论参考和实践经验。
[Abstract]:With the continuous development and progress of the information process in colleges and universities, the characteristics of its teaching resources have changed accordingly. Firstly, the quantity of teaching resources has explosive growth. Secondly, there is diversity in the data structure of resources, existing structured data. There are also unstructured data. The traditional teaching resource platform based on centralized server management can no longer meet the needs of the large data of teaching resources. This gives us a new challenge in designing and developing instructional resource platforms, and the development of cloud computing technology is a great help to solve big data's problem. In view of the current demand for educational resources in colleges and universities, this paper designs a platform for teaching resources to solve practical problems on the cloud platform based on the Hadoop framework. And the Hadoop platform and teaching resources platform for testing and optimization. The test and optimization results are analyzed and evaluated. Firstly, this paper expounds the theoretical and practical significance of the research on the platform of teaching resources based on cloud computing technology, and puts forward the research background and research purpose. At the same time, it analyzes the current research situation of cloud computing technology and education and teaching field at home and abroad. Secondly, it introduces and explains the related technology and theory of cloud computing and teaching resource platform, and introduces cloud computing technology. For the. The relationship between cloud computing technology and big data is analyzed. The virtualization technology is introduced, and the Hadoop ecosystem is described and analyzed. Secondly. This paper describes the process of using VMware software and Hadoop open source software to cluster virtual computers and build a completely distributed cloud platform. On the basis of the cloud platform, this paper analyzes the demand of the teaching resource platform in colleges and universities. The teaching resource platform based on Hadoop framework is designed. Firstly, the function module of the teaching resource platform is designed, and the overall framework is put forward. Secondly, according to the analysis of the data characteristics and structure of the current teaching resources. Different database management systems are used to deal with structured and unstructured data. The process of using MySQL to design structured database and HBase to design unstructured database is described. This paper also introduces the design process of the web interface of the teaching resource platform. This paper analyzes the characteristics of the teaching resource data, including the size, format and type of the teaching resource data, and aims at the characteristics of the teaching resource data. Combined with the HDFS storage of Hadoop cloud platform and the name of MapReduce running, the optimization design of the platform is carried out, and the benchmark and comparative analysis of the platform are carried out. Finally, the relevant conclusions of the optimization of teaching resources data storage on the cloud platform are obtained. In this paper, the whole design process of the platform is summarized and evaluated in order to provide theoretical reference and practical experience for the research of the combination of cloud computing technology and the application of teaching resources.
【学位授予单位】：沈阳师范大学
【学位级别】：硕士
【学位授予年份】：2017
【分类号】：TP311.13;TP393.09

【相似文献】