智慧教育云存储系统研究与实现

发布时间：2018-06-29 16:21

本文选题：智慧教育 + 云存储　；参考：《北京工业大学》2016年硕士论文

【摘要】：本研究基于云存储技术、多租户技术和SOA(Service-Oriented Architecture,面向服务的体系结构)设计理念构建的智慧教育云存储系统,通过构建开放的、共享的、协同的、公用设施化的数据服务中心为多租户和业务应用程序提供数据存储和数据支撑,实现对教育基础设施的统一管理调度、海量数据的存储及多租户管理,解决了教育系统遇到的诸多问题:硬件基础设施众多且分散,成本较高,维护和管理复杂困难,设备的使用率和工作效率低;各种教育应用系统独立分散,扩展性和业务灵活性差,信息孤岛现象严重;各种教育数据管理复杂,共享困难,缺乏统一的标准等。本论文具体工作是:(1)首先,提出一种针对教育的SOA存储体系架构,能够支持大规模、可扩展、多租户、协同的数据存储机制,存储智慧教育的结构化数据和非结构化数据,为用户提供文件存储服务,并为业务应用程序提供数据服务(查询、新建、更新、删除)接口。(2)对于教育非结构化数据,提出了文件存储的整体解决方案:小文件用Mongo DB存储,大文件用HDFS存储,中文件需要通过中文件处理之后再用HDFS存储,实现多租户访问、存储、上传、下载等。重点研究是中文件处理模块,包括文件的缓存、合并、映射、分解等单元。(3)对于教育的结构化数据:对教育的数据类型进行分析,并建立“半共享数据库半共享Schema”的多租户存储模型,租户通过租户视图进行访问,扩展方面采用xml进行字段扩展,很好地支持多租户模式。(4)对智慧教育云存储系统进行需求分析、设计和实现,用PowerDesigner和Visio建立相关功能模块的用例图、流程图、类图、数据模型等,用Hadoop技术对基础设施进行集群管理,用Redis做文件缓存处理,通过Java Spring MVC框架和Apache CXF框架进行开发实现并测试。本研究构建的智慧教育云存储系统能够有效地为学校、学生、教师、业务程序等提供海量数据存储和支撑平台,推动教育信息化向智慧教育阶段发展。
[Abstract]:This research is based on cloud storage technology, multi-tenant technology and SOA (Service-Oriented Architecture) design concept of intelligent education cloud storage system, by building open, shared, collaborative, The utility data service center provides data storage and data support for multi-tenant and business applications, realizes unified management and scheduling of educational infrastructure, storage of massive data and multi-tenant management. The problems encountered in the education system are solved: the hardware infrastructure is numerous and dispersed, the cost is high, the maintenance and management is complex, the utilization rate of the equipment is low and the work efficiency is low, and all kinds of educational application systems are dispersed independently. Expansibility and business flexibility are poor, information island phenomenon is serious, all kinds of educational data management is complicated, sharing difficulty, lack of unified standard, etc. The main work of this thesis is as follows: (1) first of all, an SOA storage architecture for education is proposed, which can support large-scale, extensible, multi-tenant, cooperative data storage mechanism, and store structured and unstructured data of wisdom education. Provide file storage service for users, and provide data service (query, new, update, delete) interface for business applications. (2) for education of unstructured data, the whole solution of file storage is put forward: small files are stored in Mongo DB. The large files are stored by HDFS, and the files in the middle need to be stored by HDFS after the processing of the files, so that multi-tenant access, storage, upload, download and so on can be realized. The research focuses on the file processing module, including cache, merge, mapping, decomposition and so on. (3) structural data for education: analysis of the data types of education, And the multi-tenant storage model of "semi-shared database semi-shared schema" is established. The tenants access through the tenant view, and the extension uses xml to expand the field. (4) requirement analysis, design and implementation of intelligent education cloud storage system, use case diagram, flow chart, class diagram, data model of related function module with PowerDesigner and Visio, etc. The infrastructure is managed by Hadoop technology, file cache is processed by Redis, and developed and tested by Java Spring MVC framework and Apache CXF framework. The intelligent education cloud storage system constructed in this study can effectively provide massive data storage and support platform for schools, students, teachers, business programs, and promote the development of education information to the stage of wisdom education.
【学位授予单位】：北京工业大学
【学位级别】：硕士
【学位授予年份】：2016
【分类号】：TP333

【相似文献】