云计算环境的数据存储管控技术研究

发布时间：2018-02-10 16:20

本文关键词： 云计算 Hadoop分布式文件系统 AES算法 Linux的shell 用户空间文件系统　出处：《北方工业大学》2013年硕士论文　论文类型：学位论文

【摘要】：研究以当前热门的云计算为着眼点,首先从云的当前的国内外研究现状出发,研究了关于云存储的一些利弊,以当前比较成熟的开源的云平台Hadoop的分布式文件系统HDFS为基础,详细分析了该分布式文件系统的优缺点,然后就关于云存储的安全性,及存储的便捷性对于未来应用的影响,阐述了本文研究的重要意义。在研究中用到的重要互联网相关技术部分,阐述了其中包含有云计算本身的技术,关于系统级别的技术,以及关于WEB相关的技术,关于处理安全问题时用到的文件的加密和解密技术,关于HDFS分布式文件系统的API (Application Progremming Interface,应用编程接口)。云存储管理系统设计部分,从系统的功能实现出发,阐述了该云环境数据存储管理系统的设计架构。主要分为两部分,即普通用户和管理员(超级用户),普通用户对于自己的存储空间具有上传文件,下载已上传的文件,以及删除自己存储空间的文件的权限,以及对于自身的存储空间在不够用时,在管理员监管下的动态增长方案。关于管理员,是整个云存储的管理者,监管整个云存储的使用情况,详细到了各个数据节点的占用情况,以及查看当前所有的用户的存储空间使用情况,并且可以直接删除已经过期或者不用的用户,从而将存储空间回收归HDFS. 另外管理员可以查看分块之后(HDFS是基于分块存储的备份机制的)实际的文件块存储在的物理机器名称(即实际的数据节点的名称),也就是文件实际所存储的位置。对于普通用户和管理都有基于天的统计信息。对普通用户而言,统计用户的上传文件的折线图,对于管理员则是基于天的,上传到HDFS上的所有文件的折线图。结果分析部分,给出了系统实现过程中对于不同大小的的文件加解密算法的效率比较,以及文件上传到HDFS和硬盘的效率比较,并进行了详细的分析。在系统的实现部分,详细阐述了云存储系统的实现过程。最后对云存储进行了展望。
[Abstract]:The research focuses on the current hot cloud computing. Firstly, from the current research situation of cloud at home and abroad, this paper studies some advantages and disadvantages of cloud storage, based on the distributed file system HDFS of Hadoop, a mature open source cloud platform. The advantages and disadvantages of the distributed file system are analyzed in detail. Then the significance of this paper is expounded on the security of cloud storage and the impact of storage convenience on future applications. The important Internet-related technologies used in the research, including cloud computing itself, system-level technologies, and WEB related technologies, are described. This paper deals with the encryption and decryption technology of files used in dealing with security problems, the API application Progremming interface of HDFS distributed file system, and the application programming interface. In the design part of cloud storage management system, from the function realization of the system, the design framework of the cloud environment data storage management system is expounded. That is, ordinary users and administrators (superusers, ordinary users have permission to upload files for their own storage space, download uploaded files, and delete files in their own storage space, And the dynamic growth scheme under the supervision of the administrator when the storage space is not enough. As for the administrator, he is the manager of the whole cloud storage, supervising the use of the whole cloud storage, The usage of each data node is detailed, and the storage space usage of all current users can be viewed, and users who have expired or not can be deleted directly, so that the storage space can be recycled to HDFSs. In addition, the administrator can view the physical machine name (that is, the name of the actual data node) stored in the actual file block (that is, the bit that the file actually stores) after the partition HDFS is based on the block storage backup mechanism. There are days-based statistics for both the average user and the administration. For the average user, Statistics user upload file line diagram, for the administrator is based on the sky, uploaded to all files on the HDFS line diagram. The efficiency comparison of different file encryption and decryption algorithms and the efficiency comparison between file upload to HDFS and hard disk in the process of system implementation are given and analyzed in detail. In the part of the system implementation, the implementation process of cloud storage system is described in detail. Finally, the prospect of cloud storage is given.
【学位授予单位】：北方工业大学
【学位级别】：硕士
【学位授予年份】：2013
【分类号】：TP333;TP309

【相似文献】