私有云安全存储技术的研究与实现

发布时间：2018-05-10 17:05

本文选题：私有云 + 安全存储　；参考：《广东工业大学》2013年硕士论文

【摘要】：近年来,随着云计算的新兴发展,基于海量数据的云存储服务已成为大多数企业关注的重点。而云存储的安全问题是阻碍其发展的关键原因之一,即如何确保海量的数据安全地存储在云中,以及如何确保在传输过程安全的前提下尽量提高系统效率。目前,越来越多的大型企业为了适应数据迅速增长的趋势和满足用户随处存储的需求,已经开始考虑部署私有云存储系统。在搭建私有云存储平台时,存在大量的技术问题,如完整性校验和负载均衡等问题。同时随着用户数量和数据量的不断增加,对私有云存储系统服务性能也提出了更高的要求,系统的稳定性、可用性、安全性都必须采取一定的技术手段才能得到保障。本文对私有云存储中的安全问题进行深入探讨和研究,主要研究工作包括： 1.综述了私有云存储技术的国内外研究现状,指出了私有云存储要解决的安全问题。 2.研究了私有云存储中的数据完整性验证技术,提出一种适用于私有云存储的数据完整性验证协议。该协议具有适应性,对于较小的文件,可以通过检查所有的数据块来保证结果的有效性；而对于较大的文件,则可以检查部分数据块以一定的概率来保证数据的完整性,从而减少系统资源和网络带宽的消耗。 3.研究了私有云存储中的负载均衡技术,提出了一种基于ID特征码的数据分片与备份方法,利用文件块ID和可用存储节点ID的对应关系查找存储节点,在出现失效节点时,为对应的文件块随机分配有效存储节点,提高了主服务器的效率；将需要备份的数据文件,在多个存储节点上按指定数量建立数据副本进行分片并选择最优的备份区域存储。 4.应用上述技术,设计了一个基于分布式集群架构的私有云存储系统,实现了数据的分片上传、下载和备份,同时在数据上传和下载过程中对数据进行加密,并可以对数据进行完整性验证。论文的创新之处包括：(1)提出的数据完整性校验协议可以动态的根据文件的大小进行完整性校验,系统只需少量的存储开销和通信开销,就能保证该协议的有效执行,并且随着文件的增大,所消耗的时间仍然保持在较低的值；(2)改进的负载均衡技术是在文件进行上传的过程利用文件块ID和可用存储节点ID的对应关系查找该文件所有分块的存储节点,与一般的方法相比,减少了系统的时间开销,提高系统效率。应用上述技术设计一个基于分布式集群架构的私有云存储系统来对每一种方法的可行性和安全性进行理论上的证明,以确保这些方法能够在实际中得以应用。
[Abstract]:In recent years, with the development of cloud computing, cloud storage service based on massive data has become the focus of most enterprises. The security of cloud storage is one of the key reasons that hinder the development of cloud storage, that is, how to ensure that mass data is safely stored in the cloud, and how to ensure the security of transmission process to improve the system efficiency as much as possible. At present, more and more large enterprises have begun to consider the deployment of private cloud storage system in order to adapt to the trend of rapid growth of data and meet the demand of users to store anywhere. When building private cloud storage platform, there are a lot of technical problems, such as integrity check and load balance. At the same time, with the increasing number of users and data, private cloud storage system service performance is also put forward higher requirements, the system stability, availability, security must take certain technical means to be guaranteed. In this paper, the security problems in private cloud storage are deeply discussed and studied. The main research work includes: 1. This paper summarizes the research status of private cloud storage technology at home and abroad, and points out the security problems to be solved. 2. The data integrity verification technology in private cloud storage is studied, and a data integrity verification protocol for private cloud storage is proposed. The protocol is adaptive. For smaller files, the validity of the results can be guaranteed by checking all data blocks, while for larger files, some data blocks can be checked to ensure the integrity of the data with a certain probability. Thus reducing the consumption of system resources and network bandwidth. 3. In this paper, the load balancing technology in private cloud storage is studied, and a method of data slicing and backup based on ID signature is proposed. The storage nodes are searched by the corresponding relation between the file block ID and the available storage node ID. The efficient storage nodes are allocated randomly to the corresponding file blocks, and the efficiency of the master server is improved, and the data files that need to be backed up are sliced according to the specified number of data replicas on a plurality of storage nodes and the optimal backup area storage is selected. 4. Based on the above technology, a private cloud storage system based on distributed cluster architecture is designed. The data is uploaded, downloaded and backed up, and the data is encrypted in the process of data upload and download. And the integrity of the data can be verified. The innovation of this paper includes: the data integrity verification protocol proposed by: 1) can dynamically verify the data integrity according to the file size. The system requires only a small amount of storage and communication overhead to ensure the effective implementation of the protocol. And as the file grows, The improved load balancing technique is to use the corresponding relationship between the file block ID and the available storage node ID to find all the storage nodes of the file in the process of uploading the file. Compared with the general method, the time cost of the system is reduced and the system efficiency is improved. The above techniques are used to design a private cloud storage system based on distributed cluster architecture to prove the feasibility and security of each method theoretically, so as to ensure that these methods can be applied in practice.
【学位授予单位】：广东工业大学
【学位级别】：硕士
【学位授予年份】：2013
【分类号】：TP333;TP309

【参考文献】