基于对等结构云存储的副本管理研究

发布时间：2018-01-20 06:26

本文关键词： 云存储 P2P 副本管理可信度　出处：《电子科技大学》2016年硕士论文　论文类型：学位论文

【摘要】：当今全球社会产生的数据量呈现爆炸式增长,由此产生出海量的数据存储需求。在此种背景下,云存储伴随着云计算的产生而一同出现。云存储拥有众多传统的存储方式所不具备的优势,比如良好的扩展性、较低的单位存储成本以及对海量数据的高效存储等等。正是由于这些传统方式所不具备的优势,云存储的研究在各国中也越来越受到重视,企业界也将其作为海量数据存储的首要解决方案。本文为了满足视频点播系统的高清视频存储需求,针对该应用系统的去中心化等特殊用户需求,首先对当前主流的云存储系统进行了分析与研究,然后设计自己的对等结构云存储模型,并对该对等结构云存储模型的副本管理策略进行研究,最后利用设计的云存储模型构建视频点播系统。本文的主要研究内容如下:(1)在主从结构云存储系统HDFS基础上,结合云存储和P2P技术,设计自己的对等结构云存储模型。着重设计了存储簇对等的云存储模型,将多个存储服务器组成一个存储簇,然后再使用Chord算法将多个存储簇组成对等网络。达到对等的云存储不仅拥有云存储的许多优势,而且还拥有P2P技术的众多优点,例如非中心化,优良的扩展性以及杰出地负载均衡等,因此能够有效地解决主从结构中由主节点引起的单点失败的风险以及性能提升的瓶颈。(2)为确保文件的可用性和可靠性,系统采用了多副本冗余技术,实施了主要包括副本放置策略、副本调整策略以及副本一致性策略。支持动态扩充,引入拥有一定可信度的用户机器加入云存储系统,优化了某些局域网用户对云存储系统的访问速度。本文还提出了可信度评价模型,它的提出是为了评价用户机器的可信度。(3)实现了设计的云存储模型原型系统,通过测试实验,验证了设计方案。
[Abstract]:Nowadays, the amount of data generated by the global society is increasing explosively, resulting in a huge amount of data storage requirements. In this context. Cloud storage comes along with the generation of cloud computing. Cloud storage has many advantages that traditional storage methods do not have, such as good scalability. Because of the low unit storage cost and the efficient storage of mass data, cloud storage has been paid more and more attention in many countries because of the advantages that these traditional methods do not have. In order to meet the demand of high-definition video storage in VOD system, this paper aims at the special user needs such as decentralization of the application system. Firstly, the current mainstream cloud storage system is analyzed and studied, then its own peer-to-peer structure cloud storage model is designed, and the replica management strategy of the peer-to-peer structure cloud storage model is studied. Finally, the VOD system is constructed with the designed cloud storage model. The main contents of this paper are as follows: 1) based on the master-slave structure cloud storage system (HDFS), combining cloud storage and P2P technology. This paper designs its own cloud storage model with peer-to-peer structure, focusing on the cloud storage model of storage cluster peer-to-peer, which consists of multiple storage servers to form a storage cluster. Then the Chord algorithm is used to form multiple storage clusters into a peer-to-peer network. The peer-to-peer cloud storage not only has many advantages of cloud storage, but also has many advantages of P2P technology, such as non-centralization. Excellent scalability and excellent load balancing. Therefore, it can effectively solve the risk of single point failure caused by master node in master-slave structure and the bottleneck of performance improvement. (2) in order to ensure the availability and reliability of files, the system adopts multi-replica redundancy technology. The implementation includes replica placement policy, replica adjustment strategy and replica consistency policy. It supports dynamic expansion and introduces user machines with certain credibility to add cloud storage system. The access speed of some LAN users to cloud storage system is optimized. A credibility evaluation model is also proposed in this paper. In order to evaluate the reliability of user machine, the prototype system of cloud storage model is implemented, and the design scheme is verified by test experiment.
【学位授予单位】：电子科技大学
【学位级别】：硕士
【学位授予年份】：2016
【分类号】：TP333

【相似文献】