分布式云存储网关的设计与实现
发布时间：2019-06-11 22:57
【摘要】：随着互联网的普及和信息量的爆炸性增长，数据存储花费占企业总体开支的比重越来越大，企业正面临着前所未有的存储挑战。近几年出现的云存储因具有高性价比，高可扩展性，高可用性，高可靠性等优点，正逐渐为市场所接受。尽管云存储技术正处在高速发展中，且具有巨大的市场潜力，但仍存在访问接口不统一、安全性不足、访问速度低下等缺陷，这些缺陷已成为云存储应用的主要障碍。为解决这些问题，本文提出一种云存储网关的设计方案，并基于该方案实现了原型系统。该系统不但能够简化云存储的访问方式，而且能够成倍提高云存储的访问速度，并保护用户数据的安全。 本文所设计的系统通过使用普通PC作为服务器在用户本地搭建而成，以多台普通PC构成的分布式缓存系统作为快速的一级存储设施，以云存储作为慢速、大容量的二级存储设施。系统在将分布式缓存中的文件换出至云存储的过程中自动进行压缩和加密操作，在将云存储中的文件载入至缓存的过程中自动进行解压和解密操作。同时系统为所有本地用户提供全局统一的目录空间和POSIX风格的API。本文的具体工作如下： 1）提出了一种云存储网关的设计方案，，并基于该方案实现了一个云存储网关系统。 2）针对本系统的应用场景就系统涉及到的关键技术如命名空间管理、地址映射、缓存替换和副本管理等进行了详细的讨论，并提出了一种新的元数据组织存储方案和改进的LNC缓存替换算法。 3）给出了系统的整体设计方案和模块划分，并就系统中的主要流程和这些模块之间的交互过程进行了详细的阐述。 4）就系统中关键的命名空间管理模块和缓存空间管理模块进行了详细的阐述，并给出了命名空间管理、地址映射、缓存替换和副本管理等关键技术和算法的详细的设计与实现方案。 5）对原型系统进行了详细的测试，测试结果表明该系统在保证用户数据安全的同时能够有效的提高云存储的访问效率。
[Abstract]:With the popularity of the Internet and the explosive growth of information, data storage costs account for more and more of the total expenditure of enterprises, and enterprises are facing unprecedented storage challenges. In recent years, cloud storage is gradually accepted by the market because of its advantages of high performance-price ratio, high scalability, high availability, high reliability and so on. Although cloud storage technology is in the process of rapid development and has great market potential, there are still some defects, such as inconsistent access interface, insufficient security and low access speed, which have become the main obstacles to cloud storage applications. In order to solve these problems, this paper proposes a design scheme of cloud storage gateway, and implements a prototype system based on this scheme. The system can not only simplify the access mode of cloud storage, but also improve the access speed of cloud storage and protect the security of user data. The system designed in this paper is built locally by using ordinary PC as the server, the distributed cache system composed of several ordinary PC is used as the fast primary storage facility, and the cloud storage is used as the slow and large capacity secondary storage facility. In the process of replacing the files in the distributed cache to the cloud storage, the system automatically compresses and encrypts the files in the cloud storage, and automatically decompresses and decrypts the files in the cloud storage during the process of loading the files into the cache. At the same time, the system provides all local users with globally unified directory space and POSIX-style API.. The main work of this paper is as follows: 1) A design scheme of cloud storage gateway is proposed, and a cloud storage gateway system is implemented based on this scheme. 2) aiming at the application scenario of the system, the key technologies involved in the system, such as naming space management, address mapping, cache replacement and copy management, are discussed in detail, and a new metadata organization storage scheme and an improved LNC cache replacement algorithm are proposed. 3) the overall design scheme and module division of the system are given, and the main flow of the system and the interaction process between these modules are described in detail. 4) the key naming space management module and cache space management module in the system are described in detail, and the detailed design and implementation of key technologies and algorithms, such as naming space management, address mapping, cache replacement and replica management, are given. 5) the prototype system is tested in detail. The test results show that the system can effectively improve the access efficiency of cloud storage while ensuring the security of user data.
【学位授予单位】：电子科技大学
【学位级别】：硕士
【学位授予年份】：2012
【分类号】：TP333
本文编号：2497522
[Abstract]:With the popularity of the Internet and the explosive growth of information, data storage costs account for more and more of the total expenditure of enterprises, and enterprises are facing unprecedented storage challenges. In recent years, cloud storage is gradually accepted by the market because of its advantages of high performance-price ratio, high scalability, high availability, high reliability and so on. Although cloud storage technology is in the process of rapid development and has great market potential, there are still some defects, such as inconsistent access interface, insufficient security and low access speed, which have become the main obstacles to cloud storage applications. In order to solve these problems, this paper proposes a design scheme of cloud storage gateway, and implements a prototype system based on this scheme. The system can not only simplify the access mode of cloud storage, but also improve the access speed of cloud storage and protect the security of user data. The system designed in this paper is built locally by using ordinary PC as the server, the distributed cache system composed of several ordinary PC is used as the fast primary storage facility, and the cloud storage is used as the slow and large capacity secondary storage facility. In the process of replacing the files in the distributed cache to the cloud storage, the system automatically compresses and encrypts the files in the cloud storage, and automatically decompresses and decrypts the files in the cloud storage during the process of loading the files into the cache. At the same time, the system provides all local users with globally unified directory space and POSIX-style API.. The main work of this paper is as follows: 1) A design scheme of cloud storage gateway is proposed, and a cloud storage gateway system is implemented based on this scheme. 2) aiming at the application scenario of the system, the key technologies involved in the system, such as naming space management, address mapping, cache replacement and copy management, are discussed in detail, and a new metadata organization storage scheme and an improved LNC cache replacement algorithm are proposed. 3) the overall design scheme and module division of the system are given, and the main flow of the system and the interaction process between these modules are described in detail. 4) the key naming space management module and cache space management module in the system are described in detail, and the detailed design and implementation of key technologies and algorithms, such as naming space management, address mapping, cache replacement and replica management, are given. 5) the prototype system is tested in detail. The test results show that the system can effectively improve the access efficiency of cloud storage while ensuring the security of user data.
【学位授予单位】：电子科技大学
【学位级别】：硕士
【学位授予年份】：2012
【分类号】：TP333
【引证文献】
相关期刊论文 前1条
1 赵铁柱;邓见光;;面向大规模数据备份的云存储网关研究[J];计算机光盘软件与应用;2013年12期
本文编号：2497522
本文链接：https://www.wllwen.com/kejilunwen/jisuanjikexuelunwen/2497522.html
