云存储网关的研究与实现
发布时间：2018-07-18 14:40
【摘要】：云存储作为一种新兴的基于对象的数据存储模式，，已经成为云计算领域发展最早和最成熟的应用之一。尽管云存储技术具有巨大的市场潜力，但是在实际应用的过程中，云存储无法与传统存储设备和应用进行无缝衔接，存在访问接口不统一、访问延迟大等问题。 云存储网关系统实现了多个云存储平台接口的统一管理，通过缓存管理和热点数据迁移降低客户端访问延迟，通过选择性价比高的云存储平台降低存储成本，通过跨云平台数据迁移实现云平台之间的互操作。系统由4个模块构成，基本操作模块监听并接收从客户端发送过来的访问请求，通过用户验证连接云存储平台，对请求进行响应。云平台统一管理模块将云存储网关存储池中的数据上传到合适的云存储平台，构建和管理云平台与网关存储节点间的文件映射表，并实现多个云存储平台的统一管理。热点数据迁移模块定时获取存储节点的状态信息，根据节点状态选取部分热点数据，迁往合适的目的存储节点缓存，并根据请求自主迁回部分热点数据。跨云平台数据迁移模块从云存储平台上下载待迁移数据缓存至网关存储节点，接着将数据上传至目的云存储平台，然后同步文件映射表。 采用多版本的系统和软件安装镜像以及流媒体文件，对系统的功能和性能进行测试。测试结果表明，系统对多平台的统一管理功能、热点数据迁移功能、云平台统一管理下载功能和跨云平台数据迁移功能都能正常运行。当请求数据缓存在网关内时，存储节点响应速度是云端响应速度的5-30倍。依据阿里云和盛大云平台的收费标准，本系统的存储成本仅是无网关系统的六分之一，存储成本降低了86.1%。
[Abstract]:Cloud storage, as a new object based data storage mode, has become one of the earliest and most mature applications in cloud computing. Although cloud storage technology has great market potential, cloud storage can not connect seamlessly with traditional storage devices and applications in the process of practical application, and there are many problems such as disunity of access interface, large access delay and so on. Cloud storage gateway system realizes unified management of multiple cloud storage platform interfaces, reduces client access delay through cache management and hot data migration, and reduces storage cost by selecting cloud storage platform with high performance and price ratio. The interoperability between cloud platforms is realized through data migration across cloud platforms. The system is composed of four modules. The basic operation module listens on and receives the access request sent from the client, connects the cloud storage platform through the user verification, and responds to the request. The cloud platform unified management module uploads the data in the cloud storage gateway storage pool to the suitable cloud storage platform, constructs and manages the file mapping table between the cloud platform and the gateway storage node, and realizes the unified management of multiple cloud storage platforms. The hot data migration module acquires the state information of the storage node periodically, selects part of the hot data according to the node state, moves to the appropriate destination storage node cache, and moves back part of the hot spot data independently according to the request. The data migration module downloads the data to the gateway storage node from the cloud storage platform, then uploads the data to the destination cloud storage platform, and then synchronizes the file mapping table. The function and performance of the system are tested by multi-version system and software installation mirror and streaming media file. The test results show that the unified management function, hot data migration function, unified management and download function of cloud platform and data migration function across cloud platform can all run normally. When the request data is cached in the gateway, the response speed of the storage node is 5-30 times faster than that of the cloud. According to the charge standard of Ali cloud and Shanda cloud platform, the storage cost of this system is only 1/6 of that of no gateway system, and the storage cost is reduced by 86.1.
【学位授予单位】：华中科技大学
【学位级别】：硕士
【学位授予年份】：2013
【分类号】：TP333
本文编号：2132222
[Abstract]:Cloud storage, as a new object based data storage mode, has become one of the earliest and most mature applications in cloud computing. Although cloud storage technology has great market potential, cloud storage can not connect seamlessly with traditional storage devices and applications in the process of practical application, and there are many problems such as disunity of access interface, large access delay and so on. Cloud storage gateway system realizes unified management of multiple cloud storage platform interfaces, reduces client access delay through cache management and hot data migration, and reduces storage cost by selecting cloud storage platform with high performance and price ratio. The interoperability between cloud platforms is realized through data migration across cloud platforms. The system is composed of four modules. The basic operation module listens on and receives the access request sent from the client, connects the cloud storage platform through the user verification, and responds to the request. The cloud platform unified management module uploads the data in the cloud storage gateway storage pool to the suitable cloud storage platform, constructs and manages the file mapping table between the cloud platform and the gateway storage node, and realizes the unified management of multiple cloud storage platforms. The hot data migration module acquires the state information of the storage node periodically, selects part of the hot data according to the node state, moves to the appropriate destination storage node cache, and moves back part of the hot spot data independently according to the request. The data migration module downloads the data to the gateway storage node from the cloud storage platform, then uploads the data to the destination cloud storage platform, and then synchronizes the file mapping table. The function and performance of the system are tested by multi-version system and software installation mirror and streaming media file. The test results show that the unified management function, hot data migration function, unified management and download function of cloud platform and data migration function across cloud platform can all run normally. When the request data is cached in the gateway, the response speed of the storage node is 5-30 times faster than that of the cloud. According to the charge standard of Ali cloud and Shanda cloud platform, the storage cost of this system is only 1/6 of that of no gateway system, and the storage cost is reduced by 86.1.
【学位授予单位】：华中科技大学
【学位级别】：硕士
【学位授予年份】：2013
【分类号】：TP333
【参考文献】
相关期刊论文 前1条
1 高建秀;吴振新;孙硕;;云存储在数字资源长期保存中的应用探讨[J];现代图书情报技术;2010年06期
本文编号：2132222
本文链接：https://www.wllwen.com/kejilunwen/jisuanjikexuelunwen/2132222.html
