面向多数据中心的分布式块存储技术研究
发布时间：2018-08-25 07:39
【摘要】：随着数据中心的应用越来越广,对多数据中心数据共享的要求也越来越迫切。然而,多中心的各存储系统设计架构不同、接口迥异,给统一管理、有效存储、数据检索和更新带来困难;另外,多中心的存储资源分布广泛,数据传输带宽窄、速度慢,对数据访问及其应用的性能造成极大影响。本文针对上述问题开展研究,具体的工作包括:针对基于广域网的存储资源管理架构特征,提出了基于块存储的多层次跨数据中心存储资源管理架构。使用块级存储能有效减少逻辑存储层次,缩短I/0请求,提升系统性能,多层次的存储资源管理在完成存储资源整合的同时能将总的管理负荷分散的各个管理层上,减小管理压力,并降低系统设计实现难度。针对跨域的多中心数据共享特点,提出了跨数据中心的缓存方法。该方法包括读缓存和数据快速更新,位于客户端的读缓存机制能有效提升系统性能,存储卷级的原子更新机制在对数据进行快速更新的同时能保持数据的一致性。设计实现了多数据中心的分布式块存储系统Federal Volume Manager(FVM),进行了性能测试。测试结果显示,FVM在广域网的环境下有较高的数据访问性能。
[Abstract]:With the increasing application of data centers, the requirement of data sharing in multiple data centers is becoming more and more urgent. However, the design of multi-center storage system is different, and the interface is very different, which makes it difficult for unified management, effective storage, data retrieval and update. In addition, the multi-center storage resources are widely distributed, the data transmission band is narrow, and the speed is slow. It has a great impact on the performance of data access and its applications. In this paper, the above problems are studied, including: according to the characteristics of WAN-based storage resource management architecture, a multi-level cross-data center storage resource management architecture based on block storage is proposed. Using block storage can effectively reduce the level of logical storage, shorten I / 0 requests, improve system performance. Multi-level storage resource management can complete the integration of storage resources while dispersing the total management load on the various management levels. Reduce the pressure of management and reduce the difficulty of system design and implementation. According to the characteristics of multi-center data sharing across domains, a method of multi-center caching is proposed. The method includes read cache and fast update of data. The read cache mechanism located in the client can effectively improve the system performance, and the atomic updating mechanism at the storage volume level can keep the consistency of the data while updating the data quickly. A distributed block storage system (Federal Volume Manager (FVM),) with multiple data centers is designed and implemented. The test results show that FVM has high data access performance in WAN environment.
【学位授予单位】：国防科学技术大学
【学位级别】：硕士
【学位授予年份】：2013
【分类号】：TP308;TP333
，
本文编号：2202211
[Abstract]:With the increasing application of data centers, the requirement of data sharing in multiple data centers is becoming more and more urgent. However, the design of multi-center storage system is different, and the interface is very different, which makes it difficult for unified management, effective storage, data retrieval and update. In addition, the multi-center storage resources are widely distributed, the data transmission band is narrow, and the speed is slow. It has a great impact on the performance of data access and its applications. In this paper, the above problems are studied, including: according to the characteristics of WAN-based storage resource management architecture, a multi-level cross-data center storage resource management architecture based on block storage is proposed. Using block storage can effectively reduce the level of logical storage, shorten I / 0 requests, improve system performance. Multi-level storage resource management can complete the integration of storage resources while dispersing the total management load on the various management levels. Reduce the pressure of management and reduce the difficulty of system design and implementation. According to the characteristics of multi-center data sharing across domains, a method of multi-center caching is proposed. The method includes read cache and fast update of data. The read cache mechanism located in the client can effectively improve the system performance, and the atomic updating mechanism at the storage volume level can keep the consistency of the data while updating the data quickly. A distributed block storage system (Federal Volume Manager (FVM),) with multiple data centers is designed and implemented. The test results show that FVM has high data access performance in WAN environment.
【学位授予单位】：国防科学技术大学
【学位级别】：硕士
【学位授予年份】：2013
【分类号】：TP308;TP333
，
本文编号：2202211
本文链接：https://www.wllwen.com/kejilunwen/jisuanjikexuelunwen/2202211.html
