分布式块存储系统节能技术研究

发布时间：2018-04-13 00:02

本文选题：分布式块存储系统 + 分区策略　；参考：《华中科技大学》2013年硕士论文

【摘要】：随着大数据时代的来临，数据中心要存储或处理的数据的规模急剧攀升，因此有必要对现有数据中心进行扩容或者建造更多大规模数据中心，伴随而来的是能耗的大幅增长。在能源紧缺的今天，能耗问题已经成为数据中心面临的最大挑战。继性能、可靠性之后，能耗参数正成为衡量存储系统优劣的另一重要指标。分布式块存储系统已经成为构建数据中心的典型方式，因此研究分布式块存储系统节能技术，具有重要意义。从芯片级到磁盘级，从阵列级到集群级，目前存储系统已经有一些节能技术的研究成果，但往往具有一定的局限性。一般来说，节能技术主要通过冗余、多转速、缓存、不平衡负载等手段来实现。针对多副本机制的分布式块存储系统，，基于现有的节能技术，综合了辅助节点技术、一致性哈希技术、虚拟节点技术，并巧妙地运用了分区副本策略，彻底规避了其他节能技术通常会面对的最小全覆盖问题。基于以上技术，对开源的“牧羊犬”系统进行了改进，实现了可节能的分布式块存储系统。改进后的块存储系统为全对称无中心结构，依赖corosync管理集群节点，采用epoll机制处理事件请求。通过对原系统和改进后的系统进行相同负载下的测试对比，证明改进后的系统的确可以在较小性能损耗的情况下达到较理想的节能效果。但目前系统还存在自动化程度较低等问题，还需要进一步改进。
[Abstract]:With the advent of big data era, the scale of the data centers to store or process has risen sharply, so it is necessary to expand the existing data centers or build more large-scale data centers, accompanied by a large increase in energy consumption.In today's energy shortage, energy consumption has become the biggest challenge faced by the data center.Following the performance and reliability, energy consumption parameters are becoming another important index to measure the quality of storage system.Distributed block storage system has become a typical way to construct data center, so it is of great significance to study the energy saving technology of distributed block storage system.From the chip level to the disk level, from the array level to the cluster level, there have been some research results of energy saving technology in the memory system, but they often have some limitations.Generally speaking, energy saving technology is mainly realized by redundancy, multi-speed, cache, unbalanced load and so on.For the distributed block storage system with multi-replica mechanism, based on the existing energy-saving technology, the auxiliary node technology, the consistent hash technology, the virtual node technology are integrated, and the partitioned replica strategy is used skillfully.It completely avoids the problem of minimum full coverage that other energy saving technologies usually face.Based on the above technology, the open source "Shepherd Dog" system is improved to realize the energy saving distributed block storage system.The improved block storage system is an all-symmetric centerless system, which relies on corosync to manage cluster nodes, and adopts epoll mechanism to handle event requests.Through the comparison of the original system and the improved system under the same load, it is proved that the improved system can achieve a better energy saving effect under the condition of small performance loss.However, there are still some problems in the system, such as low degree of automation, which need to be further improved.
【学位授予单位】：华中科技大学
【学位级别】：硕士
【学位授予年份】：2013
【分类号】：TP333

【参考文献】