磁盘存储系统节能关键技术研究

发布时间：2018-04-06 05:35

本文选题：节能　切入点：磁盘　出处：《华南理工大学》2012年博士论文

【摘要】：节能环保是当今世界各国政府共同面临的重大问题，，我国政府已将节能工作放在了国民经济工作的重要位置。近年来，随着全球数字信息总量的快速增长，存储系统的能耗问题日趋严重，如何降低存储系统能耗的问题已成为当前计算机科学技术领域中一个急待解决的关键科学技术问题和热点研究课题。因此，展开这方面的研究对推动存储系统节能技术的发展和应用具有重要的学术价值和实际意义。论文从磁盘存储系统的节能原理入手，以提高磁盘存储系统的能效和性能为目标，在认真分析和研究了磁盘存储系统节能的要求和各种技术因素的基础上，重点对磁盘存储系统的磁盘电源管理、缓存磁盘数据管理、磁盘负载平衡和节能磁盘存储系统模型等节能关键技术问题进行了深入研究和讨论。论文的主要研究工作和创新点包括如下几个方面：（一）提出了一种访问模式自匹配和性能保证的磁盘电源管理策略(Access ModeMatching and Performance Guarantee, AMM-PG)。针对现有磁盘电源管理策略的不足，AMM-PG采用空闲间隔长度的数据直方图来对应磁盘的访问模式并导出对应的超时阈值，实现适应磁盘的访问模式对磁盘的电源进行合理的管理，从而提高磁盘的能效；另外，AMM-PG对部分磁盘访问模式增加考虑磁盘何时从待机状态返回到空闲状态，通过性能要求和空闲间隔长度的数据直方图确定一个磁盘保持在待机状态的最大时间，从而在满足性能要求的同时，尽可能提高能量节省量。理论分析和实验结果表明，与固定超时策略和自适应管理策略share相比，AMM-PG具有更好的节能效果。（二）提出了一种负载自适应的具能量意识缓存磁盘数据管理方法（Workload-Adaptive LRU, WA-LRU）。针对现有缓存磁盘数据管理方法的不足，WA-LRU根据热门数据的数量和数据访问的密集程度区分数据磁盘的节能优先级，当需要替换缓存磁盘中的数据时，总是替换来自节能优先级最低的数据磁盘中的数据，从而匹配数据磁盘访问模式，提高节能效果，并使用基于生命周期管理的LRU队列来识别和消除缓存磁盘的瓶颈效应，从而避免出现因多个数据磁盘被缓存的数据较少而造成的能效较低问题。理论分析和实验结果表明，与现有的LRU、PA-LRU和PB-LRU方法相比，WA-LRU方法具有更好的节能效果。（三）提出了一种面向节能磁盘存储系统的多队列负载平衡方法（Multi QueueLoad Balance, MQLB）。MQLB针对基于整体存储节点的节能方案中负载倾斜的部分磁盘容易过载的问题，根据数据的访问频率、访问时间局部性等因素，按热门程度将数据分成多个队列，只维护最近被频繁访问的数据作为迁移对象，并使用热度衡量热门数据单元HDU给磁盘带来的负载压力，在磁盘出现过载时，根据过载磁盘的过载程度计算合适的负载压力比LPR，然后根据该LPR选择合适的HDU进行数据迁移。理论分析和实验结果表明，与现有的PDC、WAM和EM-FMS方法相比，MQLB方法可以更有效和快速地调整负载且引入更小的开销。（四）提出了一种新的基于动态树的节能磁盘存储系统模型（Dynamic Tree-basedMassive Array of Idle Disks, DT-MAID）。DT-MAID针对现有节能磁盘存储系统存在的瓶颈和局部性问题，提出了从系统整体角度来研究节能磁盘存储系统模型的思想，即：将缓存磁盘组织成两层动态树的结构，在动态树结构中的缓存磁盘分成Master和Slave两种角色；动态树管理将负载导向Master，以有利于Slave进入待机状态而提高系统的能效；Slave并不是一直在旋转，当其负载较轻满足设定的条件时，将会进入待机状态以节省能量；当Master的负载较大或系统被访问的数据的覆盖率较大时，动态树管理会从处于非待机状态的Slave中选择一个合适的节点或恢复一个待机状态的Slave接替其工作，从而提高系统的服务能力和能效。理论分析和实验结果表明，DT-MAID是一种较理想的节能磁盘存储系统模型，具有较好的节能效果、服务质量和可靠性。
[Abstract]:In recent years , with the rapid growth of the global digital information , the problem of energy consumption of the storage system has become more and more serious , and how to reduce the energy consumption of the storage system has become a key science and technology problem and hot topic research topic in the field of computer science and technology . Therefore , the research on this aspect has important academic value and practical significance in promoting the development and application of energy saving technology of the storage system .

This paper starts with the energy - saving principle of magnetic disk storage system to improve the energy efficiency and performance of magnetic disk storage system . On the basis of careful analysis and research on energy - saving requirements and technical factors of disk storage system , the key technical problems such as disk power management , cache disk data management , disk load balancing and energy - saving disk storage system model of magnetic disk storage system are studied and discussed .

( 1 ) An Access ModeMatching and Performance Guarantee ( AMM - PG ) is proposed in this paper . aiming at the shortage of the existing disk power management strategy , the AMM - PG adopts the data histogram of the idle interval length to correspond to the access mode of the disk and derives the corresponding time - out threshold value , so that the access mode of the adaptive disk is realized to reasonably manage the power supply of the magnetic disk , thereby improving the energy efficiency of the magnetic disk ;
in addition , that AMM - PG increase the access mode of the partial disk to the idle state when the disk is returned from the stand - by state to the idle state , and the maximum time of one disk in the standby state is determined through the performance requirement and the data histogram of the idle interval length , so that the energy saving amount is improved as much as possible while meeting the performance requirement .

( 2 ) A load - adaptive energy - aware caching disk data management method ( workload - Adaptive lru , wa - lru ) is proposed . According to the shortage of the existing cache disk data management method , the WA - lru distinguishes the energy - saving priority of the data disk according to the quantity of the hot data and the intensity of the data access , and always replaces the data in the data disk with the lowest energy - saving priority when the data in the cache disk needs to be replaced , so that the bottleneck effect of the cache disk is identified and eliminated by using the lru queue based on the life cycle management .

( 3 ) A multi - queue load balancing method ( MQLB ) for energy - saving disk storage system is proposed . This paper divides the data into a plurality of queues according to the factors such as the access frequency of the data , the locality of the access time and the like according to the factors such as the access frequency of the data , the locality of the access time and the like according to the factors such as the access frequency of the data , the locality of the access time and the like .

( 4 ) A new Dynamic Tree - based Array of Idle Disks ( DT - MAID ) is proposed . DT - MAID aims at the bottleneck and local problems existing in the existing energy - saving disk storage system , and puts forward the idea of studying the energy - saving disk storage system model from the whole angle of the system , that is , the cache disk is organized into two layers of dynamic tree structure , and the cache disk in the dynamic tree structure is divided into two roles of Master and Slave ;
the dynamic tree management loads the load to the Master to facilitate Slave to enter a standby state to improve the energy efficiency of the system ;
Slave is not always spinning , when its load is lighter than the set condition , it will enter standby state to save energy ;
The results show that DT - MAID is an ideal energy - saving disk storage system model , which has good energy - saving effect , quality of service and reliability .

【学位授予单位】：华南理工大学
【学位级别】：博士
【学位授予年份】：2012
【分类号】：TP333

【参考文献】