混合存储系统研究

发布时间：2018-03-01 23:06

本文关键词： 混合存储非易失性随机存储器固态盘磁盘　出处：《上海交通大学》2013年硕士论文　论文类型：学位论文

【摘要】：目前存储系统的发展趋向于大容量、低成本和高性能，而任何单一的存储器件如非易失性随机存储器、固态盘、磁盘等由于其物理特性的限制，并不能满足以上需求。混合存储充分利用不同存储器件的特性组成高效的存储系统，既能支持存储系统容量的大幅扩展，又能在保持系统低成本的前提下，，显著提高存储系统的性能，成为目前存储技术发展的方向。本文首先介绍了混合存储系统的概念及其发展历程，以及目前各种混合存储系统所面临的问题。在此基础上设计和实现了一个基于NVRAM、SSD、HDD的混合存储系统Trident。论文的主要工作如下： (1)对现有的主流持久存储器件的特性进行了研究，在随机性能、顺序性能、容量、成本、性能等几个方面进行了对比。 (2)对混合存储系统的发展历程进行了研究，并深入分析了混合存储设计中的关键技术问题。 (3)设计并实现了基于NVRAM、SSD、HDD的混合存储系统Trident，主要包括架构、映射策略、热点数据识别、数据的缓存和迁移等方面。 (4)使用人工合成负载和实际工作负载对基于HDD的存储系统、Facebook的FlashCache混合存储系统、以及Trident混合存储系统的随机性能和顺序性能进行了对比测试，并且对比了FlashCache和Trident中的缓存命中率。测试结果显示，Trident混合存储系统的顺序读写性能接近基于HDD的存储系统，随机IOPS部分超过FlashCache，缓存命中率接近FlashCache，且对SSD的写入次数也少于FlashCache。系统通过Linux内核模块实现，对上层用户的访问透明。本论文的研究成果对于其它的混合存储系统设计与实现也具有较好的借鉴价值。
[Abstract]:At present, the development of memory system tends to be large capacity, low cost and high performance. However, any single memory device, such as non-volatile random access memory, solid state disk, disk, etc., is limited by its physical characteristics. Hybrid storage can make full use of the characteristics of different memory devices to form an efficient storage system, which can not only support the large expansion of storage system capacity, but also maintain the low cost of the system. Improving the performance of storage system has become the direction of storage technology development. This paper first introduces the concept of hybrid storage system and its development process, as well as the problems faced by various hybrid storage systems. On this basis, we design and implement a hybrid storage system based on NVRAMN SSD-HDD. The main work of this paper is as follows:. 1) the characteristics of existing mainstream persistent memory devices are studied and compared in random performance, sequential performance, capacity, cost, performance and so on. In this paper, the development of hybrid storage system is studied, and the key technical problems in hybrid storage design are analyzed. The design and implementation of a hybrid storage system based on NVRAMN SSDN HDD includes architecture, mapping strategy, hot data identification, data cache and migration. Using synthetic load and actual workload, the random and sequential performances of FlashCache hybrid storage system based on HDD and Trident hybrid storage system are compared and tested. The cache hit ratio in FlashCache and Trident is compared. The test results show that the sequential read and write performance of the Trident hybrid storage system is similar to that of the HDD based storage system. The random IOPS is more than Flash Cache. the cache hit ratio is close to Flash Cache.And the number of writing to SSD is also less than that of Flash Cache. the system is implemented through the Linux kernel module. The research results of this paper can also be used for reference in the design and implementation of other hybrid storage systems.
【学位授予单位】：上海交通大学
【学位级别】：硕士
【学位授予年份】：2013
【分类号】：TP333

【相似文献】