面向高性能应用的PCIE SSD的驱动研究与实现
发布时间:2018-09-01 13:18
【摘要】:随着大数据时代的到来,企业和用户对存储领域的需求呈现爆炸式增长。当前数据已经成为企业的核心资源,因此对数据存储的安全性和可靠性也提出了更高要求。这些技术从软件或硬件等不同层面共同推动了存储领域的发展,也对传统的存储体系结构形成了冲击,从而为相关的研究提供了广阔的空间。 为了满足数据密集型海量存储系统的应用需求,进一步提高存储系统的带宽,目前已经研发出了基于PCIe接口的SSD。本文针对自主研制的PCIe SSD设备,设计实现了分层驱动程序。通过两层驱动的配合,正确将PCIe SSD挂载为系统中磁盘,并且有效提高了系统带宽和空间利用率。本文主要工作有以下几个方面: 1)设计并实现了PCIe SSD的Windows驱动,包括研究Windows操作系统存储驱动栈的工作原理、WDM驱动框架工作机制。整个驱动采用了分层框架,上层驱动将硬件设备正确注册为Windows操作系统中的磁盘设备,采取了与传统驱动设计不同的通路,降低了协议转换的开销;下层驱动中采用了请求队列、中断聚合、请求TAG寄存器技术以处理并发乱序请求。通过两层驱动协作,共同提高系统性能。 2)提出了面向大容量FTL的闪存转换层机制,制定了基于进程的块分配策略。实验证明:在驱动层实现FTL可以有效利用主机的大内存空间,基于进程的块分配策略可以更加有效地管理闪存,提高垃圾回收的效率和闪存的性能。 3)在驱动层中采用了缓存策略,有效解决了文件系统与磁盘设备读写粒度不同的矛盾,进一步减少了闪存的擦除次数,提高了响应速度和垃圾回收的性能。 4)研究了高速传输的相关机制,采用了请求队列、中断聚合、请求TAG寄存器技术以处理并发乱序请求。充分利用了PCIe接口的高速带宽,,减少了系统响应中断的次数,并且使乱序处理情况下的各请求得到了正确响应。
[Abstract]:With the arrival of big data era, the demand of enterprises and users for storage field presents explosive growth. At present, data has become the core resource of enterprises, so the security and reliability of data storage are also required. These technologies promote the development of storage field from different aspects such as software or hardware, and also impact the traditional storage architecture, thus providing a broad space for related research. In order to meet the application requirements of data intensive mass storage system and further improve the bandwidth of storage system, a SSD. based on PCIe interface has been developed. In this paper, a layered driver is designed and implemented for the self-developed PCIe SSD device. Through the cooperation of two layers drive, the PCIe SSD is mounted as the disk of the system correctly, and the system bandwidth and space utilization are improved effectively. The main work of this paper is as follows: 1) the Windows driver of PCIe SSD is designed and implemented, including the working principle of the storage driver stack of Windows operating system and the working mechanism of Windows driver framework. The whole driver adopts a layered framework, the upper driver registers the hardware device as the disk device in Windows operating system correctly, and adopts a different path from the traditional driver design, which reduces the overhead of protocol conversion. In the lower driver, request queue, interrupt aggregation and request TAG register technology are used to deal with concurrent disordered requests. Through two-layer driven collaboration, the system performance is improved. 2) A flash memory conversion layer mechanism for large capacity FTL is proposed, and a process-based block allocation strategy is proposed. Experiments show that the implementation of FTL in the driver layer can effectively utilize the large memory space of the host, and the block allocation strategy based on process can manage flash memory more effectively. Improve the efficiency of garbage collection and the performance of flash memory. 3) the buffer strategy is adopted in the driver layer, which effectively solves the conflict between file system and disk device in reading and writing granularity, and further reduces the erasure times of flash memory. The response speed and the performance of garbage collection are improved. 4) the related mechanism of high speed transmission is studied. Request queue, interrupt aggregation and request TAG register technology are used to deal with concurrent out-of-order requests. The high speed bandwidth of the PCIe interface is fully utilized to reduce the number of interruptions in the system response, and the requests in the case of chaotic processing are correctly responded to.
【学位授予单位】:国防科学技术大学
【学位级别】:硕士
【学位授予年份】:2012
【分类号】:TP333;TP309
本文编号:2217321
[Abstract]:With the arrival of big data era, the demand of enterprises and users for storage field presents explosive growth. At present, data has become the core resource of enterprises, so the security and reliability of data storage are also required. These technologies promote the development of storage field from different aspects such as software or hardware, and also impact the traditional storage architecture, thus providing a broad space for related research. In order to meet the application requirements of data intensive mass storage system and further improve the bandwidth of storage system, a SSD. based on PCIe interface has been developed. In this paper, a layered driver is designed and implemented for the self-developed PCIe SSD device. Through the cooperation of two layers drive, the PCIe SSD is mounted as the disk of the system correctly, and the system bandwidth and space utilization are improved effectively. The main work of this paper is as follows: 1) the Windows driver of PCIe SSD is designed and implemented, including the working principle of the storage driver stack of Windows operating system and the working mechanism of Windows driver framework. The whole driver adopts a layered framework, the upper driver registers the hardware device as the disk device in Windows operating system correctly, and adopts a different path from the traditional driver design, which reduces the overhead of protocol conversion. In the lower driver, request queue, interrupt aggregation and request TAG register technology are used to deal with concurrent disordered requests. Through two-layer driven collaboration, the system performance is improved. 2) A flash memory conversion layer mechanism for large capacity FTL is proposed, and a process-based block allocation strategy is proposed. Experiments show that the implementation of FTL in the driver layer can effectively utilize the large memory space of the host, and the block allocation strategy based on process can manage flash memory more effectively. Improve the efficiency of garbage collection and the performance of flash memory. 3) the buffer strategy is adopted in the driver layer, which effectively solves the conflict between file system and disk device in reading and writing granularity, and further reduces the erasure times of flash memory. The response speed and the performance of garbage collection are improved. 4) the related mechanism of high speed transmission is studied. Request queue, interrupt aggregation and request TAG register technology are used to deal with concurrent out-of-order requests. The high speed bandwidth of the PCIe interface is fully utilized to reduce the number of interruptions in the system response, and the requests in the case of chaotic processing are correctly responded to.
【学位授予单位】:国防科学技术大学
【学位级别】:硕士
【学位授予年份】:2012
【分类号】:TP333;TP309
【参考文献】
相关期刊论文 前2条
1 徐小玲;IDE接口硬盘读写技术[J];电子科技大学学报;2002年06期
2 郑文静;李明强;舒继武;;Flash存储技术[J];计算机研究与发展;2010年04期
本文编号:2217321
本文链接:https://www.wllwen.com/kejilunwen/jisuanjikexuelunwen/2217321.html