虚拟机本地存储写性能优化研究

发布时间：2018-01-20 04:58

本文关键词： 虚拟化技术存储性能异步处理同步处理磁盘固态盘　出处：《华中科技大学》2013年博士论文　论文类型：学位论文

【摘要】：系统虚拟化技术解耦了传统操作系统与硬件设备之间的粘合度,使得多个同时运行的操作系统例程(虚拟机)可以部署在单个的物理平台上以共享底层的硬件资源,从而实现服务器整合而达到提高硬件利用率的效果。除此之外,系统虚拟化技术还可以为操作系统在同构、甚至异构物理平台之间的实时迁移,用户计算环境的快速部署、以及恶意软件的安全隔离等需求上带来有效可靠的技术解决方案,降低了组织机构或个人在计算机硬件和相关管理上的投资成本。尽管如此,相比较传统的操作系统环境,虚拟化技术亦给底层的存储设备的写入方向带来了性能挑战。这是因为：第一,由于虚拟机管理器的引入,使得虚拟机内部的写请求需要经历更长的I/0路径,增加了额外的CPU开销；第二,虚拟机管理器的引入亦使得虚拟机内部的相关块设备驱动程序很难获取准确的存储设备相关信息,失去了写操作性能进一步调优的机会；第三,由于服务器整合,使得共享存储设备需要面对和处理成倍增加的并发写请求数目,进一步加剧了其性能瓶颈。目前,国内外相关的虚拟化存储性能优化工作偏重于读取方面,而对于写入方面则存在一定程度上的关注缺失。因此有必要对虚拟机本地存储写操作的性能进行研究和优化。虚拟机本地存储写操作的新模型,可以对虚拟机内部的文件级写操作进行同步处理,再对虚拟机管理器的块级写操作进行异步处理。其中,虚拟机内部的同步处理意味着写请求可以绕过文件系统的复杂异步处理逻辑,缩短其从虚拟机层次到虚拟机管理器层次之间所需要经历的I/O路径,而异步处理指的是在块级的写请求到达存储硬件之前,根据底层具体的存储特性,在虚拟机管理器层次进行相关优化,以减轻共享存储由于并发I/O数目激增而产生的处理压力。基于域间通信技术的虚拟机存储协议栈优化机制,进一步优化了虚拟机本地存储写操作的性能。通过利用虚拟机系统提供的域间通信接口,进一步减小写操作从虚拟机层次切换到虚拟机管理器层次的CPU开销。同时,该优化机制亦可以在单独的虚拟化体系结构下使用。固态盘在虚拟化环境下写放大问题的优化机制,可以看作是虚拟机本地存储写操作的具体应用。具体而言,由于虚拟机管理器的引入,导致虚拟机文件系统与虚拟机管理器文件系统之间产生语义缺失,使得底层基于NAND闪存芯片的固态盘设备需要接收更多的重写操作,从而产生持续写放大的性能问题。该机制通过在虚拟机管理器层次加入块级别的写操作缓存,并在其上施加特定缓存管理逻辑,以缓解重写操作增多而导致写放大问题在虚拟化固态盘上产生的性能负面影响。综上所述,通过使用虚拟机本地存储写操作的新模型,可以减小写请求所需要消耗的至多80%左右的虚拟化CPU开销,也可以在虚拟机管理器层次加入对特定存储硬件设备的优化机制,以此来对整个虚拟化系统进行相应的I/O优化,缓解共享存储设备所需要面对和处理的I/O压力。同时,该虚拟化写操作模型对读操作兼容,不影响其性能。
[Abstract]:in addition , that system virtualization technology can provide effective and reliable technical solution for the real - time migration between the operating system and the heterogeneous physical platform , the rapid deployment of the user computing environment , the security isolation of the malware , and the like , thereby reducing the investment cost of the organization or the individual in the computer hardware and related management . However , compared with the traditional operating system environment , the virtualization technology also brings the performance challenge to the writing direction of the bottom layer storage device . This is because : firstly , due to the introduction of the virtual machine manager , the write request inside the virtual machine needs to experience longer I / 0 path , and the additional CPU overhead is increased ; secondly , the introduction of the virtual machine manager makes it difficult to obtain accurate storage device related information and further aggravate the performance bottleneck . The synchronous processing in the virtual machine means that the write request can bypass the complex asynchronous processing logic of the file system and shorten the I / O path between the virtual machine level and the virtual machine manager level , and the asynchronous processing refers to the optimization at the virtual machine manager level according to the specific storage characteristic of the bottom layer before the write request of the block level reaches the storage hardware , so as to reduce the processing pressure generated due to the explosion of the concurrent I / O . By utilizing the inter - domain communication interface provided by the virtual machine system , the CPU overhead of the write operation from the virtual machine level to the virtual machine manager level is further reduced . in particular , due to the introduction of the virtual machine manager , a semantic loss is generated between the virtual machine file system and the virtual machine manager file system , so that the bottom layer based on the NAND flash chip can generate a performance problem of continuous write amplification . In conclusion , by using the new model of the local storage and writing operation of the virtual machine , the virtualization CPU overhead of up to 80 % consumed by the write request can be reduced , and the optimization mechanism for the specific storage hardware device can be added at the virtual machine manager level , so that the I / O pressure required to be faced and processed by the shared storage device can be relieved , and meanwhile , the virtualization writing operation model is compatible with the read operation , and the performance thereof is not affected .

【学位授予单位】：华中科技大学
【学位级别】：博士
【学位授予年份】：2013
【分类号】：TP302

【相似文献】