一种批处理块级数据去重方法
发布时间：2018-09-14 13:29
【摘要】：数据去重能消除备份中的冗余数据,节省存储资源和网络带宽,因而成为当前数据存储领域的研究热点。针对常用的块级数据去重技术指纹查询开销高、系统吞吐率低等问题,提出一种批处理块级数据去重方法,通过内存缓冲区对指纹进行排序,实现磁盘索引的顺序查询。同时文件以一种双指针有向无环图的结构存储在系统中,以消除文件读时引起的随机磁盘I/O开销。实验结果表明,该方法有效克服了指纹查询的磁盘I/O瓶颈,提高了数据去重时的系统读写性能。
[Abstract]:Data deduplication can eliminate redundant data in backup, save storage resources and network bandwidth, so it has become a research hotspot in the field of data storage. Aiming at the problems such as high overhead of fingerprint query and low throughput, a batch processing block level data removal method is proposed to sort fingerprint through memory buffer to realize sequential query of disk index. At the same time, the files are stored in the system as a double-pointer directed acyclic graph to eliminate the I / O overhead caused by random disks when the files are read. The experimental results show that the proposed method overcomes the I / O bottleneck of fingerprint query and improves the performance of reading and writing of the system.
【作者单位】： 黄淮学院国际学院;
【基金】：河南省科技项目(142300410288,132400411178) 河南省教育厅科学技术研究重点项目(112102210446)
【分类号】：TP333;TP309.3
，
本文编号：2242842
[Abstract]:Data deduplication can eliminate redundant data in backup, save storage resources and network bandwidth, so it has become a research hotspot in the field of data storage. Aiming at the problems such as high overhead of fingerprint query and low throughput, a batch processing block level data removal method is proposed to sort fingerprint through memory buffer to realize sequential query of disk index. At the same time, the files are stored in the system as a double-pointer directed acyclic graph to eliminate the I / O overhead caused by random disks when the files are read. The experimental results show that the proposed method overcomes the I / O bottleneck of fingerprint query and improves the performance of reading and writing of the system.
【作者单位】： 黄淮学院国际学院;
【基金】：河南省科技项目(142300410288,132400411178) 河南省教育厅科学技术研究重点项目(112102210446)
【分类号】：TP333;TP309.3
，
本文编号：2242842
本文链接：https://www.wllwen.com/kejilunwen/jisuanjikexuelunwen/2242842.html
