AWR-RAID:一致性保证的纠删码RAID系统
发布时间：2018-09-19 18:01
【摘要】：信息技术正在从以计算设备为核心的计算时代进入到以数据为核心的存储时代.数据量和数据价值的增加,对存储系统的容量、成本、访问性能和数据可靠性等方面提出了更高的要求.为减小冗余数据开销并保证数据的可用性和可靠性,采用纠删码技术已成为业界的发展趋势.数据一致性是纠删码存储系统的本质属性,保证了数据的可靠性和可用性,高效保证纠删码数据的一致性是纠删码系统的关键.提出"写后重映射"存储模型(After Write Remapping,AWR)和事务实现方法,保证了纠删码数据的一致性.AWR模型为纠删码数据的更新过程提供原子性和持久性,采用非原位更新和原子重映射机制保证了更新过程中数据的一致性,具有通用性好、存储开销低和事务性能高的特点.经过理论分析和实际测试验证,AWR事务存储模型带来的纠删码存储系统读性能损失低于1%,64KB及以上粒度的写性能损失低于3%,高效地保证了纠删码数据的一致性.
[Abstract]:Information technology is moving from the computing era with computing equipment as the core to the storage era with data as the core. With the increase of data volume and data value, the capacity, cost, access performance and data reliability of the storage system are required higher. In order to reduce the cost of redundant data and ensure the availability and reliability of data, erasure code technology has become the trend of the industry. Data consistency is the essential attribute of erasure code storage system, which ensures the reliability and availability of data. The key of erasure code system is to ensure the consistency of erasure code data efficiently. The storage model (After Write Remapping,AWR) and the transaction implementation method are proposed to ensure the consistency of erasure code data. Awr model provides atomicity and persistence for updating erasure code data. Non-in-situ updating and atomic remapping mechanisms are used to ensure the consistency of the data during the updating process, which has the characteristics of good generality, low storage overhead and high transaction performance. Through theoretical analysis and practical test, it is proved that the performance loss of erasure code storage system caused by awr transaction storage model is lower than 1 / 64KB and above granularity and the write performance loss is less than 3KB, which effectively ensures the consistency of erasure code data.
【作者单位】： 中国科学院计算技术研究所;中国科学院大学;
【基金】：中国科学院先导专项基金项目(XDA06010401)资助 天津市科技计划项目(15ZXDSGX00020)资助
【分类号】：TP333
，
本文编号：2250910
[Abstract]:Information technology is moving from the computing era with computing equipment as the core to the storage era with data as the core. With the increase of data volume and data value, the capacity, cost, access performance and data reliability of the storage system are required higher. In order to reduce the cost of redundant data and ensure the availability and reliability of data, erasure code technology has become the trend of the industry. Data consistency is the essential attribute of erasure code storage system, which ensures the reliability and availability of data. The key of erasure code system is to ensure the consistency of erasure code data efficiently. The storage model (After Write Remapping,AWR) and the transaction implementation method are proposed to ensure the consistency of erasure code data. Awr model provides atomicity and persistence for updating erasure code data. Non-in-situ updating and atomic remapping mechanisms are used to ensure the consistency of the data during the updating process, which has the characteristics of good generality, low storage overhead and high transaction performance. Through theoretical analysis and practical test, it is proved that the performance loss of erasure code storage system caused by awr transaction storage model is lower than 1 / 64KB and above granularity and the write performance loss is less than 3KB, which effectively ensures the consistency of erasure code data.
【作者单位】： 中国科学院计算技术研究所;中国科学院大学;
【基金】：中国科学院先导专项基金项目(XDA06010401)资助 天津市科技计划项目(15ZXDSGX00020)资助
【分类号】：TP333
，
本文编号：2250910
本文链接：https://www.wllwen.com/kejilunwen/jisuanjikexuelunwen/2250910.html
