分布式数据存储机制与优化方法研究

发布时间：2018-03-19 11:26

本文选题：分布式系统　切入点：网络编码　出处：《西安电子科技大学》2013年硕士论文　论文类型：学位论文

【摘要】：分布式存储利用分散的数据节点分担存储负荷，提升系统性能。在分布式存储领域，数据可靠性以及系统中通信和存储开销的优化问题是该领域的核心热点问题。本文基于节点失效概率，优化分布式存储系统的数据分配问题，，针对无线传感器网络场景，研究优化数据放置问题。考虑存储节点自身失效概率，针对分布式存储系统中由于数据分配策略不同导致的数据可靠性不同问题，通过概率论的方法，建立基于网络编码的概率均匀分配模型，在此模型基础上提出存储数据概率均匀分配策略和方法，证明在所提出的策略下，数据可靠性高于传统分配策略。本文提出的模型和方法考虑了节点失效率的差异性，提高了存储数据的可靠性，更加符合实际的分布式存储系统。针对基于多数据备份策略的无线传感器网络数据存储方法的网络通信和存储开销大的问题，以最小的通信和存储开销为优化目标，本文建立了存储放置优化方程和启发式算法，保证传感器网络数据可靠性。同时在考虑用户访问开销的情况下，改进了所提出的优化存储方法，给出了启发式算法。理论分析证明，所提议的方法在使用较少的存储资源的情况下，实现数据的高可靠性。本文所提议的基于冗余的分布式数据存储的数据分配模型和无线传感器网络中副本数据放置策略，考虑分布式存储系统中存储节点失效率，提高存储数据的可靠性，适用于各种分布式存储系统。
[Abstract]:Distributed storage uses distributed data nodes to share storage load and improve system performance. The optimization of data reliability and communication and storage overhead is the key issue in this field. Based on the node failure probability, this paper optimizes the data allocation problem of distributed storage system, aiming at the wireless sensor network scenario. The problem of optimizing data placement is studied. Considering the failure probability of storage nodes, aiming at the problem of different data reliability caused by different data allocation strategies in distributed storage systems, a probability uniform allocation model based on network coding is established by means of probability theory. On the basis of this model, a uniform allocation strategy and method for storing data probability is proposed, which proves that the proposed strategy is more reliable than the traditional allocation strategy. The model and method proposed in this paper take into account the difference of node failure rate. The reliability of stored data is improved, and the distributed storage system is more suitable. Aiming at the problem of large network communication and storage overhead in wireless sensor network data storage method based on multi-data backup strategy, the minimum communication and storage overhead is considered as the optimization goal. In this paper, the storage placement optimization equation and heuristic algorithm are established to ensure the data reliability of the sensor network. At the same time, the proposed optimal storage method is improved considering the user access overhead. A heuristic algorithm is given. The theoretical analysis shows that the proposed method can achieve high reliability of data under the condition of using less storage resources. The proposed data allocation model based on redundant distributed data storage and replica data placement strategy in wireless sensor networks consider the failure rate of storage nodes in distributed storage system to improve the reliability of storage data. Suitable for all kinds of distributed storage systems.
【学位授予单位】：西安电子科技大学
【学位级别】：硕士
【学位授予年份】：2013
【分类号】：TP333

【共引文献】