云存储环境中的远程文件同步模型研究
发布时间：2018-11-25 15:13
【摘要】：随着移动计算的出现、计算机硬件技术的发展与人们日益增长的应用需求，越来越多的个人拥有多个智能计算设备。人们每天的工作与生活都依赖于这些计算设备上的大量信息数据，因此安全有效地共享与管理多设备间的文件显得非常重要。 远程文件同步服务能够自动维护多个设备之间的文件一致性，云存储技术与NoSQL数据库技术为用户文件数据提供了安全、可扩展的备份存储。本文针对海量信息时代下的个人用户多设备之间文件共享与管理的应用需求，提出了一种云存储环境中的远程文件同步模型——SyncCS模型。本文重点研究了远程文件同步模型的系统架构、同步协议以及后台存储环境，完成的主要工作包括： 1．将远程文件同步技术与云存储技术相结合，并考虑到传统点对点文件同步模型的不足，提出了一种C/S架构的云存储环境中的远程文件同步模型——SyncCS模型，并构建了模型的三层体系结构。 2．设计了一种适用于SyncCS模型的两阶段文件同步协议，将文件同步过程分为非实时双向同步和实时单向同步两个阶段，能够兼顾文件双向同步与实时同步两种不同的用户需求。同时充分研究并讨论了在同步过程中可能发生的所有文件冲突情况，制定了与两阶段同步协议相适应的文件冲突检测与处理机制。 3．结合当前炙手可热的云存储与NoSQL数据库技术，研究并构造了SyncCS模型后台云存储环境，根据SyncCS模型中实际的数据特点，分别提出了相适应的元数据与文件数据存储方案。 4．针对SyncCS模型中冗余日志带来冗余同步操作的问题，提出了一种客户端日志预处理优化方案；针对大量并发访问可能导致元数据服务器效率低下的问题，提出了一种基于Hbase的元数据存储优化方案。并通过实验验证了两个优化方案的有效性，，从而分别从客户端与服务器端对SyncCS模型进行了性能改进。
[Abstract]:With the emergence of mobile computing, the development of computer hardware technology and the increasing demand for applications, more and more individuals have multiple intelligent computing devices. The daily work and life of people depend on a large amount of information data on these computing devices, so it is very important to share and manage the files between multiple devices safely and effectively. Remote file synchronization service can automatically maintain file consistency between multiple devices. Cloud storage technology and NoSQL database technology provide secure and extensible backup storage for user file data. In this paper, a remote file synchronization model in cloud storage environment, SyncCS model, is proposed to meet the application requirements of file sharing and management between individual users and multi-devices in the age of mass information. This paper focuses on the system architecture, synchronization protocol and background storage environment of the remote file synchronization model. The main works are as follows: 1. Combine remote file synchronization technology with cloud storage technology. Considering the shortcomings of the traditional point-to-point file synchronization model, a remote file synchronization model called SyncCS model in cloud storage environment based on C / S architecture is proposed, and the three-tier architecture of the model is constructed. 2. A two-stage file synchronization protocol suitable for SyncCS model is designed. The file synchronization process is divided into two stages: non-real-time bidirectional synchronization and real-time one-way synchronization, which can take account of two different user requirements: bidirectional file synchronization and real-time file synchronization. At the same time, all possible file conflicts in the synchronization process are studied and discussed, and a file conflict detection and handling mechanism suitable to the two-stage synchronization protocol is developed. 3. Combined with the current hot cloud storage and NoSQL database technology, the background cloud storage environment of SyncCS model is studied and constructed. According to the actual data characteristics of SyncCS model, the corresponding metadata and file data storage schemes are put forward respectively. 4. Aiming at the problem of redundant log synchronization in SyncCS model, a preprocessing optimization scheme for client log is proposed. Aiming at the problem that a large number of concurrent access may lead to the inefficiency of metadata server, a metadata storage optimization scheme based on Hbase is proposed. The effectiveness of the two optimization schemes is verified by experiments, and the performance of the SyncCS model is improved from the client side and the server side respectively.
【学位授予单位】：上海大学
【学位级别】：硕士
【学位授予年份】：2013
【分类号】：TP333
本文编号：2356551
[Abstract]:With the emergence of mobile computing, the development of computer hardware technology and the increasing demand for applications, more and more individuals have multiple intelligent computing devices. The daily work and life of people depend on a large amount of information data on these computing devices, so it is very important to share and manage the files between multiple devices safely and effectively. Remote file synchronization service can automatically maintain file consistency between multiple devices. Cloud storage technology and NoSQL database technology provide secure and extensible backup storage for user file data. In this paper, a remote file synchronization model in cloud storage environment, SyncCS model, is proposed to meet the application requirements of file sharing and management between individual users and multi-devices in the age of mass information. This paper focuses on the system architecture, synchronization protocol and background storage environment of the remote file synchronization model. The main works are as follows: 1. Combine remote file synchronization technology with cloud storage technology. Considering the shortcomings of the traditional point-to-point file synchronization model, a remote file synchronization model called SyncCS model in cloud storage environment based on C / S architecture is proposed, and the three-tier architecture of the model is constructed. 2. A two-stage file synchronization protocol suitable for SyncCS model is designed. The file synchronization process is divided into two stages: non-real-time bidirectional synchronization and real-time one-way synchronization, which can take account of two different user requirements: bidirectional file synchronization and real-time file synchronization. At the same time, all possible file conflicts in the synchronization process are studied and discussed, and a file conflict detection and handling mechanism suitable to the two-stage synchronization protocol is developed. 3. Combined with the current hot cloud storage and NoSQL database technology, the background cloud storage environment of SyncCS model is studied and constructed. According to the actual data characteristics of SyncCS model, the corresponding metadata and file data storage schemes are put forward respectively. 4. Aiming at the problem of redundant log synchronization in SyncCS model, a preprocessing optimization scheme for client log is proposed. Aiming at the problem that a large number of concurrent access may lead to the inefficiency of metadata server, a metadata storage optimization scheme based on Hbase is proposed. The effectiveness of the two optimization schemes is verified by experiments, and the performance of the SyncCS model is improved from the client side and the server side respectively.
【学位授予单位】：上海大学
【学位级别】：硕士
【学位授予年份】：2013
【分类号】：TP333
【参考文献】
相关期刊论文 前3条
1 程莹;张云勇;房秉毅;徐雷;;云计算时代的数据库研究[J];电信技术;2011年01期
2 林子雨;赖永炫;林琛;谢怡;邹权;;云数据库研究[J];软件学报;2012年05期
3 周可;王桦;李春花;;云存储技术及其应用[J];中兴通讯技术;2010年04期
本文编号：2356551
本文链接：https://www.wllwen.com/kejilunwen/jisuanjikexuelunwen/2356551.html
