一种个人云存储服务系统的设计与实现

发布时间：2018-05-07 05:37

本文选题：云存储 + HDFS　；参考：《电子科技大学》2012年硕士论文

【摘要】：现在是个信息爆炸的时代,每天都会涌现出各方面的信息,穿梭在日常生活中。根据IDC (Internet Data Center互联网数据中心)的研究数据表明,未来数据的70%都是由个人用户贡献的。随着互联网的高速发展,人们对信息的要求越来越高。另一个方面,信息的扩张速度很快,信息已经成为了日常生活的一部分,如同水、电、气一般。现在难以统计当前世界存在的信息有多少了,有统计结果表明,2006年的全球新增数据为0.18ZB,就相当于18亿TB数据了。这么多的数据如何存储,生活中信息怎样分享如何快捷的访问获取,个人对数据的要求不再仅仅只是简单的复制和备份,个人云存储的出现,很好的解决了这个问题。本文首先研究了个人云存储服务系统的背景,国内外的研究现状和确定了研究目标和内容,接着详细介绍了个人云存储服务系统所使用到的主流技术以及特点。然后详细叙述个人云存储服务系统的设计,先从需求分析得出系统的功能和设计目标,再得出系统的总体结构分为客户端和服务端,接着叙述系统的执行流程和系统的设计特点。然后再根据文章系统设计的要求,详细阐述系统客户端中Web辅助检查插件,PC客户端和手机客户端的代码实现和原理,再阐述服务端中功能服务模块,HDFS小文件处理引擎和HDFS文件接口的代码实现和原理,全面叙述系统的实现过程和相关原理。最后搭建系统测试环境,针对系统做出相应的性能测试和分析。本文主要完成的工作有： 1、给出一套完整的个人云存储服务系统解决方案。 2、实现客户端的文件同步功能。 3、设计实现了HDFS的小文件处理引擎,以提高HDFS吞吐小文件的效率。 4、达到了个人云存储服务系统的文件唯一性存储目标。本文设计实现的个人云存储服务系统,能够解决个人数据的海量存储,存储的高可靠性,使用的便捷性,为个人提供可靠高效的存储服务。
[Abstract]:Now is an era of information explosion, every day will emerge in all aspects of information, shuttle in daily life. According to the research data of the IDC (Internet Data Center Internet Data Center), 70% of the future data are contributed by individual users. With the rapid development of the Internet, the demand for information is getting higher and higher. On the other hand, information has been expanding quickly, information has become a part of daily life, like water, electricity, and gas. It is difficult to count how much information exists in the world now. Statistics show that the global new data in 2006 is 0.18ZB, which is equivalent to 1 billion 800 million TB data. So much of the data is stored and in life. How to share how fast access to access, personal data requirements are no longer just a simple copy and backup, the appearance of personal cloud storage, a good solution to this problem.
This paper first studies the background of the personal cloud storage service system, the research status at home and abroad, and the research goals and contents. Then the main technology and characteristics of the personal cloud storage service system are introduced in detail. Then the design of the personal cloud storage service system is described in detail, and the function of the system is first obtained from the requirement analysis. And then the overall structure of the system is divided into the client and the server, then the execution flow of the system and the design features of the system are described. Then, according to the requirements of the system design, the Web auxiliary check plug-in, the PC client and the mobile client are described in detail, and then the server is expounded. The implementation and principle of the medium function service module, the HDFS small file processing engine and the HDFS file interface, describe the implementation process and the related principles of the system. Finally, build the system test environment, and make corresponding performance testing and analysis for the system.
The main tasks of this article are as follows:
1, provide a complete solution for personal cloud storage service system.
2, the file synchronization function of the client is realized.
3, a small file processing engine of HDFS is designed and implemented to improve the efficiency of HDFS huff and puff.
4, achieves the file uniqueness storage objective of personal cloud storage service system.
The personal cloud storage service system designed and realized in this paper can solve the mass storage of personal data, the high reliability of the storage, the convenience of the use, and provide a reliable and efficient storage service for the individual.

【学位授予单位】：电子科技大学
【学位级别】：硕士
【学位授予年份】：2012
【分类号】：TP333

【参考文献】