基于地理位置服务的分布式电子商务系统的研究与应用
发布时间：2019-02-25 13:44
【摘要】：随着移动互联网的快速发展,基于位置服务的电子商务受到越来越多的人的欢迎,但是电子商务平台的数据量庞大,传统的集中式数据库不能很好地解决数据存储。本文以解决电子商品平台海量数据存储为目的,设计实现了基于中间件的分布式数据库存储方案。由于电子商务系统业务复杂、数据库的一致性要求较高,因此采用基于关系型的分布式数据库存储是最合适的选择。在本文设计的分布式数据库基础上,本文还实现了由该分布式数据库提供支持的基于位置服务的电子商务系统。论文主要工作如下:(1)对分布式数据库存储技术进行了研究,分析了各个存储方案的优缺点。以分布式数据库分片算法为重点,分析了各种分片算法存在的不足。然后详细分析了谷歌提出的高性能跳增一致性哈希算法,并结合分布式文件系统Ceph内部的CRUSH算法提出了一种考虑节点权重的分片算法——加权跳增一致性哈希分片算法。最后把该算法运用到数据分片中。该算法以实现数据均匀分布为目的,以考虑节点权重为重点,充分满足了对分片算法性能、平衡性和单调性的要求。(2)详细研究并分析了分布式数据库中的分片连接方案,指出了在普通连接操作下进行分片连接的高成本问题。为了降低分布式数据库集群环境中分片连接的通信成本,提出了一个基于布隆过滤器的分片连接方案。本文对该方案进行了详细的阐述和分析,并通过数学计算和函数模型得出该方案的可行性。(3)在分片算法的基础之上,并结合分布式数据库中间件Mycat,实现了分布式数据库存储方案。使用开源工具Otter完成了对数据库的同步备份。介绍了系统的需求分析、架构设计以及系统关键模块的实现,最终设计并实现了的基于地理位置服务的分布式电子商务系统。在本文最后通过大量实验验证了本文提出的分片算法的性能、平衡性和单调性。得出该分片算法在性能上较好,数据分布也比较均匀,同时在节点权重相等的条件下单调性较好,但如果改变靠近首节点的权重则会引起大规模的数据迁移。
[Abstract]:With the rapid development of mobile Internet, e-commerce based on location-based services is welcomed by more and more people. However, the amount of data on e-commerce platform is huge, and the traditional centralized database can not solve the problem of data storage very well. In order to solve the problem of mass data storage in electronic commodity platform, this paper designs and implements a distributed database storage scheme based on middleware. Because of the complexity of e-commerce system and the high requirement of database consistency, it is the most appropriate choice to use distributed database storage based on relationship. On the basis of the distributed database designed in this paper, a location-based e-business system supported by the distributed database is implemented. The main work of this paper is as follows: (1) the distributed database storage technology is studied, and the advantages and disadvantages of each storage scheme are analyzed. Based on the distributed database slicing algorithm, the shortcomings of each algorithm are analyzed. Then, the high performance jump consistency hash algorithm proposed by Google is analyzed in detail. Combined with the CRUSH algorithm within the distributed file system Ceph, a weighted jump consistent hash algorithm, which considers the node weight, is proposed. Finally, the algorithm is applied to data slicing. In order to achieve uniform distribution of data, this algorithm fully satisfies the requirements of the performance, balance and monotonicity of the fragmentation algorithm. (2) the piecewise connection scheme in distributed database is studied and analyzed in detail, with the emphasis on considering node weight, and the algorithm meets the requirements of the performance, balance and monotonicity of the algorithm. The high cost of piecewise connection under common connection operation is pointed out. In order to reduce the communication cost of piecewise connection in distributed database cluster environment, a piecewise connection scheme based on Bloom filter is proposed. In this paper, the scheme is elaborated and analyzed in detail, and the feasibility of the scheme is obtained by mathematical calculation and function model. (3) based on the slicing algorithm and combined with the distributed database middleware Mycat, the feasibility of the scheme is obtained. The distributed database storage scheme is implemented. Using the open source tool Otter to complete the synchronous backup of the database. This paper introduces the requirement analysis, architecture design and the implementation of the key modules of the system. Finally, the distributed electronic commerce system based on geographical location service is designed and implemented. At the end of this paper, the performance, balance and monotonicity of the proposed piecewise algorithm are verified by a large number of experiments. It is concluded that the proposed algorithm has good performance and uniform data distribution. At the same time, the monotonicity is better under the condition of equal node weight, but if the weight near the first node is changed, the large-scale data migration will be caused.
【学位授予单位】：电子科技大学
【学位级别】：硕士
【学位授予年份】：2017
【分类号】：F713.36;TP311.13
本文编号：2430241
[Abstract]:With the rapid development of mobile Internet, e-commerce based on location-based services is welcomed by more and more people. However, the amount of data on e-commerce platform is huge, and the traditional centralized database can not solve the problem of data storage very well. In order to solve the problem of mass data storage in electronic commodity platform, this paper designs and implements a distributed database storage scheme based on middleware. Because of the complexity of e-commerce system and the high requirement of database consistency, it is the most appropriate choice to use distributed database storage based on relationship. On the basis of the distributed database designed in this paper, a location-based e-business system supported by the distributed database is implemented. The main work of this paper is as follows: (1) the distributed database storage technology is studied, and the advantages and disadvantages of each storage scheme are analyzed. Based on the distributed database slicing algorithm, the shortcomings of each algorithm are analyzed. Then, the high performance jump consistency hash algorithm proposed by Google is analyzed in detail. Combined with the CRUSH algorithm within the distributed file system Ceph, a weighted jump consistent hash algorithm, which considers the node weight, is proposed. Finally, the algorithm is applied to data slicing. In order to achieve uniform distribution of data, this algorithm fully satisfies the requirements of the performance, balance and monotonicity of the fragmentation algorithm. (2) the piecewise connection scheme in distributed database is studied and analyzed in detail, with the emphasis on considering node weight, and the algorithm meets the requirements of the performance, balance and monotonicity of the algorithm. The high cost of piecewise connection under common connection operation is pointed out. In order to reduce the communication cost of piecewise connection in distributed database cluster environment, a piecewise connection scheme based on Bloom filter is proposed. In this paper, the scheme is elaborated and analyzed in detail, and the feasibility of the scheme is obtained by mathematical calculation and function model. (3) based on the slicing algorithm and combined with the distributed database middleware Mycat, the feasibility of the scheme is obtained. The distributed database storage scheme is implemented. Using the open source tool Otter to complete the synchronous backup of the database. This paper introduces the requirement analysis, architecture design and the implementation of the key modules of the system. Finally, the distributed electronic commerce system based on geographical location service is designed and implemented. At the end of this paper, the performance, balance and monotonicity of the proposed piecewise algorithm are verified by a large number of experiments. It is concluded that the proposed algorithm has good performance and uniform data distribution. At the same time, the monotonicity is better under the condition of equal node weight, but if the weight near the first node is changed, the large-scale data migration will be caused.
【学位授予单位】：电子科技大学
【学位级别】：硕士
【学位授予年份】：2017
【分类号】：F713.36;TP311.13
【参考文献】
相关期刊论文 前3条
1 申德荣;于戈;王习特;聂铁铮;寇月;;支持大数据管理的NoSQL系统研究综述[J];软件学报;2013年08期
2 王利娟;马晓;;基于LBS的移动电子商务商业模式探析——LBS前途光明,道路曲折[J];企业导报;2012年02期
3 孟小峰,周龙骧,王珊;数据库技术发展趋势[J];软件学报;2004年12期
，本文编号：2430241
本文链接：https://www.wllwen.com/jingjilunwen/dianzishangwulunwen/2430241.html
