面向金融大数据的内容管理方法的设计与实现

发布时间：2018-06-23 07:24

本文选题：金融大数据 + 内容管理　；参考：《北京邮电大学》2016年硕士论文

【摘要】：随着互联网的兴盛,全球各大交易所,纷纷把各种金融数据放到互联网上进行发布,其效率得到了巨大的提高。因为金融数据的类型多种多样,数据量也差异巨大,对于金融数据的管理需要耗费大量时间,所以迫切需要有效地将金融数据管理起来。而现有开源的内容管理系统虽然对于企业进行内容管理的支持十分方便,但是要处理数据量差异巨大、数据类型也各不相同的金融数据却显得力不从心。因此,针对金融数据的数据特点和内容管理需求,本文提出了一种面向金融大数据的内容管理方法,利用现有开源的CMS(Content Management System内容管理系统)和NOSQL(Not Only SQL非关系型数据库)等技术来实现对金融数据的内容管理。内容管理的关键在于数据的存储,因此主要思路是如何对不同的金融数据设计出最适合的存储方案,提高性能。本方法的设计思想是针对每种金融数据的数据特性和典型的应用场景,分析其适合使用关系型数据库、列存储数据库、文档型数据库、键值数据库还是文件系统来进行存储,选择合适的数据库平台之后,进行元数据设计,并根据此类数据的应用需求建立合适的索引。为了验证和实现本方法,本文针对几种有代表性的金融数据进行存储方案设计,并进行实验测试,获得同一种数据在不同存储模式下的量化差别,验证利用此方法设计存储方案的合理性。然后利用此方法的设计思想,实现了一个金融数据内容管理系统,并对系统的功能和性能进行测试,完成了面向金融大数据的内容管理方法的设计和实现。
[Abstract]:With the prosperity of the Internet, the major exchanges around the world have put all kinds of financial data on the Internet to publish, its efficiency has been greatly improved. Because the types of financial data are various and the amount of data is very different, it takes a lot of time to manage the financial data, so it is urgent to manage the financial data effectively. Although the existing open source content management system is very convenient for enterprises to support content management, but to deal with the huge differences in the amount of data, different data types of financial data is not enough. Therefore, according to the data characteristics and content management requirements of financial data, this paper proposes a content management method for financial big data. The existing open source CMS (content Management system) and NOSQL (not only SQL non-relational database) are used to realize the content management of financial data. The key of content management is the storage of data, so the main idea is how to design the most suitable storage scheme for different financial data and improve the performance. The design idea of this method is to analyze the suitable use of relational database, column storage database, document database, key and value database or file system for storing each kind of financial data, aiming at the data characteristics of each kind of financial data and typical application scenarios. After selecting the appropriate database platform, the metadata design is carried out, and the appropriate index is built according to the application requirements of this kind of data. In order to verify and implement this method, this paper designs several representative financial data storage schemes, and carries out experimental tests to obtain the quantitative difference of the same data in different storage modes. The rationality of using this method to design storage scheme is verified. Then, a financial data content management system is implemented by using the design idea of this method. The function and performance of the system are tested, and the design and implementation of the content management method oriented to financial big data are completed.
【学位授予单位】：北京邮电大学
【学位级别】：硕士
【学位授予年份】：2016
【分类号】：TP311.13;TP311.52

【参考文献】