金融资讯云平台数据分发和存储系统的研究和设计
发布时间:2018-08-17 15:54
【摘要】:金融数据云平台的建设,可以根据国家利益在全球范围内采集金融信息,为我国金融机构和非金融企业参与全球证券、外汇与货币、固定收益、商品与能源等市场,提供较为全面、准确的金融信息服务,从而掌握金融信息的采集权,增强金融信息的发布权,形成金融产品的定价权,提高金融领域的话语权,切实维护我国的金融安全和信息安全。2006年3月,亚马逊推出弹性计算云EC2服务。时至今日,云计算可以概括分为基础设施即服务,平台即服务和软件即服务。金融数据分为结构化数据和非结构化数据。随着网络的发展,结构数据和非结构数据的边界开始模糊,在一定的条件下经常需要转化。金融数据量是巨大的,并且需要长久保存,金融数据云平台面临着海量数据存储的问题。金融数据的实时性和准确性都要求非常高,金融数据云平台也面临着数据分发的问题。所以,本文将是面向金融数据平台的平台即服务的金融数据分发和数据存储的研究和设计。 通过对FIX协议、NAS、对象存储、Google GFS、HDFS的研究,掌握了现在的数据存储和数据分发技术。金融数据云平台的数据分发要求流量控制能够弹性适应金融数据本身的突发性和实效性,适合异地备份和异地存储的存储方式。同时体现可用性、安全性、性能和扩展性。金融数据云平台的数据分发包括五个组件:数据通信模块、数据提交模块、策略控制模块、一系列控制策略和存储数据的数据服务器。金融数据云平台的数据存储不仅仅只是做到数据安全、异地访问、数据一致,更是要做到异地备份、异地灾备。数据存储将用到数据库存储、文件存储、内存(缓存)存储。通过备份虚拟化技术、SOA、自动化管理等实现金融数据云平台的异地备份。通过各节点间的数据自动复制和同步功能,并在存储阵列上进行基于IP网络的远程卷复制,最终实现数据级的容灾保护,并确保两地数据的一致性,即可实现金融数据云平台的异地灾备。通过DNS的接入,访问权限控制层,最终通过应用层路由控制将应用请求转发至各地的应用平台之上,实现异地访问。 本文通过对金融数据云平台的分发和存储的研究,旨在未来构建处理面向多种类、多渠道、多类型金融数据的金融数据云平台。
[Abstract]:The construction of the financial data cloud platform can collect financial information on a global scale according to the national interests, so that our financial institutions and non-financial enterprises can participate in global securities, foreign exchange and currency, fixed income, commodities and energy markets. To provide a more comprehensive and accurate financial information service, so as to master the right to collect financial information, strengthen the right to issue financial information, form the pricing power of financial products, and enhance the right to speak in the financial field. Effectively maintain our financial and information security. In March 2006, Amazon launched the flexible Computing Cloud EC2 service. Today, cloud computing can be divided into infrastructure as a service, platform as a service and software as a service. Financial data is divided into structured data and unstructured data. With the development of network, the boundary of structural data and unstructured data begin to blur, and often need to be transformed under certain conditions. The financial data volume is huge and needs to be preserved for a long time. The financial data cloud platform is faced with the problem of massive data storage. The real-time and accuracy of financial data are very high, and the cloud platform of financial data is also faced with the problem of data distribution. Therefore, this paper is the research and design of financial data distribution and data storage for financial data platform. Through the research on FIX protocol, FIX, object storage and FIX, the present technology of data storage and data distribution has been mastered. The data distribution of the financial data cloud platform requires that the flow control can adapt to the sudden and effective of the financial data itself and is suitable for the storage mode of backup and storage in different places. It also embodies usability, security, performance and scalability. The data distribution of the financial data cloud platform consists of five components: data communication module, data submission module, policy control module, a series of control strategies and data server for storing data. The data storage of financial data cloud platform is not only to achieve data security, remote access, consistent data, but also to achieve remote backup, disaster preparedness. Data storage will use database storage, file storage, memory (cache) storage. Through backup virtualization technology SOA, automatic management and other financial data cloud platform remote backup. By automatically copying and synchronizing the data between the nodes and remote volume replication based on IP network on the storage array, the disaster tolerance protection of data level is finally realized, and the consistency of data between the two places is ensured. Can realize the financial data cloud platform remote disaster preparedness. Through the access of DNS, access control layer, and finally through the application layer routing control to forward the application request to the application platform in order to achieve remote access. Through the research on the distribution and storage of financial data cloud platform, this paper aims to construct a financial data cloud platform for dealing with multi-type, multi-channel and multi-type financial data in the future.
【学位授予单位】:北京邮电大学
【学位级别】:硕士
【学位授予年份】:2012
【分类号】:TP333
本文编号:2188151
[Abstract]:The construction of the financial data cloud platform can collect financial information on a global scale according to the national interests, so that our financial institutions and non-financial enterprises can participate in global securities, foreign exchange and currency, fixed income, commodities and energy markets. To provide a more comprehensive and accurate financial information service, so as to master the right to collect financial information, strengthen the right to issue financial information, form the pricing power of financial products, and enhance the right to speak in the financial field. Effectively maintain our financial and information security. In March 2006, Amazon launched the flexible Computing Cloud EC2 service. Today, cloud computing can be divided into infrastructure as a service, platform as a service and software as a service. Financial data is divided into structured data and unstructured data. With the development of network, the boundary of structural data and unstructured data begin to blur, and often need to be transformed under certain conditions. The financial data volume is huge and needs to be preserved for a long time. The financial data cloud platform is faced with the problem of massive data storage. The real-time and accuracy of financial data are very high, and the cloud platform of financial data is also faced with the problem of data distribution. Therefore, this paper is the research and design of financial data distribution and data storage for financial data platform. Through the research on FIX protocol, FIX, object storage and FIX, the present technology of data storage and data distribution has been mastered. The data distribution of the financial data cloud platform requires that the flow control can adapt to the sudden and effective of the financial data itself and is suitable for the storage mode of backup and storage in different places. It also embodies usability, security, performance and scalability. The data distribution of the financial data cloud platform consists of five components: data communication module, data submission module, policy control module, a series of control strategies and data server for storing data. The data storage of financial data cloud platform is not only to achieve data security, remote access, consistent data, but also to achieve remote backup, disaster preparedness. Data storage will use database storage, file storage, memory (cache) storage. Through backup virtualization technology SOA, automatic management and other financial data cloud platform remote backup. By automatically copying and synchronizing the data between the nodes and remote volume replication based on IP network on the storage array, the disaster tolerance protection of data level is finally realized, and the consistency of data between the two places is ensured. Can realize the financial data cloud platform remote disaster preparedness. Through the access of DNS, access control layer, and finally through the application layer routing control to forward the application request to the application platform in order to achieve remote access. Through the research on the distribution and storage of financial data cloud platform, this paper aims to construct a financial data cloud platform for dealing with multi-type, multi-channel and multi-type financial data in the future.
【学位授予单位】:北京邮电大学
【学位级别】:硕士
【学位授予年份】:2012
【分类号】:TP333
【参考文献】
相关期刊论文 前3条
1 唐箭;;云存储系统的分析与应用研究[J];电脑知识与技术;2009年20期
2 刘朝斌;谢长生;张琨;;存储网络虚拟化关键技术的研究与实现[J];计算机科学;2004年05期
3 周婧;王意洁;阮炜;李思昆;;面向海量数据的数据一致性研究[J];计算机科学;2006年04期
相关硕士学位论文 前3条
1 杜勇;基于HDFS的云数据备份系统的设计与实现[D];吉林大学;2011年
2 李国;面向银行应用的数据备份系统的设计与实现[D];电子科技大学;2000年
3 刘艳;SAN环境下数据备份系统的设计与实现[D];重庆大学;2008年
,本文编号:2188151
本文链接:https://www.wllwen.com/kejilunwen/jisuanjikexuelunwen/2188151.html