DataHub数据流通平台的设计与实现

发布时间：2017-12-26 21:22

本文关键词：DataHub数据流通平台的设计与实现　出处：《北京交通大学》2017年硕士论文　论文类型：学位论文

更多相关文章： DataHub 大数据 PaaS平台 微服务

【摘要】：随着大数据的广泛普及和应用,数据资源的价值逐步得到重视和认可,数据交易需求也在不断增加。为了实时对接数据市场的多样化需求,平台化运营成为满足这一产业需求的必要条件。DataHub支持数据流通服务,通过开源协议、开放标准、去中心化的数据传输,解决数据流通过程中的问题,实现数据有序、高效的流通。DataHub面向全球企业客户、个人客户,为数据服务提供方、数据需求方提供数据流通的平台,为用户提供认证、鉴权、流通记录、计费等功能。同时承接政府公开数据的落地,最终实现数据生态与数据互联网。DataHub数据流通平台通过PaaS平台为系统提供了应用程序的开发和运行环境,采用微服务架构模式将应用程序分割成为粒度更小的相互关联的服务,以软件工程的思想指导研究和解决数据流通与平台化问题,调研和分析数据流通平台的功能需求与非功能需求,然后进行架构的概要设计以及各功能模块的详细设计,并进行系统代码的实现,最后验证方案设计和系统效果以满足数据流通平台的所有需求,并推广上线应用。其中,微服务要求业务系统需要彻底的组件化和服务化,将原有的单个业务系统会拆分为多个可以独立开发、设计、运行和运维的小应用。这些小应用之间通过服务完成交互和集成。本人将系统分为认证、升级、账务流水、数据发布、数据订购、数据评论、数据下载、数据申诉、会员配额等服务。每个服务从前端web设计,到控制层、逻辑层、数据库访问、数据库都完全是独立的一套。在需求分析阶段,本人独立完成了界面与交互原型的设计工作。在总体设计阶段,本人完成了总体架构设计、功能模块设计、业务流程设计以及数据库的设计。在详细设计与实现阶段,本人独立完成了用户中心模块、数据管理模块与运营管理模块的设计与实现。目前,该流通平台已处于运行阶段,各模块功能稳定、运行正常,达到了预期目标。之后开发人员会根据用户的使用情况和反馈信息对系统的可用性、兼容性与可扩展性方面不断进行完善,希望可以构建成为一个更加成熟的平台。
[Abstract]:With the widespread popularization and application of large data, the value of data resources is gradually valued and recognized, and the demand for data transaction is also increasing. In order to meet the diversified demand of the data market in real time, the platform operation has become a necessary condition to meet the demand of this industry. DataHub supports data traffic service, and solves problems in data circulation process through open source protocol, open standard and centralization data transmission, so as to achieve orderly and efficient circulation of data. DataHub is for global business customers and personal customers. It provides data providers for data providers and data providers, and provides users with authentication, authentication, circulation records, billing and other functions. At the same time, to undertake the public data of the government to the ground, the final realization of the data ecology and data Internet. DataHub data distribution platform through the PaaS platform provides the development and running environment of the application of the system, using the micro service architecture application segmentation model will become interconnected smaller services, with the idea of software engineering guidance to study and solve the problem of data flow and function of the platform, demand investigation and analysis of data and non circulation platform functional requirements, detailed design and a summary of the design and architecture of each functional module, and the realization of system code, the effect of system design and finally verification scheme to meet all requirements of data distribution platform, and to promote the application of on-line. Among them, micro service requires business system to be completely component-based and service-oriented, and separate the original single business system into multiple small applications that can be independently developed, designed, run and run. These small applications interact and integrate through services. I divide the system into certification, upgrading, accounting flow, data publishing, data ordering, data review, data downloading, data appealing, membership quota and other services. Each service is designed from the front-end web to the control layer, the logic layer, the database access, and the database is completely independent. In the requirement analysis stage, I completed the design of the interface and interactive prototype independently. In the overall design phase, I completed the overall architecture design, function module design, business process design and database design. In the detailed design and implementation stage, I have completed the design and implementation of the user center module, the data management module and the operation management module independently. At present, the circulation platform has been in the stage of operation, and the functions of each module are stable and run normally, and the expected goal has been reached. After that, developers will continuously improve the usability, compatibility and scalability of the system based on users' usage and feedback information, hoping to build a more mature platform.
【学位授予单位】：北京交通大学
【学位级别】：硕士
【学位授予年份】：2017
【分类号】：TP311.52

【相似文献】