基于企业信息资源目录的多源ETL模型的研究

发布时间：2019-06-12 07:46

【摘要】：随着国家“互联网+”行动战略的提出,“两化深度融合”和大数据在各大企业中的应用,企业信息化越来越重要,相对僵化与孤立的信息资源架构体系已不能满足集团企业各级业务对数据共享发展的需要,其根本原因在于企业的信息化建设中,单独的企业部门间都建立了功能各不相同的信息管理系统,并且同一企业内部各部门间往往也单独开发了很多独立运行的信息系统,由于系统中的数据来源于不同的数据库并且数据格式也不一致,这就导致系统之间无法实现信息资源的交换与共享,因此形成了信息孤岛。目前最有效的方法来打破信息孤岛就是建立一个信息资源共享平台。本文讨论和研究的重点在于企业信息资源目录共享模型构建的过程中企业信息资源如何在异构平台和异构系统中进行交换,实现多源异构信息资源共享。针对这一问题,国际信息标准化组织制定了MFI(互操作性元模型框架)系列标准,该标准从信息模型注册、映射信息注册都给出了具体的规范化的“元数据模型”来描述元信息,因此异构数据源的集成在根本上就得到了解决。ETL技术主要包含数据的抽取、转换和加载三个部分,在数据集成过程中常常用来处理复杂的数据源以及在企业信息资源交换中的异构数据等问题。基于国际标准的企业信息资源目录的ETL模型具有高度的数据集成性并能良好的处理异构数据等特点,其屏蔽了传统数据库技术的一些缺陷,不仅兼备传统数据库的优点还使数据具有更高的集成性、稳定性。所以运用ETL来解决企业信息资源共享等问题是有效可行的。本文站在企业全局的角度来设计信息资源的整合架构方案,运用ETL技术并结合MFI-12信息模型注册标准、MFI-10映射模型注册标准以及MFI-7服务注册标准,为用户提供查询接口,使用户能够通过屏蔽底层数据源,只针对全域共享模型提出查询指令来获取底层源模型中的数据,构建了以统筹整合为基础、以交换共享为途径、以国际标准为支撑、以信息资源目录为核心的多源ETL共享模型,并通过信息资源目录ETL系统得以验证。
[Abstract]:With the introduction of the national "Internet" action strategy, the application of "deep integration of two modernizations" and big data in major enterprises, enterprise informatization is becoming more and more important. The relatively rigid and isolated information resource architecture system can no longer meet the needs of the development of data sharing at all levels of the business of group enterprises. The fundamental reason lies in the information construction of enterprises. Information management systems with different functions have been established among individual enterprise departments, and many independent information systems have been developed separately among departments within the same enterprise. Because the data in the system come from different databases and the data format is not consistent, the exchange and sharing of information resources between the systems can not be realized, so the information island is formed. At present, the most effective way to break the information island is to establish an information resource sharing platform. The focus of this paper is how to exchange enterprise information resources between heterogeneous platforms and heterogeneous systems in the process of constructing the directory sharing model of enterprise information resources, so as to realize the sharing of multi-source and heterogeneous information resources. In order to solve this problem, the International Organization for Information Standardization (MFI) has formulated a series of standards, which describe metadata from information model registration and mapping information registration, so the integration of heterogeneous data sources has been fundamentally solved. ETL technology mainly includes three parts: data extraction, transformation and loading. In the process of data integration, it is often used to deal with complex data sources and heterogeneous data in the exchange of enterprise information resources. The ETL model of enterprise information resource directory based on international standard has the characteristics of high data integration and good processing of heterogeneous data. It shielded some defects of traditional database technology. It not only has the advantages of traditional database, but also makes the data have higher integration and stability. Therefore, it is effective and feasible to use ETL to solve the problems of enterprise information resource sharing. This paper designs the integration architecture scheme of information resources from the point of view of the overall situation of the enterprise. Using ETL technology, combined with MFI-12 information model registration standard, MFI-10 mapping model registration standard and MFI-7 service registration standard, this paper provides users with query interface, so that users can obtain the data in the underlying source model by shielding the underlying data source and putting forward query instructions only for the global sharing model. A multi-source ETL sharing model based on overall integration, exchange and sharing, supported by international standards and centered on information resource directory is constructed and verified by information resource directory ETL system.
【学位授予单位】：东北石油大学
【学位级别】：硕士
【学位授予年份】：2017
【分类号】：F270.7;TP311.13

【参考文献】