环境保护局数据中心的设计与实现
发布时间:2018-08-04 10:21
【摘要】:当今社会信息化发展迅速,各单位、部门在工作过程中过已产生大量的数据信息。然而这些海量的且存储结构复杂的数据并不总能高效、直接便捷的为管理、辅助决策提供相应的信息支撑,还需要进行大量的数据处理工作,,把复杂的位于各个不同平台的异构数据变成基于相同平台并且具有相同结构符合最终用户业务逻辑的数据信息,进而转化为信息和知识,为企业管理决策分析服务。围绕异构信息数据的处理,产生了大量相关的项目、产品和课题。环保行业经过多年积累,各级环保组织的信息化建设工作取得了显著进展,大部分环境管理业务已实现信息化管理。但由于缺少统一规划,各业务系统间环境数据信息不能共享,无法实现更高级的数据分析应用功能,未能实现信息效益的最大化。构建统一的“环境数据中心”成为当前环保信息化建设的核心内容和关键所在。 本文的研究内容和取得的成果主要体现在以下三个方面: 首先,进行了数据资源分析,主要是从不同角度对环保领域所涉及的数据进行分析,梳理数据来源,以及整理分析数据的收集、加工、关联、整合和应用的过程。 其次,是设计环境业务数据库和环境数据仓库。研究数据中心平台对报表展示功能、图形展示功能、统计分析功能、数据挖掘功能等功能的实现和相关应用的支撑。 最后,是数据采集与整合设计,主要研究电子表单、excle文件数据导入、异构数据整合、数据交换、ETL等技术,实现数据采集、交换和整合。设计数据采集工具实现网页方式的应用系统数据的抓取。
[Abstract]:Nowadays, with the rapid development of information technology, various units and departments have already produced a large amount of data information in the process of work. However, these massive and complex data storage structure can not always be efficient, direct and convenient for the management of decision-making to provide the corresponding information support, but also need a lot of data processing work, The complex heterogeneous data located on different platforms can be transformed into data information based on the same platform and with the same structure according to the end-user business logic, and then transformed into information and knowledge, which can serve for enterprise management decision analysis. Around the heterogeneous information data processing, produced a large number of related projects, products and topics. After years of accumulation of environmental protection industry, the informatization construction of environmental protection organizations at all levels has made remarkable progress, most of the environmental management business has realized information management. However, due to the lack of unified planning, the environmental data information can not be shared among the business systems, which can not achieve more advanced functions of data analysis and application, and can not maximize the benefits of information. Constructing a unified environmental data center has become the core content and key of environmental protection information construction. The research contents and achievements of this paper are mainly reflected in the following three aspects: first, the data resource analysis is carried out, mainly from different angles to analyze the data involved in the field of environmental protection, combing the data sources, And the process of data collection, processing, association, integration and application. Secondly, design environment business database and environment data warehouse. This paper studies the data center platform for the report display function, graphics display function, statistical analysis function, data mining function and other functions of the implementation and related applications. Finally, it is the design of data acquisition and integration. It mainly studies the technology of data import, heterogeneous data integration, data exchange and ETL, which can realize data acquisition, exchange and integration. The data acquisition tool is designed to realize the data capture of the web page application system.
【学位授予单位】:北京工业大学
【学位级别】:硕士
【学位授予年份】:2013
【分类号】:TP308;TP311.52
本文编号:2163618
[Abstract]:Nowadays, with the rapid development of information technology, various units and departments have already produced a large amount of data information in the process of work. However, these massive and complex data storage structure can not always be efficient, direct and convenient for the management of decision-making to provide the corresponding information support, but also need a lot of data processing work, The complex heterogeneous data located on different platforms can be transformed into data information based on the same platform and with the same structure according to the end-user business logic, and then transformed into information and knowledge, which can serve for enterprise management decision analysis. Around the heterogeneous information data processing, produced a large number of related projects, products and topics. After years of accumulation of environmental protection industry, the informatization construction of environmental protection organizations at all levels has made remarkable progress, most of the environmental management business has realized information management. However, due to the lack of unified planning, the environmental data information can not be shared among the business systems, which can not achieve more advanced functions of data analysis and application, and can not maximize the benefits of information. Constructing a unified environmental data center has become the core content and key of environmental protection information construction. The research contents and achievements of this paper are mainly reflected in the following three aspects: first, the data resource analysis is carried out, mainly from different angles to analyze the data involved in the field of environmental protection, combing the data sources, And the process of data collection, processing, association, integration and application. Secondly, design environment business database and environment data warehouse. This paper studies the data center platform for the report display function, graphics display function, statistical analysis function, data mining function and other functions of the implementation and related applications. Finally, it is the design of data acquisition and integration. It mainly studies the technology of data import, heterogeneous data integration, data exchange and ETL, which can realize data acquisition, exchange and integration. The data acquisition tool is designed to realize the data capture of the web page application system.
【学位授予单位】:北京工业大学
【学位级别】:硕士
【学位授予年份】:2013
【分类号】:TP308;TP311.52
【参考文献】
相关期刊论文 前10条
1 洪亮;田支斌;;浅析中文环境下的Apach Commons HttpClient编程[J];电脑知识与技术;2008年22期
2 黄纪盛;;POI与JXL在研究生选课系统的研究与应用[J];电脑知识与技术;2010年22期
3 张强;;利用POI操作Excel[J];电脑知识与技术;2010年24期
4 张铁头;马丽霞;;使用HttpClient实现基于WEB的第三方登录验证[J];电脑知识与技术;2012年12期
5 李顺;徐富春;孔益民;张波;;国家环境数据中心建设探讨[J];环境保护;2006年02期
6 郝春辉;邹静;;基于XML Schema的XML存储[J];计算机工程与应用;2006年11期
7 周剑;朱耀琴;唐卫清;;面向复杂产品协同开发的数据集成方法研究[J];计算机科学;2009年12期
8 缪嘉嘉,邓苏,刘青宝;ETL综述[J];计算机工程;2004年03期
9 郑荣;马世龙;;网格环境下基于XML的异构数据集成系统[J];计算机工程;2008年22期
10 谭劲,余胜生,周敬利;Digest与Web Cache Digest协议[J];计算机应用研究;2002年12期
本文编号:2163618
本文链接:https://www.wllwen.com/kejilunwen/jisuanjikexuelunwen/2163618.html