基于PostgreSQL集群的能源数据采集存储系统的研究与实现

发布时间：2018-03-14 22:04

本文选题：能源数据　切入点：数据采集存储　出处：《华南理工大学》2013年硕士论文　论文类型：学位论文

【摘要】：随着经济的发展、人类对能源的依赖、地球资源枯竭的同时，节能减排越来越受到人们的关注。如何对能源进行有效的节约，并对已经消耗的能源数据进行正确的管理与分析变的越来越重要了。能源数据采集存储作为节能减排工作的数据来源、耗能度量、节能方案的决策以及节能体系的组成部分，在节能减排工作中具有重要作用。目前大多数能源数据采集存储系统对数据进行集中式的管理和存储。随着计算机网络的发展和能源采集点的日益增多，这种集中的管理模式就渐渐显出不足的地方。由于数据是集中存放在单个数据库中的，随着时间的推移，数据库中的数据越来越多，数据存取请求响应时间长已经成为该系统的瓶颈。如果引入一个数据库集群，将这些数据分布在多个数据库服务器上，多个数据库服务器并行处理请求，以提高数据存取速度，，在数据处理效率上这显然比单个数据库更加高效。于是在能源采集存储系统中引入PostgreSQL集群。本文研究的主要工作有以下几个方面：第一，根据能源数据采集存储系统的功能要求，对华南理工大学能源数据采集存储系统的数据采集存储流程进行了模块化修改，并增加了备份功能，实现了能源数据采集存储系统中的数据采集、存储、备份等功能要求。并利用缓存来临时存储数据，以应对通信中断可能丢失能源数据的问题。第二，着重研究了PostgreSQL数据库理论知识，以及PostgreSQL数据库实现数据库集群的可行性。研究了中间件pgpool-II，通过pgpool-II中间件，配合多个PostgreSQL数据库服务器，可以实现数据库集群。研究、设计了以能源类型为划分属性的数据分布策略。第三，将搭建的PostgreSQL数据库集群引入到华南理工大学能源数据采集存储系统中，将能源数据合理地分布到各个数据库服务器节点，对华南理工大学建筑能源数据进行采集存储测试，得到测试结果。经过测试运行，该系统达到研究目标。本文设计与实现的PostgreSQL数据库集群为能源数据采集存储系统的理论研究与实际应用提供一定的参考和借鉴。
[Abstract]:With the development of economy, the dependence of human beings on energy and the depletion of earth resources, more and more attention has been paid to energy conservation and emission reduction. And it is becoming more and more important to correctly manage and analyze the energy data that has been consumed. Energy data acquisition and storage is used as the data source, energy consumption measurement, energy saving scheme decision and the component of energy saving system. It plays an important role in the work of energy saving and emission reduction. At present, most energy data acquisition and storage systems manage and store data centrally. With the development of computer network and the increasing number of energy collection points, This centralized management model gradually shows its shortcomings. Because the data is centrally stored in a single database, the amount of data in the database increases over time. Long response time for data access requests has become the bottleneck of the system. If a database cluster is introduced, the data will be distributed across multiple database servers, and multiple database servers will process requests in parallel to improve the speed of data access. This is obviously more efficient than a single database in terms of data processing efficiency, so PostgreSQL clusters are introduced into energy acquisition and storage systems. The main work of this paper is as follows:. First, according to the functional requirements of the energy data acquisition and storage system, the data acquisition and storage process of the energy data acquisition and storage system of South China University of Technology is modularized, and the backup function is added. The functions of data acquisition, storage and backup in the energy data acquisition and storage system are realized, and the cache is used to store the data in order to deal with the problem that the communication interrupt may lose the energy data. Secondly, the theoretical knowledge of PostgreSQL database and the feasibility of implementing database cluster in PostgreSQL database are studied, and the middleware pgpool-II, which can realize database cluster through pgpool-II middleware and several PostgreSQL database servers, is studied. A data distribution strategy based on energy type is designed. Thirdly, the PostgreSQL database cluster is introduced into the energy data acquisition and storage system of South China University of Technology, and the energy data is distributed reasonably to each database server node. The data of building energy of South China University of Technology are collected and stored, and the test results are obtained. The PostgreSQL database cluster designed and implemented in this paper provides a reference for the theoretical research and practical application of the energy data acquisition and storage system.
【学位授予单位】：华南理工大学
【学位级别】：硕士
【学位授予年份】：2013
【分类号】：TP333

【参考文献】