基于大数据技术调度端电网模型管理和分析架构

发布时间：2018-12-21 13:51

【摘要】：为了实现大运行体系下的共享多标准电网模型的统计和分析,提出了一种应用于调度端的基于大数据技术的电网模型管理和分析的架构。首先分析了大数据存储结构的特点,根据电网模型特点采用文本式结构保存电网模型,设计出结构化的主键值表征电网模型的时间、空间和应用多维度的扩展。然后研究了多源异构电网模型的ETL(extract,transform,load)技术,将调度端电网模型提取转存至分布式大数据平台。采用Map Reduce并行计算框架对模型数据进行分布式计算,为了提高分布式计算的效率,降低I/O消耗,采用索引技术对模型数据进行处理,减少各节点对全表数据进行扫描的次数。最后在调度端图形编辑器中,利用所提出的模型分析技术实现了电网图形模型的搜索,利用热度图实现了大数据搜索结果的可视化展示,并通过实例证明了所提方法的有效性。
[Abstract]:In order to realize the statistics and analysis of shared multi-standard power network model under large operation system, this paper presents an architecture of power network model management and analysis based on big data technology applied to dispatching terminal. Firstly, the characteristics of big data storage structure are analyzed. According to the characteristics of power grid model, the text structure is adopted to preserve the power network model, and a structured primary key value is designed to represent the expansion of time, space and application of the model. Then, the ETL (extract,transform,load) technology of multi-source heterogeneous power network model is studied, and the dispatching terminal grid model is extracted and stored to the distributed big data platform. In order to improve the efficiency of distributed computing and reduce the consumption of I / O, the Map Reduce parallel computing framework is used to process the model data. Reduce the number of nodes scanning the full table data. Finally, in the graph editor of dispatching terminal, the model analysis technology is used to realize the grid graphics model search, and the heat diagram is used to realize the visual display of big data search results. The effectiveness of the proposed method is proved by an example.
【作者单位】：南瑞集团公司(北京);国网冀北电力有限公司;
【基金】：国家重点研发计划项目(2017YFB0902602)~~
【分类号】：TM73

【相似文献】