大数据环境下面向FY3的辐射计算与分析研究

发布时间：2018-06-22 06:54

本文选题：大数据 + 辐射传输仿真计算　；参考：《北方工业大学》2017年硕士论文

【摘要】：本文基于风云三号(FY3)卫星数据,研究了辐射传输仿真计算的结构和流程。在研究过程中发现了在大数据环境下单点计算无法快速完成指定任务的问题。根据辐射传输仿真计算的结构、流程以及数据等因素,结合并行计算相关知识,提出了加快仿真计算效率的方案,并且根据该计算方案将辐射传输仿真计算部署于一个适合该方案的集群系中去。最后,对辐射传输仿真的计算数据进行了实验分析。本文的主要创新与内容如下:1、辐射传输仿真的并行计算设计方案。为了解决辐射传输仿真计算在单一节点下计算慢的问题,大量研究了辐射传输仿真计算的流程中应用的数据的提取和处理的方式,分析了计算的物理结构。通过实验统计了计算过程的每一个步骤消耗的时间。根据以上总结归纳的辐射传输仿真的特性,结合研究的并行计算设计方法,提出辐射传输仿真的并行计算方案。2、辐射传输仿真集群系统的实现。基于辐射传输的并行计算方案,设计并实现了一个符合计算方案的集群计算系统。此系统结合集群技术知识,满足集群的单一系统映像、可用性高、低成本等优点和特性。根据实验证明,该集群系统提高了辐射传输仿真计算的效率,说明了辐射传输仿真计算并行设计方案的可行性。3、集群管理系统的实现。基于辐射传输仿真集群系统的复杂结构以及管理困难等问题,设计了一个界面友好,功能齐全的集群管理系统。该管理系统实现了对集群系统中任务的监控、节点的监控和管理等功能,为用户提供了一个良好的集群系统的管理平台。4、本文通过同一组数据对集群系统和单计算机分别进行计算,通过对比消耗时间,证明了集群的高计算性能。通过大量风云三号卫星数据的辐射传输仿真计算结果,分析了不同数据对同一组数据的敏感性。并且根据误差的分析,判断不同的数据对仿真数据的影响。
[Abstract]:In this paper, based on Fengyun three (FY3) satellite data, the structure and process of simulation calculation of radiation transmission are studied. In the process of research, the problem that the assigned task can not be completed quickly by single point calculation under the large data environment is found. According to the structure, process and data of the simulation calculation of radiation transmission, the related knowledge of parallel computing is proposed. The scheme to speed up the efficiency of simulation calculation is proposed, and the simulation calculation of radiation transmission is deployed in a cluster system suitable for the scheme according to the calculation scheme. Finally, the experimental analysis of the calculated data of the radiation transmission simulation is carried out. The main innovations and contents of this paper are as follows: 1, the parallel computing design scheme of the radiating transmission simulation is understood. The simulation calculation of radiative transmission is slow under a single node. A large number of methods of extracting and processing the data used in the simulation process of radiation transmission are studied. The physical structure of the calculation is analyzed. The time consumed by each step of the calculation process is calculated by the experiment. The radiation transmission is simulated according to the above summarization. Real characteristics, combined with the parallel computing design method of research, a parallel computing scheme of radiation transmission simulation.2, the implementation of the radiation transmission simulation cluster system. A cluster computing system based on the parallel computing scheme of radiation transmission is designed and implemented. This system combines the cluster technical knowledge to satisfy the cluster single. A system image, high availability, low cost and other advantages and characteristics. According to the experiment, it has been proved that the cluster system improves the efficiency of simulation and calculation of radiation transmission, illustrates the feasibility of the parallel design scheme of the simulation and calculation of radiation transmission.3, the realization of the cluster management system, and the complex structure and management difficulties based on the radiation transmission simulation cluster system. A cluster management system with friendly interface and full function is designed. The management system implements the functions of monitoring, monitoring and management of the tasks in the cluster system, providing a good management platform for the users of the cluster system,.4. In this paper, the cluster system and the single computer are calculated by the same group of data. By comparing the consumption time, the high computing performance of the cluster is proved. The sensitivity of different data to the same group of data is analyzed through the simulation results of a large number of wind and cloud three satellite data, and the influence of different data on the simulation data is determined according to the analysis of the error.
【学位授予单位】：北方工业大学
【学位级别】：硕士
【学位授予年份】：2017
【分类号】：P409;TP311.52

【参考文献】