海量遥感数据交换技术研究与应用

发布时间：2018-03-06 03:13

本文选题：数据快速分发　切入点：安全可靠交换　出处：《河南大学》2014年硕士论文　论文类型：学位论文

【摘要】：遥感行业应用多数为数据密集型，同时计算密集型应用，提高遥感系统的时效性，，不仅需要考虑提高系统对数据的处理能力，还需要考虑如何缩短传输时延，随着用户量的增加会导致随之而来的网络流量的增加，用户将会面临越来越多的数据传输时延和传输失败。如今，如何提高整个系统的数据处理吞吐量，如何安全可靠快速地传递待处理数据，如何降低数据传输和存储系统的维护成本，如何降低应用程序耦合程度，增强可扩展性和可伸缩性，这些都已经成为遥感行业应用系统发展和建设过程中亟待解决的问题。本文采用REST(Representational State Transfer)架构实现遥感应用后台数据交换系统，充分利用现有的HTTP/JSON等网络技术，有效地弥补了传统网络架构的不足，在保持提供简洁高效的客户端接口前提下，着力提高遥感应用后台数据交换系统的可伸缩性，提供低成本的扩容和维护方法。REST架构风格特别适合资源型服务接口的设计，将服务器上的共享的遥感数据看作资源，使用HTTP、URI、XML以及HTML这些广泛使用的协议和标准让Web服务重归其成功的关键——简单。消费Web服务的客户端或者浏览器通过资源标识符去操作资源，REST架构风格的开发方式使得系统结构更加简明。本文采用REST架构风格实现了一个分布式的海量遥感数据安全可靠分发系统，并对该系统的性能和可行性进行了验证，主要成果有以下3点： (1)实现GF应用系统前后端海量数据同步协同功能：通过资源注册与管理，使前后端能够自动地进行关于元数据的信息交流，从而保证前后端海量数据及时同步协同。 (2)实现海量GF数据共享服务的安全可靠交换功能：研究开发了面向不同前后端的GF数据交换中间件以支持TB级的空间数据安全交换，为GF应用数据的安全交换提供基础。 (3)实现海量数据快速分发功能：为满足大数据量、大量用户高并发访问环境下提供稳定低延时的海量遥感数据访问服务的需要，为GF应用提供基础数据传输支撑，本文提出使用基于一致性哈希（Consistent Hashing）实现网络缓存（Web Caching）系统。
[Abstract]:Most remote sensing applications are data-intensive and computationally intensive to improve the timeliness of remote sensing systems. It is necessary not only to consider how to improve the system's ability to process data, but also to consider how to shorten the transmission delay. With the increase in the number of users will lead to the subsequent increase in network traffic, users will face more and more data transmission delays and transmission failures. Nowadays, how to improve the data processing throughput of the whole system, How to transfer data to be processed safely, reliably and quickly, how to reduce the maintenance cost of data transmission and storage system, how to reduce the degree of application coupling, and how to enhance scalability and scalability. All of these have become the problems to be solved in the development and construction of remote sensing application system. In this paper, we use REST(Representational State transfer architecture to realize the background data exchange system of remote sensing application, and make full use of existing network technologies such as HTTP/JSON, etc. Effectively make up for the shortcomings of the traditional network architecture, while maintaining a simple and efficient client interface, focus on improving the remote sensing application background data exchange system scalability, Provides low-cost expansion and maintenance methods. Rest architectural style is particularly suited to the design of resource-based service interfaces, treating shared remote sensing data on servers as resources, The key to bringing Web services back to success using HTTP uri XML and widely used protocols and standards such as HTML is simple. Clients or browsers consuming Web Services manipulate Resource rest Architecture-style Development via Resource identifiers. This paper uses REST architecture style to implement a distributed security and reliable distribution system for mass remote sensing data. The performance and feasibility of the system are verified. The main results are as follows:. 1) realizing the synchronization and cooperation function of massive data in front and rear end of GF application system: through resource registration and management, the front and rear end can automatically exchange information about metadata, so as to ensure timely synchronization and cooperation of mass data in front and rear end. 2) realizing the secure and reliable exchange function of massive GF data sharing service: the GF data exchange middleware for different front and rear end is developed to support the terabyte level spatial data security exchange, which provides the basis for the secure exchange of GF application data. In order to meet the needs of large amount of data and large amount of users in high concurrent access environment, to provide stable and low delay mass remote sensing data access service, and to provide basic data transmission support for GF application, In this paper, a Consistent Hashing-based network cache (Cache) system is proposed.
【学位授予单位】：河南大学
【学位级别】：硕士
【学位授予年份】：2014
【分类号】：TP79

【参考文献】