基于Lucene的网络安全数据可视化系统研究与实现

发布时间：2019-06-02 15:18

【摘要】：随着计算机网络和通信技术的飞速发展,人们的生活和工作得到了极大的便利,但是随之而来的网络安全问题也给我们带来了极大的威胁。怎样从海量的网络安全数据中发现隐藏在数据背后的关系和规律成为了一个新兴的研究方向,数据可视化技术与网络安全研究的结合提供了一种高效的研究方式,通过直观的图形界面和方便的交互,网络安全数据分析者可以更高效地发现网络中潜藏的威胁以及数据背后错综复杂的关系。本文的主要工作是采用多种可视化方法对网络敏感信息进行可视化展示,并将基于Lucene的改进版全文搜索引擎与前后端分离架构的网络安全数据可视化系统结合,为系统提供更快的响应速度以提升用户体验和探索效率,使网络安全分析人员对网络安全的感知能力得到提升,从而减少网络安全问题给人们带来的损失。本文首先介绍了研究背景和意义以及网络安全可视化在学术界和工业界的研究和发展现状。接着对不同数据源的网络安全数据和网络安全日志进行了详细的介绍,并对几种常见的网络安全可视化方法进行了探究。然后研究了全文搜索引擎工具包Lucene的核心算法,提出了基于Lucene的改进版搜索结果排序算法,并设计实验对排序评分算法改进前后的检索结果做了对比。接着研究了数据可视化中的几种常见布局算法和可视化方法,结合知识图谱的概念进行网络安全数据可视化分析。最后,设计了系统的架构,详细介绍了数据预处理模块和系统核心模块,完成了前后端分离的网络安全数据可视化系统的开发,并对系统主要模块进行了展示。
[Abstract]:With the rapid development of computer network and communication technology, people's life and work have been greatly convenient, but the following network security problems have also brought us a great threat. How to find the relationship and law hidden behind the data from the massive network security data has become a new research direction, and the combination of data visualization technology and network security research provides an efficient research method. Through intuitive graphical interface and convenient interaction, network security data analysts can more efficiently discover the hidden threats in the network and the complex relationship behind the data. The main work of this paper is to use a variety of visualization methods to visually display the network sensitive information, and to combine the improved full-text search engine based on Lucene with the network security data visualization system based on the separation architecture of the front and rear. It provides the system with faster response speed to improve the user experience and exploration efficiency, and improves the perception ability of network security analysts to network security, so as to reduce the loss caused by network security problems. This paper first introduces the research background and significance, as well as the research and development status of network security visualization in academia and industry. Then the network security data and network security logs of different data sources are introduced in detail, and several common visualization methods of network security are discussed. Then the core algorithm of full-text search engine kit Lucene is studied, and an improved version of search result sorting algorithm based on Lucene is proposed, and the retrieval results before and after the improvement of sorting scoring algorithm are compared with each other. Then several common layout algorithms and visualization methods in data visualization are studied, and the network security data visualization analysis is carried out combined with the concept of knowledge graph. Finally, the architecture of the system is designed, the data preprocessing module and the core module of the system are introduced in detail, the development of the network security data visualization system separated from the front and rear is completed, and the main modules of the system are displayed.
【学位授予单位】：浙江工业大学
【学位级别】：硕士
【学位授予年份】：2017
【分类号】：TP393.08

【参考文献】