基于NetMagic的远程可控网络数据采集平台设计与实现

发布时间：2018-06-07 04:14

本文选题：网络测量 + 数据采集　；参考：《国防科学技术大学》2014年硕士论文

【摘要】：随着互联网技术和通信技术的迅猛发展,通信网络、计算机网络及有线电视网络逐渐融合,人们的工作、生活、娱乐等都紧紧地和互联网联系在一起。用户对网络服务质量和信息安全的要求越来越高,ISP(Internet Services Provider)需要通过网络测量和分析,实现对网络更好的管理和维护,从而满足客户要求;同时IP网络技术的研究与发展、网络安全、网络行为学研究等均需要网络测量。网络测量作为分析网络数据,监测网络性能的基本手段,已经成为网络研究的重要课题。然而,网络测量结果是否精准取决于数据采集的手段和工具,网络数据采集作为网络测量的基础和前提,更是网络测量工程的重中之重。如何设计实现精确度高、易于管理,不影响网络正常运行的数据采集工具是网络测量研究人员考虑的重点。为此,本文基于Net Magic设计了一种远程可控的网络数据采集平台NDCP(Network Data Collecting Platform)。主要工作及创新点包括:一是在对网络测量、数据采集及Net Magic平台等相关技术研究的基础上,提出了一种基于Net Magic的远程可控网络数据采集平台的实现方案。设计了平台部署环境及整体架构;采用硬件分块、软件分层的思想,分别设计了平台硬件逻辑结构和远程控制软件结构。二是实现了一种对采集平台远程控制管理的新方法。设计了平台软硬件通信的基本框架,实现了数据采集平台远程访问控制的专用协议;扩充了平台远程控制管理软件的层次结构,定义了最底层的基本库函数和应用支撑层的主要函数。三是提出了网络数据采集平台硬件设计的新方法。基于自动地址获取、网络地址解析、多元组存储及查找匹配、精确时间戳等技术,实现了采集平台报文识别分类、地址自动配置、查表匹配报文转发、报文发送控制等功能模块。四是基于采集平台设计搭建了实验验证环境,验证了数据采集平台硬件关键模块的功能。深入分析了平台性能、硬件资源消耗情况及平台转发报文的延时。验证和分析结果表明,该平台运行稳定且功能和性能符合设计需求。综上所述,本文基于Net Magic对网络数据采集等相关技术展开研究,设计实现了NDCP数据采集平台。课题研究成果对于网络数据采集技术的创新发展具有一定的理论意义和实用价值。
[Abstract]:With the rapid development of Internet technology and communication technology, communication network, computer network and cable television network gradually merge, people's work, life, entertainment and so on are closely related to the Internet. The demand of users for network quality of service and information security is more and more high. The Internet Services provider needs to realize better management and maintenance of network through network measurement and analysis, so as to meet the requirements of customers, and at the same time, the research and development of IP network technology. Network security and network behavior research need network measurement. Network measurement, as a basic means to analyze network data and monitor network performance, has become an important topic in network research. However, the accuracy of network measurement results depends on the means and tools of data acquisition. As the basis and premise of network measurement, network data acquisition is the most important part of network measurement engineering. How to design a data acquisition tool with high accuracy, easy management and no influence on the normal operation of the network is the focus of network measurement researchers. Therefore, this paper designs a remote and controllable network data acquisition platform NDCP(Network Data Collecting platform based on Net Magic. The main work and innovations are as follows: firstly, based on the research of network measurement, data acquisition and Net Magic platform, a scheme of remote controllable network data acquisition platform based on Net Magic is proposed. The hardware logical structure and remote control software structure of the platform are designed by using the idea of hardware block and software stratification. The other is to realize a new method of remote control and management of the acquisition platform. The basic framework of software and hardware communication of the platform is designed, the special protocol of remote access control of the data acquisition platform is realized, and the hierarchical structure of the remote control management software of the platform is extended. The basic library functions at the lowest level and the main functions of the application support layer are defined. Third, a new method of hardware design of network data acquisition platform is proposed. Based on the technologies of automatic address acquisition, network address resolution, multi-group storage and search matching, accurate time stamp, etc., the collection platform message recognition and classification, address automatic configuration, search table matching message forwarding, etc. Message sending control and other function modules. Fourthly, the experimental verification environment is built based on the data acquisition platform design, and the function of the key hardware module of the data acquisition platform is verified. The performance of the platform, the consumption of hardware resources and the delay of forwarding message are analyzed. The results of verification and analysis show that the platform runs stably and its function and performance meet the design requirements. The research results have certain theoretical significance and practical value for the innovation and development of network data acquisition technology.
【学位授予单位】：国防科学技术大学
【学位级别】：硕士
【学位授予年份】：2014
【分类号】：TP393.06

【参考文献】