基于策略树规则的日志智能分析系统的设计与实现

发布时间：2018-01-30 01:45

本文关键词： 策略树规则问题排查日志分析集群　出处：《华中科技大学》2016年硕士论文　论文类型：学位论文

【摘要】：如今,建立在多服务器集群上的后台系统日益庞大,复杂多样化的业务、亿级的请求数据,使得后台系统日志分析的难度不断增大、效率逐步降低。快速搜索到关键信息,准确定位相应问题,已经成为各类后台系统业务人员、开发人员和管理人员的迫切需求。为了满足各方对业务数据、故障信息筛选的高要求,智能分析系统应运而生,它能够实现基于关键字的信息采集汇总,解析详细错误消息,达到问题排查的目的。为了实现一个高效率的智能分析系统,主要工作有下面几个方面:通过业务单据号和执行环境,实现基于业务的日志搜索和指定系统的问题排查;对排查搜索结果进行优化缓存管理;对业务制定相应的策略,策略由若干规则组成,以树形结构呈现,并进行管理;借助策略树,形成问题排查的行为模式,根据用户输入条件,自动匹配执行相应的策略;定时汇总环境大盘监控记录;方便快捷自动访问业务运行的服务器集群,并获得数据。它是一个轻量级的web系统,有强大的后台查询分析功能。策略树中每个节点的规则都包含判断和动作两大类属性。判断表明是否执行该规则,动作表明该规则应当执行的操作。日志分析的过程即为策略树中从根节点开始执行动作的过程。目前,智能分析系统的功能均已全部实现。经过反复测试,系统能够正常运行,界面友好,用户可以简单快速的使用系统的所有功能。实践表明,系统的设计和实现是真实可靠的。
[Abstract]:Nowadays, the background system built on the multi-server cluster is increasingly large, complex and diversified business, multi-level request data, making the background system log analysis increasingly difficult. Efficiency gradually decreased. Quickly search key information, accurately locate the corresponding problems, has become the urgent needs of all kinds of back-end system business personnel, developers and managers. In order to meet the needs of all parties to the business data. Because of the high requirement of fault information screening, intelligent analysis system emerges as the times require. It can collect and aggregate information based on keywords and analyze detailed error messages. In order to realize an efficient intelligent analysis system, the main work includes the following aspects: business document number and execution environment. Implementation of business-based log search and designated system problem checking; Optimize cache management for search search results; Make the corresponding strategy to the business, the strategy consists of a number of rules, presented as a tree structure, and managed; With the help of the strategy tree, the behavior pattern of problem checking is formed, and the corresponding strategy is automatically matched according to the user input condition. Time summary of environmental monitoring records; It is a lightweight web system that automatically accesses the server cluster and gets the data. The rule of each node in the policy tree contains two kinds of attributes: judgment and action. It indicates whether the rule is executed or not. The process of log analysis is the process of executing the action from the root node in the policy tree. At present, all the functions of the intelligent analysis system have been realized and tested repeatedly. The system can run normally, the interface is friendly, and the user can use all the functions of the system simply and quickly. The practice shows that the design and implementation of the system is true and reliable.
【学位授予单位】：华中科技大学
【学位级别】：硕士
【学位授予年份】：2016
【分类号】：TP311.52

【参考文献】