基于微博的公安舆情监控系统研究与实现
发布时间：2018-09-10 08:55
【摘要】：微博舆情已成为网络舆情中最具影响力的传播途径，逐渐成为汇聚民意的重要途径。公安部门担负着维护国家网络安全的重责，对微博网络舆情的监控势在必行。本文在这一背景下，提出了基于微博的公安舆情监控系统的概念。在研究微博网络舆情核心技术的基础上，结合公安机关对微博网络舆情监控系统的业务需求，分析了面向公安部门的微博舆情监控系统的主要功能需求（微博采集功能、微博检索功能、微博舆情分析功能和微博舆情展示功能）、系统设计目标以及用户特点。随后对系统的架构包括系统组成、技术架构以及系统构成进行了设计，对系统各功能模块进行实现。并对本系统进行了功能和性能测试，保证本系统在设计与实现上，满足了公安部门对于微博舆情监控的设计需求。 在技术实现上，结合微博的特点以及公安部门的业务需求，，提出了将开源网络爬虫Nutch应用到基于微博的公安舆情监控系统中，并对Nutch进行了二次开发，增加虚拟登录的功能使其实现对微博平台的信息爬取。并通过修改Nutch源码改进了其网络爬取时等待时间僵化的缺点,提高了系统爬取效率。在系统中文分词部分使用中科院研发的ICTCLAS4J中文分词技术,有效的保证了系统对微博信息分词功能的可靠性。并将ICTCLAS4J集成到Nutch中，给出了集成方法。挺高了系统对微博信息采集分析的可靠性和准确性。
[Abstract]:Weibo's public opinion has become the most influential way in the network public opinion, and has gradually become the important way to converge public opinion. The public security department bears the heavy responsibility of maintaining the national network security, so it is imperative to monitor Weibo's network public opinion. Under this background, this paper puts forward the concept of public opinion monitoring system based on Weibo. On the basis of studying Weibo's core technology of network public opinion, combined with the business demand of public security organ to the network public opinion monitoring system of Weibo, this paper analyzes the main functional requirements of the public opinion monitoring system for the public security department. Weibo search function, Weibo public opinion analysis function and Weibo public opinion display function), system design goal and user characteristics. Then, the system structure including system composition, technical architecture and system structure are designed, and each functional module of the system is implemented. The function and performance of the system are tested to ensure that the design and implementation of the system meets the design requirements of the public opinion monitoring system of Weibo by the public security department. In terms of technical realization, combined with the characteristics of Weibo and the business requirements of public security departments, this paper puts forward the application of open source network crawler Nutch to the public opinion monitoring system based on Weibo, and develops the Nutch for the second time. Add virtual login to enable it to achieve the information crawling Weibo platform. And by modifying the Nutch source code to improve its network crawling while waiting for the shortcomings of the rigid time to improve the efficiency of the system crawling. In the part of Chinese word segmentation of the system, the ICTCLAS4J Chinese word segmentation technology developed by the Chinese Academy of Sciences is used, which effectively ensures the reliability of the system to Weibo's function of word segmentation. ICTCLAS4J is integrated into Nutch, and the integration method is given. Quite high system for Weibo information collection and analysis of the reliability and accuracy.
【学位授予单位】：吉林大学
【学位级别】：硕士
【学位授予年份】：2014
【分类号】：TP311.52;TP393.092
本文编号：2233973
[Abstract]:Weibo's public opinion has become the most influential way in the network public opinion, and has gradually become the important way to converge public opinion. The public security department bears the heavy responsibility of maintaining the national network security, so it is imperative to monitor Weibo's network public opinion. Under this background, this paper puts forward the concept of public opinion monitoring system based on Weibo. On the basis of studying Weibo's core technology of network public opinion, combined with the business demand of public security organ to the network public opinion monitoring system of Weibo, this paper analyzes the main functional requirements of the public opinion monitoring system for the public security department. Weibo search function, Weibo public opinion analysis function and Weibo public opinion display function), system design goal and user characteristics. Then, the system structure including system composition, technical architecture and system structure are designed, and each functional module of the system is implemented. The function and performance of the system are tested to ensure that the design and implementation of the system meets the design requirements of the public opinion monitoring system of Weibo by the public security department. In terms of technical realization, combined with the characteristics of Weibo and the business requirements of public security departments, this paper puts forward the application of open source network crawler Nutch to the public opinion monitoring system based on Weibo, and develops the Nutch for the second time. Add virtual login to enable it to achieve the information crawling Weibo platform. And by modifying the Nutch source code to improve its network crawling while waiting for the shortcomings of the rigid time to improve the efficiency of the system crawling. In the part of Chinese word segmentation of the system, the ICTCLAS4J Chinese word segmentation technology developed by the Chinese Academy of Sciences is used, which effectively ensures the reliability of the system to Weibo's function of word segmentation. ICTCLAS4J is integrated into Nutch, and the integration method is given. Quite high system for Weibo information collection and analysis of the reliability and accuracy.
【学位授予单位】：吉林大学
【学位级别】：硕士
【学位授予年份】：2014
【分类号】：TP311.52;TP393.092
【参考文献】
相关期刊论文 前3条
1 王娟;;网络舆情监控分析系统构建[J];长春理工大学学报(高教版);2007年04期
2 刘尚喜;蔡开裕;卓琳;;内网舆情信息监测系统研究与设计[J];电脑应用技术;2009年01期
3 张启宇;朱玲;张雅萍;;中文分词算法研究综述[J];情报探索;2008年11期
本文编号：2233973
本文链接：https://www.wllwen.com/guanlilunwen/ydhl/2233973.html
