新闻聚合平台的设计与实现
发布时间：2018-09-01 07:00
【摘要】：随着互联网的迅猛发展和广泛普及,全媒体线索新闻与素材展现出了信息海量、格式多样、处理时效性和准确性要求高的特点,单纯由人工采集、分析和处理的难度极大,导致工作效率低下,无法满足全媒体新闻生产的需求。新闻聚合平台采用了数据爬取、自然语言处理、搜索引擎、概率统计和机器学习等相关领域的技术,利用这些技术可以实现新闻采集和统计分析的自动化以及检索的快速化,为媒体从业人员提供线索新闻与素材,提高查找、过滤、分析的效率。新闻聚合平台为媒体从业人员提供服务。本文从开发新闻聚合平台出发,以新闻检索、新闻详情和定时任务调度三个模块作为切入点展开深入的分析与设计。新闻检索是平台的基础业务模块,满足用户对线索新闻、热点新闻、事件新闻和网络新闻的检索。新闻详情模块是平台的核心业务模块,在新闻原始信息的基础上,提供基于新闻内容的摘要、实体词、关键词、情感正负面、评论区域、评论量以及媒体报道量的统计分析结果,并依据新闻类别分为线索新闻详情、热点新闻详情、事件详情和历史上今天新闻详情。定时任务调度是软件的关键技术模块,基于Quartz Scheduler框架,实现新闻统计分析任务的自动化。本人参与了开发新闻聚合平台的需求分析和设计与实现阶段。在需求分析阶段,本人独立完成了所负责开发模块的业务分析工作、产品原型设计和前端页面的交互设计工作。在设计与实现阶段,本人参与完成了新闻检索模块中线索新闻检索子模块、热点新闻检索子模块、事件检索子模块和网络新闻检索子模块的设计与实现;独立完成了新闻详情模块中的线索新闻详情子模块、热点新闻详情子模块和事件详情子模块的设计与实现;独立完成了定时任务调度模块中线索新闻定时任务子模块、热点新闻定时任务子模块和事件新闻定时任务子模块的设计与实现,并参与完成了数据库表结构的设计与实现。目前,该新闻聚合平台处于用户试用阶段,部署于国内某企业云的新闻聚合平台运行良好;本人负责完成的模块运行稳定、达到了预期的目标。
[Abstract]:With the rapid development and widespread popularity of the Internet, all-media clue news and materials show the characteristics of mass information, diverse formats, high processing timeliness and accuracy requirements. It is very difficult to collect, analyze and process only by hand, resulting in inefficient work and can not meet the needs of all-media news production. The technology of data crawling, natural language processing, search engine, probability statistics and machine learning are used to realize the automation of news gathering and statistical analysis and the speediness of retrieval. The technology can provide clue news and material for media practitioners, improve the efficiency of search, filtering and analysis. The platform provides services for media practitioners. Starting from the development of news aggregation platform, this paper makes an in-depth analysis and design of three modules: news retrieval, news details and timed task scheduling. The news details module is the core business module of the platform. Based on the original news information, it provides statistical analysis results of news content summary, entity words, keywords, positive and negative emotions, comment area, comment volume and media coverage. According to the news category, it can be divided into clue news details, hot news details and events. Timing task scheduling is the key technology module of the software. Based on Quartz Scheduler framework, this paper realizes the automation of news statistical analysis task. I participated in the requirement analysis and design and implementation stage of developing news aggregation platform. In the requirement analysis stage, I completed the development model independently. In the design and implementation stage, I participated in the design and implementation of the news retrieval module, including the clue news retrieval sub-module, hot news retrieval sub-module, event retrieval sub-module and network news retrieval sub-module. The design and implementation of the cue news detail module, the hot news detail module and the event detail sub-module in the situation module; independently completed the design and implementation of the cue news timer task sub-module, the hot news timer task sub-module and the event news timer task sub-module in the timer task scheduling module, and participated in the completion of the number At present, the news aggregation platform is in the user trial stage, and the news aggregation platform deployed in the cloud of a domestic enterprise runs well; the module I am responsible for completing runs stably and achieves the desired goal.
【学位授予单位】：北京交通大学
【学位级别】：硕士
【学位授予年份】：2017
【分类号】：TP311.52
本文编号：2216460
[Abstract]:With the rapid development and widespread popularity of the Internet, all-media clue news and materials show the characteristics of mass information, diverse formats, high processing timeliness and accuracy requirements. It is very difficult to collect, analyze and process only by hand, resulting in inefficient work and can not meet the needs of all-media news production. The technology of data crawling, natural language processing, search engine, probability statistics and machine learning are used to realize the automation of news gathering and statistical analysis and the speediness of retrieval. The technology can provide clue news and material for media practitioners, improve the efficiency of search, filtering and analysis. The platform provides services for media practitioners. Starting from the development of news aggregation platform, this paper makes an in-depth analysis and design of three modules: news retrieval, news details and timed task scheduling. The news details module is the core business module of the platform. Based on the original news information, it provides statistical analysis results of news content summary, entity words, keywords, positive and negative emotions, comment area, comment volume and media coverage. According to the news category, it can be divided into clue news details, hot news details and events. Timing task scheduling is the key technology module of the software. Based on Quartz Scheduler framework, this paper realizes the automation of news statistical analysis task. I participated in the requirement analysis and design and implementation stage of developing news aggregation platform. In the requirement analysis stage, I completed the development model independently. In the design and implementation stage, I participated in the design and implementation of the news retrieval module, including the clue news retrieval sub-module, hot news retrieval sub-module, event retrieval sub-module and network news retrieval sub-module. The design and implementation of the cue news detail module, the hot news detail module and the event detail sub-module in the situation module; independently completed the design and implementation of the cue news timer task sub-module, the hot news timer task sub-module and the event news timer task sub-module in the timer task scheduling module, and participated in the completion of the number At present, the news aggregation platform is in the user trial stage, and the news aggregation platform deployed in the cloud of a domestic enterprise runs well; the module I am responsible for completing runs stably and achieves the desired goal.
【学位授予单位】：北京交通大学
【学位级别】：硕士
【学位授予年份】：2017
【分类号】：TP311.52
【参考文献】
相关期刊论文 前10条
1 柳原;马宁;;基于Web的Java应用性能监测系统设计与实现[J];电脑编程技巧与维护;2016年20期
2 杨小伟;;静态网页制作技术与动态网页制作技术的比较[J];中国新通信;2016年19期
3 郭嘉;刘璐宇;;以用户生成内容为主导的网络电台发展研究——以荔枝FM为例[J];当代电视;2016年09期
4 胡翼青;余晓敏;;社交媒体如何盈利:对BuzzFeed的个案研究[J];编辑之友;2016年07期
5 王秀;孙忠林;姜莉;;任务定时调度在企业级开发中的研究[J];电子科技;2015年10期
6 许姗姗;;基于Spring的事务处理机制的应用与研究[J];信息通信;2015年10期
7 佟玲;周传生;;基于XML的任务流编辑器的设计与实现[J];沈阳师范大学学报(自然科学版);2015年04期
8 李岩;;基于受众需求谈广播电视新闻编辑的创新[J];西部广播电视;2015年19期
9 夏文忠;邹雯奇;;基于X86平台的高性能数据库集群技术的研究[J];微型机与应用;2015年01期
10 陆璐;;从“今日头条”的成功突围看新闻App的生存法则[J];江苏科技信息;2014年08期
相关硕士学位论文 前6条
1 曹晓凤;公民新闻视野下消息类电视节目的发展研究[D];四川师范大学;2015年
2 蔡骋;基于集群的多任务调度处理方案研究[D];云南大学;2015年
3 李单云;铁路智能运输系统的系统集成研究与实现[D];西南交通大学;2015年
4 田生;开发测试云平台的设计与实现[D];北京交通大学;2014年
5 王宇明;成都高校学生采纳手机新闻客户端的关键影响因素研究[D];电子科技大学;2014年
6 张虹;企业项目需求管控系统的设计与实现[D];北京交通大学;2013年
，本文编号：2216460
本文链接：https://www.wllwen.com/kejilunwen/ruanjiangongchenglunwen/2216460.html
