基于网页采集的校园新闻移动网站设计与实现
发布时间：2019-05-10 09:03
【摘要】：随着互联网技术和计算机技术的发展，特别是第三代移动通信技术的应用和推广，人们的阅读习惯也发生了改变，大家迫切地希望能在任何时间地点场合通过无线网络使用移动设备方便地浏览web获取信息。校园中更是如此，拥有大量移动设备使用人群的学校里，这种无线上网的需要更是迫切。而移动设备有着很多PC机等完全不同的特点，使得原来的HTML网页无法在移动设备上良好地运作，这给移动网站的开发带来了机遇。 基于以上问题，本文从分析校园网站移动现状开始，提出了基于新闻采集的校园新闻网站移动化的解决方案。本文主要研究和解决两个问题，一个是如何从现有学校新闻网站提取信息，存储到数据库中，另外一个则是如何把这些信息方便有效的展现在用户的移动设备上。 本系统采用基于规则的方式来实现采集，通过http协议获得网页信息，然后通过DOM树利用系统和用户定制好的规则萃取页面的有效信息到服务器并储存在数据库。另外编写一个数据处理的模块处理采集回来的数据，该模块统一了访问控制，并通过json和web页面两种形式传给客户端原生应用程序及手机浏览器，其中web页面会根据客户端的不同而使用不同的页面模板。这两种形式可以满足不同客户对系统的不同要求。目前该系统已经作为移动校园的其中一部分应用到广东第二师范学院的移动应用中。 本系统的主要特色在于：其一，使用采集方式获取旧网站系统数据，不同于其他的移动网站直接在旧系统上进行改造的开发方式，能更够快速广泛的与旧系统结合；其二，同时提供web app页面和原生应用系统使用的接口，，更广泛的支持各种设备，也能够最大限度的满足部分客户对性能的要求；其三，系统采用中间件的形式，能够和旧系统分开部署，能够使得服务器部署更加灵活。
[Abstract]:With the development of Internet technology and computer technology, especially the application and promotion of the third generation mobile communication technology, people's reading habits have also changed. People are eager to browse web to get information conveniently through wireless network at any time and place. This is especially true on campus, where there is a large number of mobile device users, the need for this kind of wireless Internet access is even more urgent. However, mobile devices have many completely different characteristics, such as PCs, which makes the original HTML page can not work well on mobile devices, which brings opportunities to the development of mobile websites. Based on the above problems, this paper starts with the analysis of the current situation of campus website mobility, and puts forward a solution of campus news website mobility based on news collection. This paper mainly studies and solves two problems, one is how to extract information from the existing school news website and store it in the database, the other is how to display this information on the user's mobile device conveniently and effectively. The system adopts the rule-based method to realize the collection, obtains the web page information through the http protocol, and then uses the system and the user-customized rules to extract the effective information of the page to the server and store it in the database through the DOM tree. In addition, a data processing module is written to process the collected data. The module unifies the access control and transmits it to the client native application and mobile browser through json and web pages. Web pages use different page templates depending on the client. These two forms can meet the different requirements of different customers for the system. At present, the system has been applied to the mobile application of Guangdong second normal University as part of the mobile campus. The main characteristics of this system are as follows: first, the use of collection to obtain the data of the old website system, different from other mobile websites directly in the old system of the development of the way, can be more rapid and extensive combination with the old system; Second, at the same time, it provides the interface used by web app page and native application system, which supports a variety of devices more widely, and can also meet the performance requirements of some customers to the maximum extent. Third, the system adopts the form of middleware, which can be deployed separately from the old system, which can make the server deployment more flexible.
【学位授予单位】：华南理工大学
【学位级别】：硕士
【学位授予年份】：2014
【分类号】：TP393.092
本文编号：2473526
[Abstract]:With the development of Internet technology and computer technology, especially the application and promotion of the third generation mobile communication technology, people's reading habits have also changed. People are eager to browse web to get information conveniently through wireless network at any time and place. This is especially true on campus, where there is a large number of mobile device users, the need for this kind of wireless Internet access is even more urgent. However, mobile devices have many completely different characteristics, such as PCs, which makes the original HTML page can not work well on mobile devices, which brings opportunities to the development of mobile websites. Based on the above problems, this paper starts with the analysis of the current situation of campus website mobility, and puts forward a solution of campus news website mobility based on news collection. This paper mainly studies and solves two problems, one is how to extract information from the existing school news website and store it in the database, the other is how to display this information on the user's mobile device conveniently and effectively. The system adopts the rule-based method to realize the collection, obtains the web page information through the http protocol, and then uses the system and the user-customized rules to extract the effective information of the page to the server and store it in the database through the DOM tree. In addition, a data processing module is written to process the collected data. The module unifies the access control and transmits it to the client native application and mobile browser through json and web pages. Web pages use different page templates depending on the client. These two forms can meet the different requirements of different customers for the system. At present, the system has been applied to the mobile application of Guangdong second normal University as part of the mobile campus. The main characteristics of this system are as follows: first, the use of collection to obtain the data of the old website system, different from other mobile websites directly in the old system of the development of the way, can be more rapid and extensive combination with the old system; Second, at the same time, it provides the interface used by web app page and native application system, which supports a variety of devices more widely, and can also meet the performance requirements of some customers to the maximum extent. Third, the system adopts the form of middleware, which can be deployed separately from the old system, which can make the server deployment more flexible.
【学位授予单位】：华南理工大学
【学位级别】：硕士
【学位授予年份】：2014
【分类号】：TP393.092
【参考文献】
相关期刊论文 前6条
1 张逸;贾金玺;;新闻网站的移动化之路[J];重庆工商大学学报(社会科学版);2013年02期
2 谭翔纬;;利用JSON实现Android客户端与Web服务器间的数据交互[J];福建电脑;2013年02期
3 付亮;于立娟;陈幽君;秦雯;;2012-2013年移动互联网发展趋势综述[J];互联网天地;2013年02期
4 刘文;甘志春;李文;王更辉;;基于XML和JSON的格式化网络参数文件研究[J];计算机与网络;2013年24期
5 王左利;;校园移动平台:未来的主角[J];中国教育网络;2012年11期
6 ;移动校园 下一个竞技场[J];中国教育网络;2012年11期
本文编号：2473526
本文链接：https://www.wllwen.com/guanlilunwen/ydhl/2473526.html
