移动终端网页转换系统的设计与实现

发布时间：2018-05-10 16:20

本文选题：Dom树 + Htmlparser　；参考：《大连理工大学》2012年硕士论文

【摘要】：随着新兴移动终端的飞速发展,其优秀的操控体验并携带多种传感器,使人们随时随地的获取更多的信息。随之移动互联网成为人们生活中不可或缺的一部分,人们的工作、学习、生活、娱乐都将依赖着移动互联网,人们开始更多的在终端设备上获取信息。但是部分中低端手机不能浏览Html页面,即使可以浏览也因为WEB页面是为PC设计的,因此在移动终端上浏览体验极差、页面较大,用户访问流量、时间、带宽成本较大。因此如何将Html页面转换成适合在移动终端上浏览的页面,为众多的移动终端应用或移动搜索引擎提供低成本、快速、有良好浏览体验的网页信息浏览能力有着极其重要意义,是支持移动互联网和传统互联网信息融合的关键。本文针对上述问题提出了一种服务器端网页转换系统。系统将Html页面转换为XHtml页面,打破了部分手机不能浏览Html页面的技术性限制。更重要的是系统将对网页内容进行解析、识别,过滤不需要的内容,重新对网页进行排版、适配和分页,对图片进行压缩处理,最后拼接整个页面返回给用户,该网页的版式、内容、布局和展现效果更适合移动终端。文中详细阐述了系统的总体方案、详细设计和实现,为了配合网页转换的实时和高效,系统主要设计了前端模块、缓存模块、抓取模块和转换模块,前端模块负责解析用户请求和各个模块的网络交互。在收到用户请求后将对页面进行实时抓取,然后交给后端进行网页转换以实现实时转换的功能。系统中加入了缓存模块,使重复请求有快速响应处理,并且系统采用异步框架实现,提高系统的处理性能。在实现系统后进行测试,结果表明满足上述设计要求,并进行大量的手工转换测试,85%以上的页面展现效果良好,版式合理,页面压缩率高达76%,平均一次请求处理时间在500ms以内,缓存命中率23.85%,经每秒100个请求的压力测试,系统资源占用合理、程序稳定,符合设计需求,给用户带来低成本、快速卓越的浏览体验,使人们更便捷地随时随地获取信息找到所求。
[Abstract]:With the rapid development of new mobile terminals, its excellent control experience and carry a variety of sensors, so that people can get more information anytime and anywhere. With this, mobile Internet becomes an indispensable part of people's life, people's work, study, life, entertainment will depend on mobile Internet, people begin to get more information on terminal devices. However, some low-end mobile phones can not browse Html pages, even if they can browse, because WEB pages are designed for PC, so the browsing experience on mobile terminals is extremely poor, the pages are large, user access traffic, time, bandwidth cost is high. Therefore, how to convert Html pages into pages suitable for browsing on mobile terminals is of great significance in providing low-cost, fast and good browsing experience for many mobile terminal applications or mobile search engines. Is the support mobile Internet and the traditional Internet information fusion key. In this paper, a server-side web page conversion system is proposed to solve the above problems. The system transforms Html page into XHtml page, breaking the technical restriction that some mobile phone can't browse Html page. What is more important is that the system will parse, identify, filter the unwanted content of the web page, rearrange, adapt and paginate the page, compress the picture, and finally splice the whole page back to the user, the layout of the page. Content, layout and presentation effects are more suitable for mobile terminals. In this paper, the overall scheme, design and implementation of the system are described in detail. In order to cooperate with the real time and high efficiency of web page conversion, the system mainly designs front-end module, cache module, grab module and conversion module. The front-end module is responsible for parsing the user request and the network interaction of each module. After receiving the user's request, the page will be fetched in real time, and then transferred to the back end to realize the function of real-time conversion. The cache module is added to the system to make the repeated requests respond quickly and the asynchronous framework is adopted to improve the processing performance of the system. After the implementation of the system, the test results show that the above design requirements are satisfied, and a large number of manual conversion tests are carried out with 85% of the pages showing good results, reasonable layout, the compression ratio of the page is as high as 76%, and the average processing time of one request is less than 500ms. Cache hit rate 23.85, after 100 requests per second of the stress test, the system resources use is reasonable, the program is stable, meet the design needs, bring users low-cost, rapid and excellent browsing experience, Make it easier for people to get information at any time and anywhere to find out what they want.
【学位授予单位】：大连理工大学
【学位级别】：硕士
【学位授予年份】：2012
【分类号】：TN929.53;TP393.092

【引证文献】