基于网络爬虫的Web自动化测试工具的设计与实现

发布时间：2018-08-12 08:38

【摘要】：随着Internet的急速发展，大型Web应用已经成为传播信息的媒介、发布信息的平台。Web应用的规模大幅增加，新兴技术不断涌现，使得Web应用变得更庞大、更复杂。对于Web应用的要求不仅是功能上满足用户需求，在性能和安全方面也需要带来更完善的用户体验。为了确保Web应用的服务质量，必须对其进行严格有效的测试。Web应用因为分布、异构、跨平台等特性，使得对它的测试与传统软件的测试有很大的区别。网络爬虫是一个可以从Internet上自动提取网页的系统，它为搜索引擎从万维网上下载网页，是搜索引擎的重要组成部分。而本文的网络爬虫是为Web应用自动化测试工具URLMonitor（以下文中简称URLMonitor工具）服务的，为其提供被检测的URLs，充实URL库。本文首先总体介绍URLMonitor工具，随后对Web应用自动化测试、网络爬虫、SQL注入漏洞、Accessibility测试的相关概念及技术进行了详细的论述。接着对URLMonitor工具的详细设计以及实现细节进行了论述。最后对工具从功能、性能等方面进行了系统地测试。本文的研究内容主要包括：1.自动检测Web应用上的无效链接；2.根据链接失效原因和链接速度的统计结果快速定位链接无效的问题所在，，如CSS/JS/FORM中存在的错误；3.自动识别URL的变更，方便Web应用的回归性测试；4.检测网络爬虫得到的URL库中存在SQL注入攻击的URLs；5.利用由URL库建立的Web图进行链接分析及路径依赖分析；6.进行Web应用的Accessibility测试。此外，论文从爬行速率、正确率、覆盖率等方面对工具进行了测试，测试结果表明：该工具较好地实现了对Web应用的自动化测试，具有较好的可行性、可重用性和灵活性。
[Abstract]:With the rapid development of Internet, large Web applications have become the medium of information dissemination. The scale of the platform. Web applications for publishing information has increased significantly, and emerging technologies have been emerging, making Web applications become larger and more complex. The requirement for Web applications is not only to meet the needs of users functionally, but also to bring a more perfect user experience in terms of performance and security. In order to ensure the quality of service (QoS) of Web applications, it is necessary to test them strictly and effectively. Because of the characteristics of distribution, heterogeneity, cross-platform and so on, the testing of Web applications is very different from that of traditional software. Web crawler is a system that can automatically extract web pages from Internet. It downloads web pages from the World wide Web for search engines and is an important part of search engines. The web crawler in this paper serves the Web application automation testing tool URLMonitor (hereinafter referred to as URLMonitor tool) to provide the detected URLs and enrich the URL library. This paper first introduces the URLMonitor tools in general, and then discusses in detail the concepts and techniques of Web application automation testing, network crawler SQL injection vulnerability testing and accessibility testing. Then the detailed design and implementation of URLMonitor tools are discussed. Finally, the function and performance of the tool are systematically tested. The research content of this paper mainly includes: 1. Automatic detection of invalid links on Web applications. According to the statistical results of link failure and link speed, we can quickly locate the problem of link invalidation, such as the error in CSS/JS/FORM. Automatic identification of URL changes to facilitate Web application regression testing. Detect the presence of SQL injection attack URLs5 in the URL library obtained by the network crawler. The link analysis and path dependence analysis are carried out by using the Web diagram established by URL library. Carry out Accessibility test of Web application. In addition, the paper tests the tool from crawling rate, correct rate, coverage rate and so on. The test results show that the tool has good feasibility, reusability and flexibility.
【学位授予单位】：华南理工大学
【学位级别】：硕士
【学位授予年份】：2012
【分类号】：TP311.52

【相似文献】