互联网广告经营管理系统的设计与实现
发布时间:2019-04-09 09:28
【摘要】: 随着互联网应用技术发展,网络广告内容交易平台成为新的互联应用盈利模式,此类网站往往要同时承担大量用户的的web请求。如何建设快速、大并发量,可持续扩展的web应用架构成为该类应用的关键。如何利用现有的软件资源进行快速的应用整合是网站成功的基础。 本文针对大规模互联网广告经营管理需求设计了基于Linux操作系统平台的分布式、大容量、可扩展的互联网广告经营管理系统。实现了互联网广告的发布,广告播放时段交易,以及广告播放统计三个主要的功能,为广告主、广告商,网站管理者提供一个易用、安全、快速的广告交易平台,并且使得广告内容受众能够快速无障碍的浏览到广告内容。 本系统采用Browser/Server结构开发,使用Python语言作为基础程序设计语言,根据MVC(Model-View-Controller,模型-视图-控制器)软件开发架构,结合开放源代码的公共组件memcached、memcacheQ、Twisted,实现了系统的分布式用户请求处理,并且保证了系统的高可用性以及系统的可扩展能力。 本文对持久性hash算法(Consistent Hashing)进行了介绍和研究,该算法能够较好地解决在分布式缓存节点数变化后大量缓存内容需要重新分配存储节点,造成缓存命中率下降的问题。同时由于Twisted网络框架中没有实现可用的针对memcache服务的分布式算法及其相关协议,所以本系统根据memcache服务的通信协议完成了一个非阻塞的异步分布式memcache服务客户端模块,该扩展模块能够良好地处理大量的缓存内容在不同memcache服务中的分布式存储。本文对基于事件的Twisted网络框架的事件回调机制和事件延迟机制进行了介绍。分析和研究了针对大容量、多连接、高并发的网络应用服务系统应采用何种底层网络IO结构。对常用的基于CGI协议的WEB应用开发方法和基于HTTP服务器的WEB应用开发所能够承受的用户并发数进行了对比测试。同时研究了针对大资料量的先进先出(First-In/First-Out)消息队列系统的分布式处理方法,利用该方法实现了一个用户可接受数据延迟的网络广告播放统计分析子系统。 本系统无论从操作系统、程序设计语言、还是各个应用服务组件都使用了开放源代码的产品或组件,充分的利用开放源代码产品和组件不但能够减少企业运营的成本、而且可以获得良好的小区技术支持。开放源代码的产品和组件人人可以任意取得自由软件的原始码,所以软件的很多功能可以相互引用,不用再浪费无谓的时间精力重新开发,这可以大大加强软件开发的质量和速度。
[Abstract]:With the development of Internet application technology, the Internet advertising content trading platform has become a new profit model for Internet applications. This kind of websites often undertake web requests from a large number of users at the same time. How to build a fast, large concurrency, sustainable and scalable web application architecture is the key to this kind of application. How to use the existing software resources for rapid application integration is the basis of website success. In this paper, a distributed, large-capacity and expandable Internet advertising management system based on Linux operating system platform is designed to meet the needs of large-scale Internet advertising management. It realizes the three main functions of Internet advertisement release, advertisement broadcast time trading, and advertisement broadcast statistics. It provides an easy-to-use, safe and fast advertising trading platform for advertisers, advertisers and site managers. And make advertising content audience can quickly and barrier-free browsing to advertising content. This system adopts Browser/Server structure development, uses Python language as the basic programming language, according to the MVC (Model-View-Controller, Model-View-Controller) software development architecture, combines the open source common component memcached,memcacheQ,Twisted,. The distributed user request processing of the system is realized, and the high availability of the system and the extensibility of the system are guaranteed. In this paper, the persistent hash algorithm (Consistent Hashing) is introduced and studied. The algorithm can solve the problem that a large number of cache contents need to be reallocated after the number of distributed cache nodes changes, which results in the decrease of cache hit ratio. At the same time, the Twisted network framework does not implement the available distributed algorithm for memcache services and its related protocols, so this system completes a non-blocking asynchronous distributed memcache service client module according to the memcache service communication protocol. The extension module can well handle the distributed storage of a large number of cached content in different memcache services. The event callback mechanism and event delay mechanism of event-based Twisted network framework are introduced in this paper. In this paper, the underlying network IO architecture for large capacity, multi-connection and high concurrent network application service system is analyzed and studied. This paper compares and tests the common WEB application development method based on CGI protocol and the number of user concurrency that WEB application development based on HTTP server can bear. At the same time, the distributed processing method of First-In/First-Out message queue system for large data volume is studied. By using this method, a user-acceptable data delay statistical analysis subsystem for network advertisement playback is implemented. This system not only uses open source products or components from operating system, programming language, or application service components, but also can reduce the cost of enterprise operation by making full use of open source products and components. And can obtain good community technical support. Open source products and components are available to anyone who has access to the source code of free software, so many features of the software can be referenced with each other without wasting unnecessary time and effort to re-develop, This can greatly enhance the quality and speed of software development.
【学位授予单位】:上海交通大学
【学位级别】:硕士
【学位授予年份】:2010
【分类号】:TP311.52
本文编号:2455053
[Abstract]:With the development of Internet application technology, the Internet advertising content trading platform has become a new profit model for Internet applications. This kind of websites often undertake web requests from a large number of users at the same time. How to build a fast, large concurrency, sustainable and scalable web application architecture is the key to this kind of application. How to use the existing software resources for rapid application integration is the basis of website success. In this paper, a distributed, large-capacity and expandable Internet advertising management system based on Linux operating system platform is designed to meet the needs of large-scale Internet advertising management. It realizes the three main functions of Internet advertisement release, advertisement broadcast time trading, and advertisement broadcast statistics. It provides an easy-to-use, safe and fast advertising trading platform for advertisers, advertisers and site managers. And make advertising content audience can quickly and barrier-free browsing to advertising content. This system adopts Browser/Server structure development, uses Python language as the basic programming language, according to the MVC (Model-View-Controller, Model-View-Controller) software development architecture, combines the open source common component memcached,memcacheQ,Twisted,. The distributed user request processing of the system is realized, and the high availability of the system and the extensibility of the system are guaranteed. In this paper, the persistent hash algorithm (Consistent Hashing) is introduced and studied. The algorithm can solve the problem that a large number of cache contents need to be reallocated after the number of distributed cache nodes changes, which results in the decrease of cache hit ratio. At the same time, the Twisted network framework does not implement the available distributed algorithm for memcache services and its related protocols, so this system completes a non-blocking asynchronous distributed memcache service client module according to the memcache service communication protocol. The extension module can well handle the distributed storage of a large number of cached content in different memcache services. The event callback mechanism and event delay mechanism of event-based Twisted network framework are introduced in this paper. In this paper, the underlying network IO architecture for large capacity, multi-connection and high concurrent network application service system is analyzed and studied. This paper compares and tests the common WEB application development method based on CGI protocol and the number of user concurrency that WEB application development based on HTTP server can bear. At the same time, the distributed processing method of First-In/First-Out message queue system for large data volume is studied. By using this method, a user-acceptable data delay statistical analysis subsystem for network advertisement playback is implemented. This system not only uses open source products or components from operating system, programming language, or application service components, but also can reduce the cost of enterprise operation by making full use of open source products and components. And can obtain good community technical support. Open source products and components are available to anyone who has access to the source code of free software, so many features of the software can be referenced with each other without wasting unnecessary time and effort to re-develop, This can greatly enhance the quality and speed of software development.
【学位授予单位】:上海交通大学
【学位级别】:硕士
【学位授予年份】:2010
【分类号】:TP311.52
【引证文献】
相关硕士学位论文 前1条
1 陈玉云;网络广告效果分析系统的设计及实现[D];上海交通大学;2012年
,本文编号:2455053
本文链接:https://www.wllwen.com/wenyilunwen/guanggaoshejilunwen/2455053.html