【摘要】： 隨著互聯(lián)網(wǎng)應(yīng)用技術(shù)發(fā)展,網(wǎng)絡(luò)廣告內(nèi)容交易平臺(tái)成為新的互聯(lián)應(yīng)用盈利模式,此類(lèi)網(wǎng)站往往要同時(shí)承擔(dān)大量用戶(hù)的的web請(qǐng)求。如何建設(shè)快速、大并發(fā)量,可持續(xù)擴(kuò)展的web應(yīng)用架構(gòu)成為該類(lèi)應(yīng)用的關(guān)鍵。如何利用現(xiàn)有的軟件資源進(jìn)行快速的應(yīng)用整合是網(wǎng)站成功的基礎(chǔ)。 本文針對(duì)大規(guī)模互聯(lián)網(wǎng)廣告經(jīng)營(yíng)管理需求設(shè)計(jì)了基于Linux操作系統(tǒng)平臺(tái)的分布式、大容量、可擴(kuò)展的互聯(lián)網(wǎng)廣告經(jīng)營(yíng)管理系統(tǒng)。實(shí)現(xiàn)了互聯(lián)網(wǎng)廣告的發(fā)布,廣告播放時(shí)段交易,以及廣告播放統(tǒng)計(jì)三個(gè)主要的功能,為廣告主、廣告商,網(wǎng)站管理者提供一個(gè)易用、安全、快速的廣告交易平臺(tái),并且使得廣告內(nèi)容受眾能夠快速無(wú)障礙的瀏覽到廣告內(nèi)容。 本系統(tǒng)采用Browser/Server結(jié)構(gòu)開(kāi)發(fā),使用Python語(yǔ)言作為基礎(chǔ)程序設(shè)計(jì)語(yǔ)言,根據(jù)MVC(Model-View-Controller,模型-視圖-控制器)軟件開(kāi)發(fā)架構(gòu),結(jié)合開(kāi)放源代碼的公共組件memcached、memcacheQ、Twisted,實(shí)現(xiàn)了系統(tǒng)的分布式用戶(hù)請(qǐng)求處理,并且保證了系統(tǒng)的高可用性以及系統(tǒng)的可擴(kuò)展能力。 本文對(duì)持久性hash算法(Consistent Hashing)進(jìn)行了介紹和研究,該算法能夠較好地解決在分布式緩存節(jié)點(diǎn)數(shù)變化后大量緩存內(nèi)容需要重新分配存儲(chǔ)節(jié)點(diǎn),造成緩存命中率下降的問(wèn)題。同時(shí)由于Twisted網(wǎng)絡(luò)框架中沒(méi)有實(shí)現(xiàn)可用的針對(duì)memcache服務(wù)的分布式算法及其相關(guān)協(xié)議,所以本系統(tǒng)根據(jù)memcache服務(wù)的通信協(xié)議完成了一個(gè)非阻塞的異步分布式memcache服務(wù)客戶(hù)端模塊,該擴(kuò)展模塊能夠良好地處理大量的緩存內(nèi)容在不同memcache服務(wù)中的分布式存儲(chǔ)。本文對(duì)基于事件的Twisted網(wǎng)絡(luò)框架的事件回調(diào)機(jī)制和事件延遲機(jī)制進(jìn)行了介紹。分析和研究了針對(duì)大容量、多連接、高并發(fā)的網(wǎng)絡(luò)應(yīng)用服務(wù)系統(tǒng)應(yīng)采用何種底層網(wǎng)絡(luò)IO結(jié)構(gòu)。對(duì)常用的基于CGI協(xié)議的WEB應(yīng)用開(kāi)發(fā)方法和基于HTTP服務(wù)器的WEB應(yīng)用開(kāi)發(fā)所能夠承受的用戶(hù)并發(fā)數(shù)進(jìn)行了對(duì)比測(cè)試。同時(shí)研究了針對(duì)大資料量的先進(jìn)先出(First-In/First-Out)消息隊(duì)列系統(tǒng)的分布式處理方法,利用該方法實(shí)現(xiàn)了一個(gè)用戶(hù)可接受數(shù)據(jù)延遲的網(wǎng)絡(luò)廣告播放統(tǒng)計(jì)分析子系統(tǒng)。 本系統(tǒng)無(wú)論從操作系統(tǒng)、程序設(shè)計(jì)語(yǔ)言、還是各個(gè)應(yīng)用服務(wù)組件都使用了開(kāi)放源代碼的產(chǎn)品或組件,充分的利用開(kāi)放源代碼產(chǎn)品和組件不但能夠減少企業(yè)運(yùn)營(yíng)的成本、而且可以獲得良好的小區(qū)技術(shù)支持。開(kāi)放源代碼的產(chǎn)品和組件人人可以任意取得自由軟件的原始碼,所以軟件的很多功能可以相互引用,不用再浪費(fèi)無(wú)謂的時(shí)間精力重新開(kāi)發(fā),這可以大大加強(qiáng)軟件開(kāi)發(fā)的質(zhì)量和速度。
[Abstract]:With the development of Internet application technology, the Internet advertising content trading platform has become a new profit model for Internet applications. This kind of websites often undertake web requests from a large number of users at the same time. How to build a fast, large concurrency, sustainable and scalable web application architecture is the key to this kind of application. How to use the existing software resources for rapid application integration is the basis of website success. In this paper, a distributed, large-capacity and expandable Internet advertising management system based on Linux operating system platform is designed to meet the needs of large-scale Internet advertising management. It realizes the three main functions of Internet advertisement release, advertisement broadcast time trading, and advertisement broadcast statistics. It provides an easy-to-use, safe and fast advertising trading platform for advertisers, advertisers and site managers. And make advertising content audience can quickly and barrier-free browsing to advertising content. This system adopts Browser/Server structure development, uses Python language as the basic programming language, according to the MVC (Model-View-Controller, Model-View-Controller) software development architecture, combines the open source common component memcached,memcacheQ,Twisted,. The distributed user request processing of the system is realized, and the high availability of the system and the extensibility of the system are guaranteed. In this paper, the persistent hash algorithm (Consistent Hashing) is introduced and studied. The algorithm can solve the problem that a large number of cache contents need to be reallocated after the number of distributed cache nodes changes, which results in the decrease of cache hit ratio. At the same time, the Twisted network framework does not implement the available distributed algorithm for memcache services and its related protocols, so this system completes a non-blocking asynchronous distributed memcache service client module according to the memcache service communication protocol. The extension module can well handle the distributed storage of a large number of cached content in different memcache services. The event callback mechanism and event delay mechanism of event-based Twisted network framework are introduced in this paper. In this paper, the underlying network IO architecture for large capacity, multi-connection and high concurrent network application service system is analyzed and studied. This paper compares and tests the common WEB application development method based on CGI protocol and the number of user concurrency that WEB application development based on HTTP server can bear. At the same time, the distributed processing method of First-In/First-Out message queue system for large data volume is studied. By using this method, a user-acceptable data delay statistical analysis subsystem for network advertisement playback is implemented. This system not only uses open source products or components from operating system, programming language, or application service components, but also can reduce the cost of enterprise operation by making full use of open source products and components. And can obtain good community technical support. Open source products and components are available to anyone who has access to the source code of free software, so many features of the software can be referenced with each other without wasting unnecessary time and effort to re-develop, This can greatly enhance the quality and speed of software development.
【學(xué)位授予單位】：上海交通大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2010
【分類(lèi)號(hào)】：TP311.52

【引證文獻(xiàn)】

相關(guān)碩士學(xué)位論文 前1條

1 陳玉云;網(wǎng)絡(luò)廣告效果分析系統(tǒng)的設(shè)計(jì)及實(shí)現(xiàn)[D];上海交通大學(xué);2012年

，

本文編號(hào)：2455053