本文選題：分布式系統(tǒng) + 可擴(kuò)展性��； 參考：《華中科技大學(xué)》2012年碩士論文

【摘要】：在當(dāng)今互聯(lián)網(wǎng)環(huán)境下，圖片已經(jīng)成為大多網(wǎng)站展示內(nèi)容的一種主要手段，用戶也常通過照片來(lái)分享自己的生活和心情。而隨著互聯(lián)網(wǎng)的高速發(fā)展，，傳統(tǒng)的圖片存儲(chǔ)服務(wù)正面臨著數(shù)據(jù)規(guī)模高速增長(zhǎng)和數(shù)據(jù)訪問高并發(fā)這兩方面的挑戰(zhàn)。這就需要圖片存儲(chǔ)系統(tǒng)具有良好的可擴(kuò)展性和高性能。此外，如今的互聯(lián)網(wǎng)應(yīng)用越來(lái)越多樣化，很難有一種通用的辦法適用于所有的系統(tǒng)，我們需要針對(duì)系統(tǒng)的應(yīng)用特征來(lái)設(shè)計(jì)相應(yīng)的解決方案。 以研究各大互聯(lián)網(wǎng)公司的圖片存儲(chǔ)系統(tǒng)為基礎(chǔ)，結(jié)合論文分享社會(huì)化網(wǎng)絡(luò)的應(yīng)用特點(diǎn)，提出一種日志型的基于哈希樹和鍵值對(duì)（key-value）接口的存儲(chǔ)模型，同時(shí)借鑒已有的解決系統(tǒng)可擴(kuò)展性和可靠性的分布式架構(gòu)設(shè)計(jì)理念，對(duì)傳統(tǒng)的圖片存儲(chǔ)系統(tǒng)進(jìn)行改進(jìn)。使用日志型的key-value模型，將圖片數(shù)據(jù)只增不減的寫入大文件中，減少了文件數(shù)量，簡(jiǎn)化了操作系統(tǒng)的管理，同時(shí)使用哈希樹結(jié)構(gòu)，組織圖片在大文件中的索引信息，實(shí)現(xiàn)圖片的快速讀取；采用分布式的架構(gòu)設(shè)計(jì)，實(shí)現(xiàn)系統(tǒng)的可擴(kuò)展性和可靠性；結(jié)合論文分享的特點(diǎn)，利用圖片之間的相關(guān)性，進(jìn)一步提高讀取性能；采用了epoll網(wǎng)絡(luò)模型和領(lǐng)導(dǎo)者-跟隨者（leader-follower）線程模型，有效地提升了系統(tǒng)處理高并發(fā)請(qǐng)求的能力。然后根據(jù)提出的解決方案實(shí)現(xiàn)了一個(gè)針對(duì)論文分享的圖片存儲(chǔ)系統(tǒng)，并詳細(xì)介紹了系統(tǒng)的架構(gòu)、核心模塊以及相應(yīng)實(shí)現(xiàn)。 最后對(duì)論文分享系統(tǒng)進(jìn)行了性能測(cè)試，分別對(duì)采用日志型的key-value模型、采用哈希樹組織索引信息、結(jié)合論文圖片相關(guān)性以及使用epoll和leader-follower模型等方案進(jìn)行了相應(yīng)的測(cè)試，并與沒有采用這些方案的系統(tǒng)進(jìn)行對(duì)比，測(cè)試結(jié)果表明新系統(tǒng)的性能有了很大提升，驗(yàn)證了設(shè)計(jì)的針對(duì)論文分享的圖片存儲(chǔ)系統(tǒng)具有良好的性能。
[Abstract]:In today ' s Internet environment , images have become a major means of presenting content in most websites , and users often share their lives and mood through photos . With the rapid development of the Internet , traditional image storage services are facing the challenges of high data size and high data access . This requires a picture storage system with good scalability and high performance . In addition , today ' s Internet applications are becoming more diverse , and it is difficult to have a general approach to all systems , and we need to design the corresponding solutions for the application features of the system .

This paper presents a kind of log - based storage model based on hash tree and key - value interface based on the research of the image storage system of each big internet company , and proposes a kind of log - based storage model based on hash tree and key - value interface .
the distributed architecture design is adopted to realize the expandability and the reliability of the system ;
According to the characteristics of the sharing of the paper , the correlation between the pictures is utilized to further improve the reading performance ;
The epoll network model and leader - follower thread model are adopted to effectively improve the ability of the system to process high concurrency requests . Then a picture storage system for the paper sharing is realized according to the proposed solution , and the architecture , core module and corresponding implementation of the system are introduced in detail .

Finally , the performance test of the paper - sharing system is carried out , the key - value model of the log type is adopted , the index information of the hash tree is adopted , the correlation of the paper pictures is combined and compared with the system without the schemes , the test results show that the performance of the new system is greatly improved , and the design is verified to have good performance for the picture storage system shared by the paper .
【學(xué)位授予單位】：華中科技大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2012
【分類號(hào)】：TP333

【參考文獻(xiàn)】

相關(guān)期刊論文 前3條

1 劉江;;開放、標(biāo)準(zhǔn)化、低成本是云計(jì)算的大勢(shì)所趨[J];程序員;2010年07期

2 王偉軍;孫晶;;Web2.0的研究與應(yīng)用綜述[J];情報(bào)科學(xué);2007年12期

3 田磊;;基于MogileFS建設(shè)廉價(jià)的電子檔案管理系統(tǒng)[J];現(xiàn)代計(jì)算機(jī)(專業(yè)版);2009年11期

本文編號(hào)：1917507