本文選題：云計(jì)算 + 云存儲(chǔ)系統(tǒng)��； 參考：《南京郵電大學(xué)》2017年碩士論文

【摘要】：隨著云計(jì)算技術(shù)、云存儲(chǔ)技術(shù)的發(fā)展,系統(tǒng)內(nèi)部產(chǎn)生的數(shù)據(jù)量呈現(xiàn)出爆炸式的增長(zhǎng)方式。在面對(duì)海量數(shù)據(jù)的存儲(chǔ)與處理時(shí),云計(jì)算技術(shù)以及云存儲(chǔ)技術(shù)逐漸成為當(dāng)前互聯(lián)網(wǎng)技術(shù)中主流的數(shù)據(jù)共享與處理的技術(shù)。云存儲(chǔ)系統(tǒng)中,經(jīng)常通過(guò)數(shù)據(jù)復(fù)制技術(shù)來(lái)提高數(shù)據(jù)可用性,保證數(shù)據(jù)的容錯(cuò)性和提高容災(zāi)能力。云存儲(chǔ)技術(shù)的關(guān)鍵技術(shù)中就包含有副本管理技術(shù)和副本放置技術(shù)。這些技術(shù)能給系統(tǒng)帶來(lái)好處的同時(shí),也帶來(lái)了一些負(fù)面的影響,比如多副本在系統(tǒng)中存儲(chǔ)勢(shì)必會(huì)增加存儲(chǔ)代價(jià)的開(kāi)銷,副本維護(hù)也會(huì)消耗部分的系統(tǒng)資源。本文設(shè)計(jì)了一個(gè)數(shù)據(jù)復(fù)制方案并且提出了一個(gè)基于負(fù)載均衡的數(shù)據(jù)副本放置方法:(1)復(fù)制方案中包含對(duì)副本創(chuàng)建時(shí)機(jī)的判斷,副本數(shù)量的確定以及副本一致性維護(hù)。方案采用基于分塊計(jì)算校驗(yàn)值的方式來(lái)驗(yàn)證并找出需要同步的文件之間的差異數(shù)據(jù),在數(shù)據(jù)同步過(guò)程中只需要將兩個(gè)副本的差異數(shù)據(jù)同步即可。(2)針對(duì)副本放置問(wèn)題,本文提出的副本放置算法在對(duì)整個(gè)系統(tǒng)中所有數(shù)據(jù)中心負(fù)載做均衡操作的基礎(chǔ)上,根據(jù)轉(zhuǎn)發(fā)服務(wù)請(qǐng)求信息的距離決定是否需要?jiǎng)?chuàng)建新的副本節(jié)點(diǎn)并選取合適的放置節(jié)點(diǎn)。選取合適的節(jié)點(diǎn)過(guò)程是對(duì)數(shù)據(jù)中心的各個(gè)性能參數(shù)綜合考評(píng)確定數(shù)據(jù)中心資本值,從而選取資本值最高的數(shù)據(jù)中心作為副本放置節(jié)點(diǎn)。仿真實(shí)驗(yàn)結(jié)果表明,本文提出的副本放置方法是可行性的。最后,本文借助Hadoop平臺(tái)中分布式計(jì)算框架MapReduce以及分布式文件系統(tǒng)HDFS來(lái)設(shè)計(jì)了相關(guān)的業(yè)務(wù)場(chǎng)景,分別驗(yàn)證了本文設(shè)計(jì)的復(fù)制方案以及數(shù)據(jù)副本放置方法,驗(yàn)證結(jié)果表明,本文設(shè)計(jì)的復(fù)制方案和提出的副本放置方法都是可行的。
[Abstract]:With the development of cloud computing technology and cloud storage technology, the amount of data generated in the system is increasing explosively.In the face of massive data storage and processing, cloud computing technology and cloud storage technology has gradually become the mainstream of Internet technology data sharing and processing technology.In cloud storage systems, data replication technology is often used to improve data availability, ensure data fault tolerance and improve disaster tolerance.The key technologies of cloud storage include replica management and replica placement.These technologies can not only bring benefits to the system, but also bring some negative effects. For example, multi-copy storage in the system will inevitably increase the cost of storage, copy maintenance will also consume part of the system resources.In this paper, we design a data replication scheme and propose a data replica placement scheme based on load balancing, which includes the judgment of replica creation time, the determination of replica number and the maintenance of replica consistency.The scheme uses the method of calculating the check value based on block to verify and find out the difference data between the files that need to be synchronized. In the process of data synchronization, we only need to synchronize the difference data of two replicas.On the basis of balancing the load of all data centers in the whole system, the replica placement algorithm proposed in this paper determines whether a new replica node should be created and the appropriate placement node should be selected according to the distance of forwarding service request information.The process of selecting the appropriate node is to determine the capital value of the data center by synthetically evaluating the performance parameters of the data center, and then selecting the data center with the highest capital value as the replica to place the node.The simulation results show that the proposed replica placement method is feasible.Finally, this paper designs the related business scenarios with the help of the distributed computing framework MapReduce and the distributed file system HDFS in the Hadoop platform, and verifies the replication scheme and the data replica placement method designed in this paper, and the results show that,The replica scheme designed in this paper and the proposed replica placement method are feasible.
【學(xué)位授予單位】：南京郵電大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2017
【分類號(hào)】：TP333

【參考文獻(xiàn)】

相關(guān)期刊論文 前4條

1 傅穎勛;羅圣美;舒繼武;;安全云存儲(chǔ)系統(tǒng)與關(guān)鍵技術(shù)綜述[J];計(jì)算機(jī)研究與發(fā)展;2013年01期

2 郭東;杜勇;胡亮;;基于HDFS的云數(shù)據(jù)備份系統(tǒng)[J];吉林大學(xué)學(xué)報(bào)(理學(xué)版);2012年01期

3 熊潤(rùn)群;羅軍舟;宋愛(ài)波;金嘉暉;;云計(jì)算環(huán)境下QoS偏好感知的副本選擇策略[J];通信學(xué)報(bào);2011年07期

4 周可;王樺;李春花;;云存儲(chǔ)技術(shù)及其應(yīng)用[J];中興通訊技術(shù);2010年04期

，

本文編號(hào)：1741966