【摘要】：隨著互聯(lián)網(wǎng)技術(shù)和分布式數(shù)據(jù)存儲(chǔ)的高速發(fā)展,企業(yè)對(duì)云平臺(tái)使用越來(lái)越普及。與此同時(shí),人們對(duì)于自身存儲(chǔ)在云平臺(tái)的數(shù)據(jù)安全的關(guān)心程度也前所未有,對(duì)云平臺(tái)上存儲(chǔ)的數(shù)據(jù)安全有了更高的要求。Hadoop能夠讓用戶輕松架構(gòu)和使用分布式平臺(tái),然后通過(guò)該平臺(tái)對(duì)大量數(shù)據(jù)進(jìn)行分布式處理。但是基于Hadoop的分布式數(shù)據(jù)存儲(chǔ)目前存在著很大的安全隱患,缺少對(duì)靜態(tài)數(shù)據(jù)的加密保障,在安全方面只關(guān)注了數(shù)據(jù)的驗(yàn)證和備份等部分,并沒(méi)有注重?cái)?shù)據(jù)本身的安全性,因此頻頻爆發(fā)安全問(wèn)題。本文研究的主要內(nèi)容就是將加密技術(shù)應(yīng)用到Hadoop云平臺(tái)中,能夠?qū)崿F(xiàn)對(duì)存儲(chǔ)在Hadoop云平臺(tái)的數(shù)據(jù)進(jìn)行分布式的對(duì)稱加密和解密。首先,本論文在介紹了云計(jì)算和分布式數(shù)據(jù)存儲(chǔ)的國(guó)內(nèi)外研究現(xiàn)狀和發(fā)展趨勢(shì)后,對(duì)Hadoop開源平臺(tái)的兩大關(guān)鍵技術(shù):分布式文件系統(tǒng)HDFS(Hadoop Distributed Filesystem)和用于處理海量數(shù)據(jù)的編程模型MapReduce做了詳細(xì)的介紹。其次,通過(guò)對(duì)現(xiàn)有加密算法的對(duì)比,分析傳統(tǒng)分布式數(shù)據(jù)存儲(chǔ)和Hadoop分布式數(shù)據(jù)存儲(chǔ)存在的問(wèn)題,本文結(jié)合Hadoop分布式云計(jì)算框架中的的MapReduce模型,總結(jié)得出了基于Hadoop的分布式對(duì)稱加密數(shù)據(jù)存儲(chǔ)技術(shù),并進(jìn)行了簡(jiǎn)要的分析。然后,從整體上對(duì)數(shù)據(jù)的分布式加密和解密各個(gè)模塊進(jìn)行了設(shè)計(jì),并詳細(xì)介紹了用MapReduce實(shí)現(xiàn)對(duì)稱加密AES(Advanced Encryption Standard)算法過(guò)程,特別是著重介紹和設(shè)計(jì)了能夠?qū)崿F(xiàn)該算法的Map函數(shù)和Reduce函數(shù)。最后,在實(shí)驗(yàn)室內(nèi)搭建Hadoop集群,并且通過(guò)該云平臺(tái),來(lái)實(shí)現(xiàn)加密和解密過(guò)程,并對(duì)分布式對(duì)稱加密算法進(jìn)行功能測(cè)試、擴(kuò)展性測(cè)試和效率測(cè)試,驗(yàn)證整個(gè)流程。通過(guò)比較測(cè)試數(shù)據(jù)給出仿真性能分析,提出優(yōu)化問(wèn)題,并對(duì)工作進(jìn)行了總結(jié)和展望。
[Abstract]:With the rapid development of Internet technology and distributed data storage, the use of cloud platform is becoming more and more popular. At the same time, people pay more attention to the security of data stored on cloud platform than ever before. Hadoop can make it easy for users to construct and use distributed platform. Then, a large number of data are distributed through the platform. However, the distributed data storage based on Hadoop has great security hidden danger at present, it lacks the encryption guarantee of static data, pays attention only to the verification and backup of data in the security aspect, and does not pay attention to the security of the data itself. As a result, security issues frequently erupt. The main content of this paper is to apply encryption technology to Hadoop cloud platform, which can realize distributed symmetric encryption and decryption of data stored in Hadoop cloud platform. First of all, this paper introduces the research status and development trend of cloud computing and distributed data storage at home and abroad. This paper introduces two key technologies of Hadoop open source platform: distributed file system (HDFS (Hadoop Distributed Filesystem) and programming model (MapReduce) which is used to deal with massive data. Secondly, by comparing the existing encryption algorithms, this paper analyzes the problems existing in traditional distributed data storage and Hadoop distributed data storage, and combines the MapReduce model of Hadoop distributed cloud computing framework. The distributed symmetric encryption data storage technology based on Hadoop is summarized and analyzed briefly. Then, the distributed encryption and decryption modules of data are designed, and the process of using MapReduce to realize symmetric encryption AES (Advanced Encryption Standard) algorithm is introduced in detail. Especially, the Map function and Reduce function which can realize the algorithm are introduced and designed. Finally, the Hadoop cluster is built in the laboratory, and the encryption and decryption process is realized through the cloud platform. The distributed symmetric encryption algorithm is tested by function, extensibility test and efficiency test, and the whole process is verified. The simulation performance analysis is given by comparing the test data, the optimization problem is put forward, and the work is summarized and prospected.
【學(xué)位授予單位】：西安科技大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2015
【分類號(hào)】：TP309.7;TP333

【相似文獻(xiàn)】

相關(guān)期刊論文 前10條

1 劉慧;徐振中;;一種改進(jìn)的加密型WAP協(xié)議[J];計(jì)算機(jī)應(yīng)用與軟件;2006年07期

2 周慶;何校棟;胡月;;用簡(jiǎn)單物理模型構(gòu)建通用對(duì)稱加密系統(tǒng)[J];物理學(xué)報(bào);2011年09期

3 徐江峰;趙峰;;基于雙密鑰的對(duì)稱加密方案[J];計(jì)算機(jī)工程;2008年08期

4 陳鴻星;周媛蘭;;基于不對(duì)稱加密的網(wǎng)絡(luò)信息安全對(duì)策研究[J];網(wǎng)絡(luò)安全技術(shù)與應(yīng)用;2012年06期

5 王燦;秦志光;;一種基于對(duì)稱加密和隱寫術(shù)的反取證方法[J];南京郵電大學(xué)學(xué)報(bào)(自然科學(xué)版);2009年03期

6 徐秀花;黃炯威;;電子批簽系統(tǒng)的設(shè)計(jì)與實(shí)現(xiàn)[J];北京印刷學(xué)院學(xué)報(bào);2006年05期

7 陳芳芳;ASP.NET中的加密技術(shù)——對(duì)稱加密[J];信息技術(shù);2005年07期

8 黃益栓;盧建朱;;一種基于身份的認(rèn)證加密新方案[J];計(jì)算機(jī)工程;2007年07期

9 張衛(wèi)濤;鄧月華;王欽;;對(duì)稱加密數(shù)據(jù)隨機(jī)性定量研究[J];宇航計(jì)測(cè)技術(shù);2011年03期

10 劉浪;周新衛(wèi);;基于DES對(duì)稱加密體制的探討[J];科技廣場(chǎng);2012年10期

相關(guān)碩士學(xué)位論文 前3條

1 靳盼;基于Hadoop的分布式對(duì)稱加密數(shù)據(jù)存儲(chǔ)的分析與研究[D];西安科技大學(xué);2015年

2 賈蕤銘;基于Android系統(tǒng)的動(dòng)態(tài)密鑰管理方案的研究及實(shí)現(xiàn)[D];西北師范大學(xué);2014年

3 蔡照鵬;DD-S-CPK-IC在改進(jìn)SSLVPN記錄層的應(yīng)用[D];遼寧工程技術(shù)大學(xué);2010年

，

本文編號(hào)：2147604