低能耗存儲系統(tǒng)的設計與實現(xiàn)
發(fā)布時間:2018-12-17 06:35
【摘要】:為了滿足呈爆炸式增長的信息存儲、處理、傳輸?shù)男枨,大?guī)模數(shù)據中心應運而生。在大規(guī)模數(shù)據中心里,根據經典的80/20原理,將數(shù)據都存儲在高性能設備上是不經濟的,為了實現(xiàn)資源的優(yōu)化配置,于是就有了分級存儲概念。研究表明數(shù)據中心的服務器很少處于滿負荷狀態(tài),由于服務器消耗的能量與服務器的利用率并不成比例,空轉的服務器(空閑的CPU、空轉的硬盤等)浪費了大量的能量。設計一種低能耗存儲系統(tǒng)就十分必要。 通過對現(xiàn)有的x86服務器在性能、能耗方面進行分析,設計了一種低能耗存儲系統(tǒng)——基于嵌入式平臺的分級存儲系統(tǒng)。首先,介紹了低能耗存儲系統(tǒng)的應用場景,討論了在系統(tǒng)實現(xiàn)中涉及到的關鍵技術,分析了在實現(xiàn)基于數(shù)據訪問熱度和存儲資源性能的在線數(shù)據遷移機制時可能引發(fā)的相關問題。其次,對原型系統(tǒng)進行設計和實現(xiàn),構建了由應用服務器、存儲服務器和管理服務器三個部分組成的系統(tǒng)。系統(tǒng)包含系統(tǒng)監(jiān)控、存儲管理、數(shù)據管理、智能管理和用戶界面五個模塊,系統(tǒng)監(jiān)控模塊主要收集用戶數(shù)據訪問熱度信息和存儲服務器的負載信息;智能管理模塊根據這些信息調度數(shù)據進行遷移,并對服務器有選擇地進行開啟和關機,在實現(xiàn)基于用戶訪問頻度的分級存儲機制的同時,達到節(jié)能降耗的目的。 最后通過實驗驗證了該系統(tǒng)的功能,對系統(tǒng)性能進行了評測,分析了通過數(shù)據遷移對系統(tǒng)進行調度系統(tǒng)能耗的變化。測試結果表明,,它能夠依據數(shù)據的實時熱度和服務器的負載,對數(shù)據進行自適應遷移;再通過對服務器啟停進行動態(tài)調度,可以在實現(xiàn)優(yōu)化資源配置的同時,將系統(tǒng)能耗降低25%。
[Abstract]:In order to meet the demand of explosive information storage, processing and transmission, large-scale data center emerged as the times require. In large scale data centers, it is not economical to store data on high performance devices according to the classical 80 / 20 principle. In order to optimize the allocation of resources, there is the concept of hierarchical storage. The research shows that the server in the data center is rarely in the full load state. Because the energy consumed by the server is not proportional to the utilization rate of the server, the idle server (idle CPU, idling hard disk, etc.) wastes a lot of energy. It is necessary to design a low energy storage system. By analyzing the performance and energy consumption of the existing x86 server, a low energy storage system-hierarchical storage system based on embedded platform is designed. Firstly, the application scenario of low energy consumption storage system is introduced, and the key technologies involved in the system implementation are discussed. This paper analyzes the related problems in the implementation of online data migration mechanism based on data access heat and storage resource performance. Secondly, the prototype system is designed and implemented, and the system is composed of application server, storage server and management server. The system consists of five modules: system monitoring, storage management, data management, intelligent management and user interface. The system monitoring module mainly collects user data access heat information and storage server load information. The intelligent management module migrates according to these information scheduling data and selectively opens and shuts down the server so as to realize the hierarchical storage mechanism based on user access frequency and achieve the purpose of saving energy and reducing consumption. Finally, the function of the system is verified by experiments, the performance of the system is evaluated, and the energy consumption of the scheduling system is analyzed through data migration. The test results show that it can transfer the data adaptively according to the real-time heat of the data and the load of the server. Through dynamic scheduling of the server, the system energy consumption can be reduced by 25% while optimizing the allocation of resources.
【學位授予單位】:華中科技大學
【學位級別】:碩士
【學位授予年份】:2012
【分類號】:TP333
本文編號:2383817
[Abstract]:In order to meet the demand of explosive information storage, processing and transmission, large-scale data center emerged as the times require. In large scale data centers, it is not economical to store data on high performance devices according to the classical 80 / 20 principle. In order to optimize the allocation of resources, there is the concept of hierarchical storage. The research shows that the server in the data center is rarely in the full load state. Because the energy consumed by the server is not proportional to the utilization rate of the server, the idle server (idle CPU, idling hard disk, etc.) wastes a lot of energy. It is necessary to design a low energy storage system. By analyzing the performance and energy consumption of the existing x86 server, a low energy storage system-hierarchical storage system based on embedded platform is designed. Firstly, the application scenario of low energy consumption storage system is introduced, and the key technologies involved in the system implementation are discussed. This paper analyzes the related problems in the implementation of online data migration mechanism based on data access heat and storage resource performance. Secondly, the prototype system is designed and implemented, and the system is composed of application server, storage server and management server. The system consists of five modules: system monitoring, storage management, data management, intelligent management and user interface. The system monitoring module mainly collects user data access heat information and storage server load information. The intelligent management module migrates according to these information scheduling data and selectively opens and shuts down the server so as to realize the hierarchical storage mechanism based on user access frequency and achieve the purpose of saving energy and reducing consumption. Finally, the function of the system is verified by experiments, the performance of the system is evaluated, and the energy consumption of the scheduling system is analyzed through data migration. The test results show that it can transfer the data adaptively according to the real-time heat of the data and the load of the server. Through dynamic scheduling of the server, the system energy consumption can be reduced by 25% while optimizing the allocation of resources.
【學位授予單位】:華中科技大學
【學位級別】:碩士
【學位授予年份】:2012
【分類號】:TP333
【參考文獻】
相關期刊論文 前7條
1 譚志虎,裴先登,謝長生,吳海良;附網存儲——一種新的網絡存儲方案[J];電子計算機與外部設備;1999年01期
2 胡偉武;李國杰;;納米級工藝對微處理器設計的挑戰(zhàn)[J];中國集成電路;2008年07期
3 李輝,謝長生,涂平;一種新型的高性能計算機存儲系統(tǒng)的研究與實現(xiàn)[J];計算機研究與發(fā)展;1999年02期
4 謝長生,王宇德,曹強;進化存儲系統(tǒng)的研究[J];計算機工程;2004年22期
5 郭御風,李瓊,劉光明,劉衡竹;虛擬存儲技術研究[J];計算機應用研究;2004年02期
6 陳華英;數(shù)據在線“搬家”——關于數(shù)據遷移技術及應用[J];微電腦世界;2003年07期
7 李旭;謝長生;萬繼光;魏沁祺;;基于ESS自適應數(shù)據遷移的研究與實現(xiàn)[J];小型微型計算機系統(tǒng);2007年02期
本文編號:2383817
本文鏈接:http://www.sikaile.net/kejilunwen/jisuanjikexuelunwen/2383817.html
最近更新
教材專著