內存數據庫存儲管理研究
發(fā)布時間:2018-11-26 08:50
【摘要】:內存數據庫由于全部或者大部分數據常駐內存,故其事務處理過程中的I/O很少。因此,與磁盤數據庫以減少I/O為主要優(yōu)化目標不同,內存數據庫不再以此為主要優(yōu)化目標。這也意味著磁盤數據庫中的各種處理方法不再適用于內存數據庫,而需要針對內存數據庫的自身特點來研究新的處理方法。作為內存數據庫的各種功能的基礎,存儲管理有著十分重要的地位。存儲管理不僅直接影響著內存數據庫的性能,也影響了各種上層功能,故內存數據庫存儲管理的研究具有重要的意義。 基于以上需求,研究了內存數據庫的存儲管理,,并給出了相應的存儲管理器的設計與實現。具體而言,研究內容包括內存數據庫的數據組織、內存管理以及索引。主要工作如下:在分析內存數據庫的存儲層次的基礎上,設計了存儲管理器的存儲層次以及記錄的組織方法;通過改進記錄的格式從而大幅度提高了存儲管理器的性能;設計并實現了一個基于多內存池,可以有效利用內存資源的內存管理方法;設計并實現了一個靈活的啟動加載策略和一個內外存數據交換策略;詳細分析了哈希索引、T-樹索引和緩存敏感索引的特點及其適用性,給出了T-樹索引的詳細設計、實現及其優(yōu)化方法。 最后,通過實驗表明,索引節(jié)點塊的大小對索引性能存在著較大的影響;記錄格式的改進顯著提升了該存儲管理器的性能。另外,還通過與FastDB的對比實驗表明,該存儲管理器的綜合性能較實際內存數據庫系統(tǒng)FastDB相當或更高,在實踐中是可行的。
[Abstract]:Since all or most of the data are resident in memory, there are very few I / O in the transaction. Therefore, unlike the disk database with reducing I / O as the main optimization goal, the memory database is no longer the main optimization goal. This means that the various processing methods in the disk database are no longer suitable for the memory database, but the new processing method should be studied according to the characteristics of the memory database. As the basis of various functions of memory database, storage management plays an important role. Storage management not only directly affects the performance of the memory database, but also affects various upper functions, so the research of memory database storage management is of great significance. Based on the above requirements, the storage management of the memory database is studied, and the design and implementation of the storage manager are given. Specifically, the research includes data organization, memory management and index of memory database. The main work is as follows: on the basis of analyzing the storage hierarchy of the memory database, the storage layer of the storage manager and the organization method of the record are designed, and the performance of the storage manager is greatly improved by improving the format of the record. A memory management method based on multi-memory pool is designed and implemented, and a flexible startup loading strategy and an internal and external memory data exchange strategy are designed and implemented. The characteristics and applicability of hash index, T- tree index and cache sensitive index are analyzed in detail. The detailed design, implementation and optimization of T- tree index are given. Finally, the experimental results show that the size of the index node block has a great impact on the index performance, and the improvement of the record format significantly improves the performance of the storage manager. In addition, the comparison experiment with FastDB shows that the comprehensive performance of the storage manager is comparable to or higher than that of the real memory database system FastDB, and it is feasible in practice.
【學位授予單位】:華中科技大學
【學位級別】:碩士
【學位授予年份】:2012
【分類號】:TP311.13;TP333
本文編號:2358031
[Abstract]:Since all or most of the data are resident in memory, there are very few I / O in the transaction. Therefore, unlike the disk database with reducing I / O as the main optimization goal, the memory database is no longer the main optimization goal. This means that the various processing methods in the disk database are no longer suitable for the memory database, but the new processing method should be studied according to the characteristics of the memory database. As the basis of various functions of memory database, storage management plays an important role. Storage management not only directly affects the performance of the memory database, but also affects various upper functions, so the research of memory database storage management is of great significance. Based on the above requirements, the storage management of the memory database is studied, and the design and implementation of the storage manager are given. Specifically, the research includes data organization, memory management and index of memory database. The main work is as follows: on the basis of analyzing the storage hierarchy of the memory database, the storage layer of the storage manager and the organization method of the record are designed, and the performance of the storage manager is greatly improved by improving the format of the record. A memory management method based on multi-memory pool is designed and implemented, and a flexible startup loading strategy and an internal and external memory data exchange strategy are designed and implemented. The characteristics and applicability of hash index, T- tree index and cache sensitive index are analyzed in detail. The detailed design, implementation and optimization of T- tree index are given. Finally, the experimental results show that the size of the index node block has a great impact on the index performance, and the improvement of the record format significantly improves the performance of the storage manager. In addition, the comparison experiment with FastDB shows that the comprehensive performance of the storage manager is comparable to or higher than that of the real memory database system FastDB, and it is feasible in practice.
【學位授予單位】:華中科技大學
【學位級別】:碩士
【學位授予年份】:2012
【分類號】:TP311.13;TP333
【參考文獻】
相關期刊論文 前5條
1 劉云生,李國徽,肖群;實時內存數據庫的數據交換策略及評價[J];計算機研究與發(fā)展;1999年07期
2 劉云生,遲巖;內存受限的實時內存數據庫數據裝入策略[J];計算機工程;2004年20期
3 郭超;李坤;王永炎;劉勝航;王宏安;;多核處理器環(huán)境下內存數據庫索引性能分析[J];計算機學報;2010年08期
4 王珊;肖艷芹;劉大為;覃雄派;;內存數據庫關鍵技術研究[J];計算機應用;2007年10期
5 劉云生,李國徽;實時內存數據庫的裝入[J];軟件學報;2000年06期
本文編號:2358031
本文鏈接:http://www.sikaile.net/kejilunwen/jisuanjikexuelunwen/2358031.html