本文選題：分布式數(shù)據(jù)管理 + 分布式渲染　； 參考：《華中科技大學》2013年碩士論文

【摘要】：隨著影視行業(yè)的蓬勃發(fā)展，從傳統(tǒng)的2D平面電影時代發(fā)展到風靡全球的3D數(shù)字化電影時代，而達到這種效果的關鍵技術之一就是渲染技術。隨著單機越來越無法滿足渲染應用的處理需求，分布式集群下的渲染應用也逐漸普遍起來，強大的集群計算能力帶給渲染應用性能上的巨大提升，但同時由于渲染應用頻繁的數(shù)據(jù)IO訪問，使得磁盤IO成為了提升分布式渲染應用性能的瓶頸。 基于內(nèi)存存儲的分布式數(shù)據(jù)緩存系統(tǒng)通過構建一個分布式的共享內(nèi)存區(qū)域的方式，來存放所有分布式渲染應用過程中產(chǎn)生的數(shù)據(jù)。在高效的分布式內(nèi)存資源管理模塊中，利用內(nèi)存池狀態(tài)信息管理機制來實現(xiàn)對共享內(nèi)存的實時監(jiān)控；利用內(nèi)存數(shù)據(jù)信息管理機制來記錄所有存儲在共享內(nèi)存中文件數(shù)據(jù)的元數(shù)據(jù)信息，以方便快速查找到它們的位置；利用內(nèi)存空間申請回收管理機制為上層渲染用戶提供內(nèi)存資源申請與釋放的服務，讓渲染用戶可以自由的使用內(nèi)存資源。同時在傳統(tǒng)分布式數(shù)據(jù)訪問方式的基礎上，針對渲染系統(tǒng)的特點提出了兩種數(shù)據(jù)訪問優(yōu)化策略。雙層多粒度鎖機制，在避免了多個渲染用戶的數(shù)據(jù)訪問沖突的前提下，有效的減少了等待延遲的開銷。在用戶讀數(shù)據(jù)之前的預處理過程中，數(shù)據(jù)預取優(yōu)化策略有效的避免了對同一個存儲節(jié)點重復數(shù)據(jù)傳輸情況的發(fā)生，減少了網(wǎng)絡開銷，提高了數(shù)據(jù)訪問的效率。 實驗表明，面向渲染應用下的分布式數(shù)據(jù)緩存系統(tǒng)能夠很好的滿足了渲染應用數(shù)據(jù)存儲和訪問需求。完備的分布式內(nèi)存數(shù)據(jù)管理為渲染應用提供了可靠的數(shù)據(jù)保障；針對渲染系統(tǒng)特點的數(shù)據(jù)訪問優(yōu)化策略，，在滿足渲染應用需求的基礎上，給渲染應用數(shù)據(jù)讀取帶來了性能上的提升。
[Abstract]:With the rapid development of the film and television industry, from the traditional 2D plane film era to the global 3D digital film era, rendering technology is one of the key technologies to achieve this effect. As the single machine is unable to meet the processing requirements of rendering applications, rendering applications in distributed clusters are becoming more and more popular. The powerful computing power of cluster brings great improvement to the performance of rendering applications. However, due to frequent data IO access in rendering applications, disk IO becomes the bottleneck to improve the performance of distributed rendering applications. A distributed data cache system based on memory storage can store all the data generated in distributed rendering applications by constructing a distributed shared memory region. In the efficient distributed memory resource management module, the memory pool state information management mechanism is used to realize the real-time monitoring of shared memory. Using the memory data information management mechanism to record all the metadata information stored in the shared memory file data in order to quickly find their location; Using the memory space request recycling management mechanism to provide the memory resource application and release service for the upper layer rendering user, so that the rendering user can use the memory resource freely. At the same time, based on the traditional distributed data access method, two kinds of data access optimization strategies are proposed according to the characteristics of the rendering system. Double-layer multi-granularity locking mechanism can effectively reduce the overhead of waiting delay while avoiding the collision of multiple rendering users' data access. In the preprocessing process before the user reads the data, the data prefetching optimization strategy effectively avoids the repeated data transmission to the same storage node, reduces the network overhead, and improves the efficiency of data access. Experimental results show that the distributed data cache system for rendering applications can meet the requirements of data storage and access in rendering applications. The complete distributed memory data management provides reliable data guarantee for the rendering application, and the data access optimization strategy for the characteristics of the rendering system, on the basis of satisfying the requirements of the rendering application, It improves the performance of rendering application data reading.
【學位授予單位】：華中科技大學
【學位級別】：碩士
【學位授予年份】：2013
【分類號】：TP391.41;TP333

【參考文獻】

相關期刊論文 前2條

1 蔣衛(wèi)寅;李斌;凌力;;分布式系統(tǒng)數(shù)據(jù)一致性和并發(fā)性優(yōu)化研究[J];計算機工程;2012年04期

2 姚遠;王麗芳;蔣澤軍;;HDFS一致性管理的研究[J];現(xiàn)代電子技術;2012年08期

本文編號：2027241