【摘要】：網(wǎng)絡I/O一直是分布式應用的瓶頸。為此,相關研究者提出高速網(wǎng)絡RDMA(Remote Direct Memory Access)技術。RDMA具有卸載TCP/IP協(xié)議棧和用戶態(tài)下處理數(shù)據(jù)傳輸?shù)墓ぷ鞣绞?它首先在高性能計算領域得到廣泛應用。隨著其硬件價格的降低和RDMA over Ethernet的出現(xiàn),數(shù)據(jù)中心也將RDMA引入。它的低延遲、高帶寬、CPU輕負荷的特點,為許多傳統(tǒng)分布式應用的設計提供了新思路,也對新興的大數(shù)據(jù)處理、云計算服務等起到性能保障�，F(xiàn)有的利用RDMA技術加速分布式系統(tǒng)的工作都是將RDMA網(wǎng)絡模塊與整個系統(tǒng)緊耦合。系統(tǒng)設計者通常以一個高速網(wǎng)絡模塊的角度來使用RDMA,試圖來解決跨節(jié)點間的數(shù)據(jù)傳輸瓶頸。當將這些系統(tǒng)部署到數(shù)據(jù)中心或者云計算環(huán)境下,就會產(chǎn)生資源浪費、惡性競爭、較差的數(shù)據(jù)本地性、可擴展性不夠等問題。此外,將RDMA網(wǎng)絡模塊與特定系統(tǒng)緊耦合這種方式,不但增加系統(tǒng)設計者的負擔,還在系統(tǒng)維護成本、軟件復用、大規(guī)模部署等方面有所損害。基于上述原因,我們設計并實現(xiàn)一個提供RDMA高速網(wǎng)絡的通用平臺RDMAVisor,以守護進程的方式存在,向應用程序提供簡單易用的接口來調用RDMA高速網(wǎng)絡服務。分布式應用設計者通過這些接口,來獲得類似于系統(tǒng)服務一樣的RDMA高速網(wǎng)絡數(shù)據(jù)傳輸服務,從而能夠專心于應用邏輯的設計和實現(xiàn)。本文的主要貢獻有以下4點:(1)設計并實現(xiàn)面向數(shù)據(jù)中心的RDMA網(wǎng)絡服務通用平臺RDMAVisor;(2)對RDMA中各種服務類型和操作進行分析,以自適應調節(jié)參數(shù)的方式,為各種類型的分布式應用提供用戶態(tài)下的數(shù)據(jù)傳輸服務;(3)通過復用RDMA連接實體,減輕甚至解決了RDMA的可擴展性問題;(4)針對RDMA原生操作如RDMA Remote Atomic的不足,RDMAVisor在守護進程層級向用戶提供Remote Atomic操作,以更高效的方式替換掉RDMA原生操作。
[Abstract]:Network I / O has been the bottleneck of distributed applications. For this reason, researchers have proposed that the high-speed network RDMA (remote Direct memory Access) technology. RDMA has the ability to uninstall TCP / IP protocol stack and process data transmission in user state. It is widely used in the field of high performance computing. With the reduction of hardware price and the emergence of RDMA over Ethernet, the data center also introduces RDMA. Its characteristics of low latency and high bandwidth and low CPU load provide new ideas for the design of many traditional distributed applications, and also guarantee the performance of the emerging big data processing, cloud computing services and so on. The existing work of using RDMA technology to accelerate the distributed system is to tightly couple the RDMA network module with the whole system. System designers usually use RDMAs as a high-speed network module to try to solve the bottleneck of data transmission between nodes. When these systems are deployed in the data center or cloud computing environment, there will be problems such as waste of resources, vicious competition, poor data locality, poor scalability and so on. In addition, the tight coupling of RDMA network modules with specific systems not only increases the burden on system designers, but also damages system maintenance costs, software reuse, large-scale deployment, and so on. For the above reasons, we design and implement a general platform for RDMA high-speed network, RDMA Visor, which exists as a daemon and provides an easy to use interface to the application program to invoke the RDMA high-speed network service. Through these interfaces, distributed application designers can obtain RDMA high-speed network data transmission services similar to system services, so that they can concentrate on the design and implementation of application logic. The main contributions of this paper are as follows: (1) designing and implementing the general platform of RDMA network service for data center, (2) analyzing various service types and operations in RDMA, and adjusting the parameters adaptively. Provide data transmission services for various types of distributed applications in user mode; (3) by multiplexing RDMA connection entities, The extensibility of RDMA is alleviated or even solved. (4) RDMA native operations such as RDMA remote Atomic are not suitable for RDMA. RDMA Visor provides remote Atomic operations to users at the daemon level and replaces them with more efficient methods.
【學位授予單位】：南京大學
【學位級別】：碩士
【學位授予年份】：2017
【分類號】：TP393.0

【相似文獻】

相關期刊論文 前10條

1 劉翔;羅菊;車軍;;下一代傳輸網(wǎng)絡通用平臺[J];中國新通信;2007年05期

2 任東旺,田文德,姚飛;一種管理信息系統(tǒng)通用平臺思想的提出[J];微型電腦應用;2003年03期

3 陳建;李劍峰;李方義;王玉玲;姜峰;馬開\，

本文編號：2134589