海量遙感影像共性產(chǎn)品生產(chǎn)任務(wù)調(diào)度模型研究及應(yīng)用
本文關(guān)鍵詞: 任務(wù)調(diào)度模型 負(fù)載均衡 并行計(jì)算 高性能 遙感產(chǎn)品生產(chǎn) 出處:《河南大學(xué)》2014年碩士論文 論文類型:學(xué)位論文
【摘要】:隨著社會(huì)對(duì)信息數(shù)據(jù)的巨大需求,遙感影像數(shù)據(jù)量呈爆炸式增長,同時(shí),遙感應(yīng)用對(duì)數(shù)據(jù)處理的巨量需求,推動(dòng)了遙感影像處理技術(shù)的不斷發(fā)展。高性能集群計(jì)算是實(shí)現(xiàn)海量高分辨率遙感衛(wèi)星數(shù)據(jù)快速處理的重要技術(shù)之一,能有效緩解高分遙感應(yīng)用的“瓶頸”。其中,任務(wù)調(diào)度模型是提升集群系統(tǒng)效率的關(guān)鍵。 作者所參與研發(fā)的國家重大專項(xiàng)課題“高分辨率對(duì)地觀測應(yīng)用系統(tǒng)”中海量遙感影像共性產(chǎn)品生產(chǎn)系統(tǒng),具有任務(wù)性質(zhì)單一、子任務(wù)量輕、資源文件大且相對(duì)獨(dú)立等特點(diǎn),而傳統(tǒng)的任務(wù)調(diào)度模型還存在針對(duì)性差、實(shí)用性不強(qiáng)、調(diào)度時(shí)間過長等問題,不能滿足該系統(tǒng)的特點(diǎn)要求。為解決上述問題,本文采用多指標(biāo)負(fù)載均衡技術(shù)以及分層式任務(wù)調(diào)度方法,對(duì)系統(tǒng)中原有的調(diào)度模型進(jìn)行改進(jìn),提出了一種與負(fù)載均衡相結(jié)合的兩級(jí)任務(wù)調(diào)度模型。主要工作和貢獻(xiàn)如下: 1.在對(duì)海量遙感影像共性產(chǎn)品生產(chǎn)系統(tǒng)以及系統(tǒng)原有的任務(wù)調(diào)度策略分析的基礎(chǔ)上,針對(duì)原有任務(wù)調(diào)度策略所存在的吞吐量低、可靠性低以及容錯(cuò)性差等問題,提出了考慮負(fù)載均衡的兩級(jí)任務(wù)調(diào)度模型。 2.在提出該模型的基礎(chǔ)上,首先通過分析負(fù)載均衡技術(shù),并根據(jù)海量遙感產(chǎn)品生產(chǎn)系統(tǒng)的特點(diǎn),設(shè)計(jì)負(fù)載均衡器,以及任務(wù)管理器與負(fù)載均衡器之間的接口;然后,根據(jù)系統(tǒng)的任務(wù)特點(diǎn),完成任務(wù)調(diào)度模型的整體流程設(shè)計(jì);最后,完成了任務(wù)調(diào)度模型中的一級(jí)任務(wù)調(diào)度和二級(jí)任務(wù)調(diào)度的設(shè)計(jì)。 3.將改進(jìn)的任務(wù)調(diào)度模型應(yīng)用于海量遙感影像共性產(chǎn)品生產(chǎn)系統(tǒng)中,并通過大量的實(shí)驗(yàn)數(shù)據(jù)表明,相比原有的任務(wù)調(diào)度模型,在系統(tǒng)吞吐量、系統(tǒng)自適應(yīng)性、系統(tǒng)的可靠性以及系統(tǒng)的容錯(cuò)性等方面,都得到了大大提高。利用改進(jìn)的任務(wù)調(diào)度策略,,某些特定衛(wèi)星切片數(shù)據(jù)的處理時(shí)間甚至縮短了一半以上。
[Abstract]:With the huge demand of society for information data, the amount of remote sensing image data increases explosively. At the same time, there is a huge demand for data processing in remote sensing applications. High performance cluster computing is one of the most important technologies to realize the fast processing of massive high resolution remote sensing satellite data. The task scheduling model is the key to improve the efficiency of cluster system. The production system of mass remote sensing image generality product in the national special project "High Resolution Earth observation Application system", which the author participated in, has a single task and a light sub-task. Resource files are large and relatively independent, but the traditional task scheduling model also has some problems, such as poor pertinence, weak practicability and long scheduling time, which can not meet the characteristics of the system. This paper adopts multi-index load balancing technology and hierarchical task scheduling method to improve the original scheduling model in the system. A two-level task scheduling model combined with load balancing is proposed. The main work and contributions are as follows: 1. On the basis of analyzing the common product production system of mass remote sensing image and the original task scheduling strategy of the system, the throughput of the original task scheduling strategy is low. Due to the low reliability and poor fault tolerance, a two-level task scheduling model considering load balancing is proposed. 2. On the basis of this model, the load balancer is designed by analyzing the load balancing technology and according to the characteristics of mass remote sensing product production system. And the interface between task manager and load balancer; Then, according to the task characteristics of the system, the overall process design of the task scheduling model is completed. Finally, the primary task scheduling and the second level task scheduling are designed in the task scheduling model. 3. The improved task scheduling model is applied to the mass remote sensing image generic product production system, and a large number of experimental data show that compared with the original task scheduling model, the system throughput. The adaptability of the system, the reliability of the system and the fault tolerance of the system have been greatly improved, using the improved task scheduling strategy. Processing time for certain satellite slicing data is even reduced by more than half.
【學(xué)位授予單位】:河南大學(xué)
【學(xué)位級(jí)別】:碩士
【學(xué)位授予年份】:2014
【分類號(hào)】:TP79
【參考文獻(xiàn)】
相關(guān)期刊論文 前10條
1 童小念;舒萬能;李子茂;;異構(gòu)多處理機(jī)系統(tǒng)的負(fù)載均衡與任務(wù)調(diào)度[J];光學(xué)精密工程;2007年12期
2 譚亞麗;于炯;鄧定蘭;呂良干;田國忠;;基于多維QoS約束的網(wǎng)格任務(wù)調(diào)度算法[J];計(jì)算機(jī)工程;2010年12期
3 魯曉霞;周忠和;;云計(jì)算中主任務(wù)調(diào)度算法的優(yōu)化研究[J];計(jì)算技術(shù)與自動(dòng)化;2011年04期
4 王觀玉;;網(wǎng)格計(jì)算中任務(wù)調(diào)度算法的研究和改進(jìn)[J];計(jì)算機(jī)工程與科學(xué);2011年10期
5 鐘紹波;;基于動(dòng)態(tài)負(fù)載均衡策略的網(wǎng)格任務(wù)調(diào)度優(yōu)化模型和算法[J];計(jì)算機(jī)應(yīng)用;2008年11期
6 李坤;王百杰;;服務(wù)器集群負(fù)載均衡技術(shù)研究及算法比較[J];計(jì)算機(jī)與現(xiàn)代化;2009年08期
7 史園莉;申文明;熊文成;付卓;肖如林;;遙感數(shù)據(jù)集群處理作業(yè)調(diào)度管理系統(tǒng)研究[J];計(jì)算機(jī)工程與應(yīng)用;2012年25期
8 陳志剛;楊博;;網(wǎng)格服務(wù)資源多維性能聚類任務(wù)調(diào)度[J];軟件學(xué)報(bào);2009年10期
9 陳志剛;楊博;劉立;;網(wǎng)格資源超圖劃分聚類任務(wù)調(diào)度[J];小型微型計(jì)算機(jī)系統(tǒng);2008年09期
10 殷佳欣;陳馳;;集群數(shù)據(jù)庫系統(tǒng)多指標(biāo)動(dòng)態(tài)負(fù)載均衡方法的設(shè)計(jì)與實(shí)現(xiàn)[J];中國科學(xué)院研究生院學(xué)報(bào);2012年01期
本文編號(hào):1492168
本文鏈接:http://www.sikaile.net/guanlilunwen/gongchengguanli/1492168.html