MDLB:一種基于強化學習的元數(shù)據(jù)動態(tài)負載均衡機制(英文)
發(fā)布時間:2021-04-09 02:37
隨著信息和數(shù)據(jù)量增長,面向?qū)ο蟮拇鎯ο到y(tǒng)已被廣泛應(yīng)用到很多領(lǐng)域,包括Google文件系統(tǒng)、AmazonS3、Hadoop分布式文件系統(tǒng)和Ceph。其中元數(shù)據(jù)負載均衡在提高整個系統(tǒng)輸入/輸出性能方面起著重要作用,元數(shù)據(jù)負載不平衡會導(dǎo)致服務(wù)器出現(xiàn)嚴重的系統(tǒng)性能瓶頸問題。然而現(xiàn)有元數(shù)據(jù)負載平衡策略缺乏良好動態(tài)性和適用性,如基于子樹分割或者哈希的負載策略。提出一種基于強化學習的動態(tài)負載平衡機制(MDLB)。采用Qlearning算法,所提基于強化學習機制由3個模塊組成,即策略選擇網(wǎng)絡(luò)、負載均衡網(wǎng)絡(luò)和參數(shù)更新網(wǎng)絡(luò)。實驗結(jié)果表明MDLB算法可根據(jù)元數(shù)據(jù)服務(wù)器的性能動態(tài)調(diào)節(jié)負載,在數(shù)據(jù)量驟變情況下仍具有很好適應(yīng)性。
【文章來源】:Frontiers of Information Technology & Electronic Engineering. 2020,21(07)EISCICSCD
【文章頁數(shù)】:14 頁
【文章目錄】:
1 Introduction
2 Related works
3 Problem definition
4 The proposed method
4.1 Reinforcement learning and the Q_learning algorithm
4.2 RL model for MDLB
4.2.1 Policy selection network
4.2.2 Metadata load balancing network
4.2.3 Parameter update network
4.3 Metadata dynamic load balancing mechanism
4.4 Reward and objective function
4.5 Algorithm complexity analysis
5 Experiments
5.1 Metadata server resource utilization analysis
5.2 Dynamic load balancing analysis
5.3 Metadata server delay overshoot and adjust-ment time analysis
5.4 Metadata distribution analysis
5.5 Discussion
6 Conclusions
Contributors
Compliance with ethics guidelines
【參考文獻】:
期刊論文
[1]對象存儲系統(tǒng)中自適應(yīng)的元數(shù)據(jù)負載均衡機制[J]. 陳濤,肖儂,劉芳. 軟件學報. 2013(02)
[2]基于目錄路徑的元數(shù)據(jù)管理方法[J]. 劉仲,周興銘. 軟件學報. 2007(02)
本文編號:3126745
【文章來源】:Frontiers of Information Technology & Electronic Engineering. 2020,21(07)EISCICSCD
【文章頁數(shù)】:14 頁
【文章目錄】:
1 Introduction
2 Related works
3 Problem definition
4 The proposed method
4.1 Reinforcement learning and the Q_learning algorithm
4.2 RL model for MDLB
4.2.1 Policy selection network
4.2.2 Metadata load balancing network
4.2.3 Parameter update network
4.3 Metadata dynamic load balancing mechanism
4.4 Reward and objective function
4.5 Algorithm complexity analysis
5 Experiments
5.1 Metadata server resource utilization analysis
5.2 Dynamic load balancing analysis
5.3 Metadata server delay overshoot and adjust-ment time analysis
5.4 Metadata distribution analysis
5.5 Discussion
6 Conclusions
Contributors
Compliance with ethics guidelines
【參考文獻】:
期刊論文
[1]對象存儲系統(tǒng)中自適應(yīng)的元數(shù)據(jù)負載均衡機制[J]. 陳濤,肖儂,劉芳. 軟件學報. 2013(02)
[2]基于目錄路徑的元數(shù)據(jù)管理方法[J]. 劉仲,周興銘. 軟件學報. 2007(02)
本文編號:3126745
本文鏈接:http://www.sikaile.net/kejilunwen/jisuanjikexuelunwen/3126745.html
最近更新
教材專著