【摘要】：在當(dāng)前競(jìng)爭(zhēng)日益激烈的互聯(lián)網(wǎng)時(shí)代下,數(shù)據(jù)的及時(shí)獲取成為企業(yè)成功的關(guān)鍵所在。商業(yè)智能以挖掘數(shù)據(jù)中的信息為目的,以數(shù)據(jù)搜集、管理和分析為手段,使用戶從數(shù)據(jù)中獲得對(duì)于商業(yè)市場(chǎng)更好的洞察力和決策力。數(shù)據(jù)倉(cāng)庫(kù)作為為企業(yè)所有級(jí)別的決策制定過程提供支持的所有類型數(shù)據(jù)的戰(zhàn)略集合,成為商業(yè)智能中數(shù)據(jù)建模的核心環(huán)節(jié)。本文的數(shù)據(jù)倉(cāng)庫(kù)包括對(duì)倉(cāng)外分散數(shù)據(jù)、倉(cāng)內(nèi)整合數(shù)據(jù)的ETL過程以及對(duì)上層應(yīng)用提供決策支持三大部分,而調(diào)度系統(tǒng)作為數(shù)據(jù)倉(cāng)庫(kù)處理數(shù)據(jù)的核心控制工具起到了重要的作用。本文設(shè)計(jì)實(shí)現(xiàn)了完整的處理倉(cāng)內(nèi)倉(cāng)外數(shù)據(jù)的數(shù)據(jù)倉(cāng)庫(kù)調(diào)度系統(tǒng),達(dá)到穩(wěn)定、高效、快捷的處理數(shù)據(jù),闡述了處理倉(cāng)內(nèi)倉(cāng)外數(shù)據(jù)的數(shù)據(jù)倉(cāng)庫(kù)調(diào)度系統(tǒng)的設(shè)計(jì)原理,并依托流量經(jīng)營(yíng)項(xiàng)目給出該設(shè)計(jì)方案在現(xiàn)實(shí)業(yè)務(wù)中的應(yīng)用。數(shù)據(jù)倉(cāng)庫(kù)調(diào)度系統(tǒng)是流量經(jīng)營(yíng)項(xiàng)目中的數(shù)據(jù)處理核心,負(fù)責(zé)平臺(tái)統(tǒng)計(jì)分析源數(shù)據(jù)的工作流的調(diào)度,從而完成數(shù)據(jù)的采集、加工和存儲(chǔ)。本文數(shù)據(jù)倉(cāng)庫(kù)調(diào)度系統(tǒng)具備三個(gè)層次的能力:(1)調(diào)度處理倉(cāng)內(nèi)倉(cāng)外數(shù)據(jù)的ETL工作流的能力;(2)多元的ETL能力,將不同來源的分散數(shù)據(jù)經(jīng)過不同的手段,依托于調(diào)度工具,經(jīng)采集、加工以及持久化后,供上層應(yīng)用使用;(3)為提升系統(tǒng)的易用性設(shè)計(jì)實(shí)現(xiàn)了可視化配置和展現(xiàn)的能力。本文通過真實(shí)全面的現(xiàn)網(wǎng)實(shí)際應(yīng)用數(shù)據(jù)和應(yīng)用效果,證明了本課題給出的調(diào)度系統(tǒng)以及可視化配置界面的設(shè)計(jì)方案的可行性和現(xiàn)實(shí)價(jià)值。
[Abstract]:In the current competitive Internet era, the timely acquisition of data becomes the key to the success of enterprises. The purpose of business intelligence is to mine the information in the data, and to collect, manage and analyze the data so that the user can obtain better insight and decision power for the business market from the data. As a strategic set of all types of data that provide support for all levels of decision making process, data warehouse has become the core of data modeling in business intelligence. The data warehouse in this paper includes three parts: the distributed data outside the warehouse, the ETL process of data integration in the warehouse and the decision support for the upper application. The scheduling system plays an important role as the core control tool for data processing in the data warehouse. This paper designs and implements a complete data warehouse scheduling system to deal with the data inside and outside the warehouse, and achieves a stable, efficient and fast data processing system. The design principle of the data warehouse scheduling system for processing the data inside and outside the warehouse is described. Based on the flow management project, the application of the design scheme in the real business is given. Data warehouse scheduling system is the core of data processing in the flow management project. It is responsible for scheduling the workflow of the source data in order to complete the data collection, processing and storage. The data warehouse scheduling system in this paper has three levels of capability: (1) the ability to schedule and process the ETL workflow of data inside and outside the warehouse; (2) the multiple ETL ability to collect the scattered data from different sources through different means, depending on the scheduling tools, After processing and persistence, it can be used for upper application. (3) the ability of visual configuration and presentation is realized for improving the usability of the system. This paper proves the feasibility and practical value of the scheduling system and the visual configuration interface design scheme given in this paper through the real and comprehensive practical application data and application effect of the present network.
【學(xué)位授予單位】：北京郵電大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2016
【分類號(hào)】：TP311.13

【參考文獻(xiàn)】

相關(guān)期刊論文 前7條

1 曹旭;張?jiān)迫A;;Hadoop平臺(tái)下計(jì)算模型中調(diào)度策略的研究[J];計(jì)算機(jī)應(yīng)用與軟件;2013年09期

2 全波;姚素丹;;移動(dòng)互聯(lián)網(wǎng)時(shí)代電信運(yùn)營(yíng)商流量經(jīng)營(yíng)探索[J];電信科學(xué);2012年07期

3 張作鳳;;運(yùn)營(yíng)商如何做好流量經(jīng)營(yíng)[J];移動(dòng)通信;2012年07期

4 劉亞鵬;張征;俞婷;;基于MVC多層架構(gòu)的Web應(yīng)用框架設(shè)計(jì)[J];微計(jì)算機(jī)信息;2011年07期

5 徐俊剛;裴瑩;;數(shù)據(jù)ETL研究綜述[J];計(jì)算機(jī)科學(xué);2011年04期

6 龍青云;胡巧多;;商務(wù)智能的架構(gòu)體系和技術(shù)工具[J];電腦知識(shí)與技術(shù)(學(xué)術(shù)交流);2007年12期

7 趙文,胡文蕙,張世琨,王立福;工作流元模型的研究與應(yīng)用[J];軟件學(xué)報(bào);2003年06期

相關(guān)碩士學(xué)位論文 前5條

1 任桂禾;大數(shù)據(jù)處理支撐平臺(tái)調(diào)度子系統(tǒng)的設(shè)計(jì)與實(shí)現(xiàn)[D];北京郵電大學(xué);2015年

2 費(fèi)仕憶;Hadoop大數(shù)據(jù)平臺(tái)與傳統(tǒng)數(shù)據(jù)倉(cāng)庫(kù)的協(xié)作研究[D];東華大學(xué);2014年

3 劉靜;數(shù)據(jù)倉(cāng)庫(kù)在零售業(yè)商業(yè)智能系統(tǒng)的應(yīng)用[D];江蘇科技大學(xué);2014年

4 趙英杰;基于商業(yè)智能技術(shù)的決策支持系統(tǒng)設(shè)計(jì)與開發(fā)[D];北京工業(yè)大學(xué);2012年

5 牛筱峰;基于元數(shù)據(jù)的數(shù)據(jù)倉(cāng)庫(kù)任務(wù)調(diào)度原型系統(tǒng)的設(shè)計(jì)與實(shí)現(xiàn)[D];北京交通大學(xué);2008年

，

本文編號(hào)：2261042