本文選題：高速鐵路 + 云計算�。� 參考：《西南交通大學》2013年碩士論文

【摘要】：科技的不斷進步推動了高速鐵路的快速發(fā)展.而其作為一個節(jié)能、環(huán)保、快速和準點的交通工具日漸成為了人們出行的首選。隨著高鐵裝備水平的不斷改進和提高,安全性和舒適性也成為人們關注的焦點。為了保證列車的安全運行,我們需要實時地對列車運行數(shù)據(jù)進行分析處理,掌握列車的運營狀態(tài),做出決策判斷。 為了能夠獲得足夠的高鐵列車運行信息,工程人員利用大量的傳感器來采集噪聲和振動等多種類型的信號數(shù)據(jù)。然而,分析處理這種大規(guī)模增長的數(shù)據(jù)給傳統(tǒng)的信號分析方法帶來了前所未有的嚴峻挑戰(zhàn),而云計算作為一個新興的并行處理技術,融合了網(wǎng)格計算、分布式計算和并行計算等特點,在大數(shù)據(jù)計算和網(wǎng)絡存儲方面具有卓越的性能表現(xiàn)。 Hadoop作為一種云計算框架,包含了文件系統(tǒng)HDFS和MapReduce編程模型,其具有高可靠性和高容錯性等特點,尤其是MapReduce模型,采用分而治之的設計思想,有效地化解了大數(shù)據(jù)對現(xiàn)代程序設計過程帶來的挑戰(zhàn)。本文利用云計算技術對高鐵數(shù)據(jù)處理領域十分重要的數(shù)據(jù)預處理和信號分析算法進行并行化,包括高鐵原始數(shù)據(jù)解包算法和數(shù)字信號分析中廣為應用的快速傅里葉變換算法FFT。高鐵原始數(shù)據(jù)解包作為高鐵數(shù)據(jù)預處理的第一步,為后期的數(shù)據(jù)預處理過程如數(shù)據(jù)平滑、去除異常點和去除線性趨勢項等奠定了數(shù)據(jù)基礎,對其并行化解決了傳統(tǒng)解包算法處理測試數(shù)據(jù)集的瓶頸。實驗證實,該算法在并行性方而表現(xiàn)良好。 為了給工程人員提供一個系統(tǒng)化的數(shù)據(jù)預處理環(huán)境,本文設計了一個基于云計算的高鐵數(shù)據(jù)預處理系統(tǒng),其將多種并行數(shù)據(jù)預處理算法整合到一起,并且提供了對Hadoop集群的配置功能,工程人員只需要在系統(tǒng)中按需求提交處理任務,系統(tǒng)通過分析將任務操作步驟轉交給Hadoop系統(tǒng),待處理完畢之后,工程人員便可將處理結果下載到本地,極大地方便了數(shù)據(jù)預處理過程。 FFT作為離散傅里葉變換的一種快速算法,成為了數(shù)字信號分析領域中重要的工具,廣泛應用于圖像處理和通信技術等領域。高鐵信號數(shù)據(jù)處理中也同樣需要用到FFT算法,然而傳統(tǒng)的串行FFT算法并不能適應大規(guī)模的高鐵運行數(shù)據(jù)。于是,本文基于云計算技術設計了一個并行FFT算法,實驗證明,該算法在準確率方而與串行算法結果保持一致,且節(jié)點間的并行性提升了運算效率,可以適應大規(guī)模的高鐵數(shù)據(jù)集處理需求。
[Abstract]:The continuous progress of science and technology has promoted the rapid development of high-speed railway. As an energy-saving, environmental-friendly, fast and punctual transportation, it has become the first choice for people to travel. With the continuous improvement and improvement of high-speed equipment, safety and comfort have become the focus of attention. In order to ensure the safe operation of the train, we need to analyze and process the train operation data in real time, master the operation state of the train, and make the decision judgment. In order to obtain enough information of high-speed train operation, engineers use a large number of sensors to collect various kinds of signal data, such as noise and vibration. However, analyzing and processing this kind of large-scale growth data brings unprecedented challenges to traditional signal analysis methods. Cloud computing, as a new parallel processing technology, integrates grid computing. Distributed computing and parallel computing have excellent performance in big data computing and network storage. As a cloud computing framework, Hadoop includes file system HDFS and MapReduce programming model. It has the characteristics of high reliability and high fault tolerance, especially the MapReduce model, which adopts the design idea of divide-and-conquer. It effectively resolves the challenge brought by big data to the modern programming process. This paper uses cloud computing technology to parallelize the data preprocessing and signal analysis algorithms which are very important in the field of high-speed rail data processing, including the fast Fourier transform algorithm (FFTFT), which is widely used in high-speed rail raw data unpacking algorithm and digital signal analysis. As the first step of high-speed railway data preprocessing, the unpacking of raw data of high speed rail lays the data foundation for the later data preprocessing process such as data smoothing, removing abnormal points and removing linear trend items, etc. Parallelization solves the bottleneck of traditional unpacking algorithm in processing test data sets. Experiments show that the algorithm performs well in parallelism. In order to provide a systematic data preprocessing environment for engineers, this paper designs a high-speed railway data preprocessing system based on cloud computing, which integrates a variety of parallel data preprocessing algorithms. And the configuration function of Hadoop cluster is provided. Engineers only need to submit the processing task according to the requirement in the system. The system passes the task operation steps to the Hadoop system through the analysis, and after the processing is finished, Engineers can download the processing results to the local, which greatly facilitates the data preprocessing process. As a fast algorithm of discrete Fourier transform (DFT), FFT has become an important tool in the field of digital signal analysis, and has been widely used in image processing and communication technology. The FFT algorithm is also used in high-speed rail signal data processing, but the traditional serial FFT algorithm can not adapt to the large-scale high-speed rail operation data. Therefore, this paper designs a parallel FFT algorithm based on cloud computing technology. Experimental results show that the algorithm is consistent with the result of serial algorithm in accuracy, and the parallelism between nodes improves the computing efficiency. It can meet the needs of large-scale high-speed railway data set processing.
【學位授予單位】：西南交通大學
【學位級別】：碩士
【學位授予年份】：2013
【分類號】：TP338.6

【參考文獻】

相關期刊論文 前9條

1 孫苗鐘;;基于MATLAB的振動信號平滑處理方法[J];電子測量技術;2007年06期

2 孫志堅 ,劉學梅 ,黃建喜 ,肖欣;用FPGA實現(xiàn)SAR實時信號處理的進一步研究[J];電子技術應用;2005年02期

3 朱曉航;劉亞男;;OFDM中的FFT模塊設計及其FPGA實現(xiàn)[J];電子科技;2007年02期

4 郭進;張亞東;;中國高速鐵路信號系統(tǒng)分析與思考[J];北京交通大學學報;2012年05期

5 林偉偉;張志立;齊德昱;;基于網(wǎng)格的分布并行計算策略[J];計算機工程;2006年09期

6 趙成兵;李天瑞;王仲剛;高子U，

本文編號：1943303