本文選題：新聞客戶端　切入點(diǎn)：日志收集　出處：《北京交通大學(xué)》2017年碩士論文　論文類型：學(xué)位論文

【摘要】：隨著智能手機(jī)與移動(dòng)互聯(lián)網(wǎng)的快速發(fā)展,傳統(tǒng)新聞門戶網(wǎng)站的業(yè)務(wù)受到了移動(dòng)性與便捷性的多重挑戰(zhàn)。智能手機(jī)憑借其移動(dòng)、便捷等優(yōu)勢(shì),已發(fā)展成為重要的大眾傳播媒體,成為媒介融合的新平臺(tái),越來(lái)越多的手機(jī)用戶開始選擇使用移動(dòng)新聞客戶端來(lái)實(shí)時(shí)獲取新聞。目前市場(chǎng)上存在多款新聞客戶端APP,激烈的市場(chǎng)競(jìng)爭(zhēng)使得各家廠商在不斷優(yōu)化自身移動(dòng)新聞業(yè)務(wù)的同時(shí),還開始嘗試為用戶提供個(gè)性化的新聞推薦。業(yè)務(wù)的優(yōu)化離不開對(duì)于新聞服務(wù)數(shù)據(jù)的對(duì)比分析,而個(gè)性化推薦則需要從用戶使用新聞客戶端時(shí)的行為中分析用戶的偏好�？梢钥吹叫侣効蛻舳说陌l(fā)展離不開海量多維度數(shù)據(jù)的支持,因此收集新聞客戶端的業(yè)務(wù)日志并從中挖掘出有價(jià)值的信息便成為了一項(xiàng)非常有意義的工作。針對(duì)新聞客戶端設(shè)計(jì)的日志收集分析系統(tǒng)面臨著許多挑戰(zhàn),考慮到日志收集分析系統(tǒng)整體需要面臨的數(shù)據(jù)吞吐量,本系統(tǒng)采用了大量分布式框架來(lái)實(shí)現(xiàn)系統(tǒng)的各個(gè)功能,利用Flume、Kafka、Storm和HBase等分別實(shí)現(xiàn)了日志收集、緩存、傳輸、分析與存儲(chǔ)等功能,再考慮到日志收集分析系統(tǒng)在新聞客戶端業(yè)務(wù)中發(fā)揮的重要作用,系統(tǒng)還建設(shè)了完善的監(jiān)控模塊與數(shù)據(jù)展示模塊為業(yè)務(wù)人員提供實(shí)時(shí)的系統(tǒng)監(jiān)控與數(shù)據(jù)展示服務(wù)。本論文所闡述的解決方案來(lái)源于搜狐新聞移動(dòng)客戶端,從實(shí)際業(yè)務(wù)需求出發(fā)從研究背景、技術(shù)選擇、系統(tǒng)架構(gòu)等方面設(shè)計(jì)并實(shí)現(xiàn)了一套基于分布式框架的日志收集分析系統(tǒng),重點(diǎn)闡述了日志收集、日志分發(fā)、流式處理、系統(tǒng)監(jiān)控和數(shù)據(jù)展示等模塊。本文在實(shí)際開發(fā)的基礎(chǔ)上分析了系統(tǒng)的可靠性與實(shí)用性,提出了一套可行的移動(dòng)新聞客戶端日志收集分析方案,并展示了系統(tǒng)的部分功能界面。
[Abstract]:With the rapid development of smart phone and mobile Internet, the business of traditional news portal has been challenged by mobility and convenience. With its advantages of mobility and convenience, smart phone has developed into an important mass media. Become a new platform for media convergence, More and more mobile phone users choose to use the mobile news client to get news in real time. At present, there are many news clients in the market, and the fierce market competition makes each manufacturer optimize their mobile news business at the same time. It also tries to provide personalized news recommendation to users. Business optimization is inseparable from the comparative analysis of news service data. The personalized recommendation needs to analyze the user's preference from the user's behavior when using the news client. It can be seen that the development of the news client can not be separated from the support of massive multi-dimensional data. Therefore, collecting the business log of the news client and digging out the valuable information from it has become a very meaningful task. The log collection and analysis system designed for the news client faces many challenges. Considering the data throughput that the log collection and analysis system needs to face, this system adopts a large number of distributed framework to realize the various functions of the system, and uses Flumeer Kafka Storm and HBase to realize log collection, cache and transmission, respectively. Analysis and storage and other functions, and then considering the log collection and analysis system in news client business play an important role, The system also built a perfect monitoring module and data display module to provide real-time system monitoring and data display services for business personnel. The solution described in this paper comes from Sohu news mobile client. This paper designs and implements a set of log collection and analysis system based on distributed framework from the aspects of research background, technology selection, system architecture and so on, which focus on log collection, log distribution, flow processing, etc. This paper analyzes the reliability and practicability of the system, puts forward a set of feasible mobile news client log collection and analysis scheme, and shows some functional interfaces of the system.
【學(xué)位授予單位】：北京交通大學(xué)
【學(xué)位級(jí)別】：碩士
【學(xué)位授予年份】：2017
【分類號(hào)】：TP311.52

【參考文獻(xiàn)】

相關(guān)期刊論文 前10條

1 于秦;;基于Apache Flume的大數(shù)據(jù)日志收集系統(tǒng)[J];中國(guó)新通信;2016年18期

2 張永諾;孫華;孫子恒;;移動(dòng)APP的應(yīng)用與發(fā)展[J];電腦知識(shí)與技術(shù);2016年02期

3 李圣;黃永忠;陳海勇;;大數(shù)據(jù)流式計(jì)算系統(tǒng)研究綜述[J];信息工程大學(xué)學(xué)報(bào);2016年01期

4 王巖;王純;;一種基于Kafka的可靠的Consumer的設(shè)計(jì)方案[J];軟件;2016年01期

5 孟祥武;陳誠(chéng);張玉潔;;移動(dòng)新聞推薦技術(shù)及其應(yīng)用研究綜述[J];計(jì)算機(jī)學(xué)報(bào);2016年04期

6 李川;鄂海紅;宋美娜;;基于Storm的實(shí)時(shí)計(jì)算框架的研究與應(yīng)用[J];軟件;2014年10期

7 唐海東;武延軍;;分布式同步系統(tǒng)Zookeeper的優(yōu)化[J];計(jì)算機(jī)工程;2014年04期

8 盛銓;;基于Centos的Nginx Web服務(wù)器的構(gòu)建[J];福建電腦;2012年03期

9 詹玲;馬駿;陳伯江;陳維梁;呂睿;;分布式I/O日志收集系統(tǒng)的設(shè)計(jì)與實(shí)現(xiàn)[J];計(jì)算機(jī)工程與應(yīng)用;2010年36期

10 曹婧華;冉彥中;許志軍;;分布式消息隊(duì)列的設(shè)計(jì)與實(shí)現(xiàn)[J];河南科技大學(xué)學(xué)報(bào)(自然科學(xué)版);2010年04期

相關(guān)碩士學(xué)位論文 前4條

1 袁子淇;基于ZooKeeper的集群應(yīng)用配置管理的設(shè)計(jì)與實(shí)現(xiàn)[D];內(nèi)蒙古大學(xué);2015年

2 譚金金;我國(guó)門戶網(wǎng)站移動(dòng)新聞客戶端研究[D];河南大學(xué);2014年

3 章蕾;移動(dòng)新聞客戶端用戶評(píng)論賦權(quán)行為初探[D];廈門大學(xué);2014年

4 馮曉普;HBase存儲(chǔ)的研究與應(yīng)用[D];北京郵電大學(xué);2014年

，

本文編號(hào)：1610695