Combiner to Reduce the Time of Processing in Trend Analysis using Hadoop's MapReduce Framework

被引:0
|
作者
Pinto, Vivek Francis [1 ]
机构
[1] NMAM Inst Technol, Dept Comp Sci & Engn, Karkala, India
关键词
Trend; Trend Analysis; Hadoop Mapper Reducer Framework; Combiner;
D O I
暂无
中图分类号
TP39 [计算机的应用];
学科分类号
081203 ; 0835 ;
摘要
Trend means to be one of the words, subjects, or names that is being mentioned most often on a social media website or a news website at a particular time or for a duration of time. It also means that a particular behaviour or method change done or being undertaken or followed by people may be individual or as a group. Taking the advantage of the fast phased processing technology helps in analysing the trends in the current times. Apache Hadoop frame work provides Mapper and Reducer which helps to mine the large amount of data and to help the business to plan their marketing tactics based on the trend. Further, using concept of Combiner, which is an important feature of Hadoop framework, immensely reduces the processing time and gives the mining results in less time compared to the one without Combiner, which reduces the entire processing time in bigger difference as the file size increases. The main motivation behind this research is that need of improved processing time of larger files, utilizing the Hadoop's available features.
引用
收藏
页码:166 / 169
页数:4
相关论文
共 50 条
  • [1] Scientific data processing framework for Hadoop MapReduce
    Department of Computer and Information, Xinxiang University, Xinxiang, China
    [J]. J. Chem. Pharm. Res., 6 (2950-2954):
  • [2] SmartGrids: MapReduce Framework using Hadoop
    Fanibhare, Vaibhav
    Dahake, Vijay
    [J]. 2016 3RD INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING AND INTEGRATED NETWORKS (SPIN), 2016, : 406 - 411
  • [3] Real-time digital forensic triaging for cloud data analysis using MapReduce on Hadoop framework
    Povar, Digambar
    Saibharath
    Geethakumari, G.
    [J]. INTERNATIONAL JOURNAL OF ELECTRONIC SECURITY AND DIGITAL FORENSICS, 2015, 7 (02) : 119 - 133
  • [4] Data Analysis using Hadoop MapReduce Environment
    Merla, PrathyushaRani
    Liang, Yiheng
    [J]. 2017 IEEE INTERNATIONAL CONFERENCE ON BIG DATA (BIG DATA), 2017, : 4783 - 4785
  • [5] Parallelized Genetic Operations for SBST using Hadoop MapReduce Framework
    Mayandi, Geethapriya
    Arumugam, Chamundeswari
    [J]. 2014 INTERNATIONAL CONFERENCE ON ADVANCED COMMUNICATION CONTROL AND COMPUTING TECHNOLOGIES (ICACCCT), 2014, : 1686 - 1691
  • [6] Framework for Analyzing Web Access Logs using Hadoop and MapReduce
    Borgaonkar, Pranjali
    Kumar, Gaurav
    Yaduwanshi, Jyoti
    [J]. 2018 INTERNATIONAL CONFERENCE ON RECENT INNOVATIONS IN ELECTRICAL, ELECTRONICS & COMMUNICATION ENGINEERING (ICRIEECE 2018), 2018, : 2124 - 2129
  • [7] An overview and an Approach for Graph Data Processing using Hadoop MapReduce
    Talan, Pooja P.
    Sharma, Kartik U.
    [J]. PROCEEDINGS OF THE 2ND INTERNATIONAL CONFERENCE ON COMPUTING METHODOLOGIES AND COMMUNICATION (ICCMC 2018), 2018, : 59 - 63
  • [8] Leveraging Hadoop Framework to develop Duplication Detector and analysis using MapReduce, Hive and Pig
    Sethi, Priyanka
    Kumar, Prakash
    [J]. 2014 SEVENTH INTERNATIONAL CONFERENCE ON CONTEMPORARY COMPUTING (IC3), 2014, : 454 - 460
  • [9] An approach for MapReduce based Log analysis using Hadoop
    Hingave, Hemant
    Ingle, Rasika
    [J]. 2015 2ND INTERNATIONAL CONFERENCE ON ELECTRONICS AND COMMUNICATION SYSTEMS (ICECS), 2015, : 1264 - 1268
  • [10] MapReduce Based Analysis of Sample Applications Using Hadoop
    Ghazi, Mohd Rehan
    Raghava, N. S.
    [J]. APPLICATIONS OF COMPUTING AND COMMUNICATION TECHNOLOGIES, ICACCT 2018, 2018, 899 : 34 - 44