A distributed data mining system framework for mobile internet access log based on hadoop

被引：0
|
作者：
Jiang, Yunliang [1 ,3 ]
Yang, Jiangang [3 ]
Tang, Liang [4 ]
Liu, Yong [2 ]
Zhao, Xiaoming [5 ]
Hao, Xiulan [1 ]
机构：
[1] School of Information Engineering, Huzhou University, Huzhou,313000, China
[2] National Laboratory of Industrial Control Technology, Zhejiang University, Hangzhou,310027, China
[3] School of Computer Science, Hangzhou Dianzi University, Hangzhou,310018, China
[4] China Ship Development and Design Center, Wuhan,430064, China
[5] School of Mathematics and Information Engineering, Taizhou University, Linhai,317000, China
来源：
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) | 2015年 / 8971卷
关键词：
Data mining - Blogs - Cellular telephones - Statistical tests;
D O I：
10.1007/978-3-662-48247-6_23
中图分类号：
学科分类号：
摘要：
Because of the popularity of mobile phone and the development of mobile network, mobile data is growing explosively. Mobile data mining is more and more of attention. But single node-based data mining platform has been unable to store and analysis the massive data. According to cloud computing technology, we preset a distributed data mining framework based on Hadoop. Then, we present the implementation of this system framework and process mobile internet access log on the Hadoop cluster. Comparative tests will show that this distributed system framework is significantly efficient for processing huge scale dataset. © Springer-Verlag Berlin Heidelberg 2015.
引用
收藏
页码：243 / 252
相关论文
共 50 条
  • [1] Research on Distributed Data Mining System Based on Hadoop Platform
    Guo, Jianwei
    Li, Ying
    Du, Liping
    Zhao, Guifen
    Jiang, Jiya
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND INFORMATION TECHNOLOGY (CSAIT 2013), 2014, 255 : 629 - 636
  • [2] A mobile agent based system for distributed database access on the Internet
    Yan, W
    2000 INTERNATIONAL CONFERENCE ON COMMUNICATION TECHNOLOGY PROCEEDINGS, VOLS. I & II, 2000, : 1587 - 1590
  • [3] A distributed and mobile data mining system
    Wang, F
    Na, HL
    Guo, Y
    Jin, H
    PARALLEL AND DISTRIBUTED COMPUTING, APPLICATIONS AND TECHNOLOGIES, PDCAT'2003, PROCEEDINGS, 2003, : 916 - 918
  • [4] Mass Log Data Processing and Mining Based on Hadoop and Cloud Computing
    Yu, Hongyong
    Wang, Deshuai
    PROCEEDINGS OF 2012 7TH INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE & EDUCATION, VOLS I-VI, 2012, : 197 - 202
  • [5] Big Data: Mining of Log File through Hadoop
    Kotiyal, Bina
    Kumar, Ankit
    Pant, Bhaskar
    Goudar, R. H.
    2013 INTERNATIONAL CONFERENCE ON HUMAN COMPUTER INTERACTIONS (ICHCI), 2013,
  • [6] Modern Framework for Distributed Healthcare Data Analytics Based on Hadoop
    Raja, P. Vignesh
    Sivasankar, E.
    INFORMATION AND COMMUNICATION TECHNOLOGY, 2014, 8407 : 348 - 355
  • [7] Mobile agent based distributed data mining
    Kulkarni, U. P.
    Desai, P. D.
    Ahmed, Tanveer
    Vadavi, J. V.
    Yardi, A. R.
    ICCIMA 2007: INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND MULTIMEDIA APPLICATIONS, VOL II, PROCEEDINGS, 2007, : 18 - +
  • [8] TREST: A Hadoop Based Distributed Mobile Trajectory Retrieval System
    Lv, Jianming
    Wang, Xintong
    Huang, Fengtao
    Yang, Junjie
    Wu, Tianfeng
    Yan, Qifa
    2016 IEEE FIRST INTERNATIONAL CONFERENCE ON DATA SCIENCE IN CYBERSPACE (DSC 2016), 2016, : 341 - 346
  • [9] Hadoop based Mining of Distributed Association Rules from Big Data
    Bouraoui, Marwa
    Bouzouita, Ines
    Touzi, Amel Grissa
    2017 18TH INTERNATIONAL CONFERENCE ON SCIENCES AND TECHNIQUES OF AUTOMATIC CONTROL AND COMPUTER ENGINEERING (STA), 2017, : 185 - 190
  • [10] Distributed Data Platform System Based on Hadoop Platform
    Guo, Jianwei
    Du, Liping
    Li, Ying
    Zhao, Guifen
    Jiya, Jiang
    PROCEEDINGS OF INTERNATIONAL CONFERENCE ON COMPUTER SCIENCE AND INFORMATION TECHNOLOGY (CSAIT 2013), 2014, 255 : 533 - 539
12345