A distributed data mining system framework for mobile internet access log based on hadoop

被引：0
|
作者：
Jiang, Yunliang [1 ,3 ]
Yang, Jiangang [3 ]
Tang, Liang [4 ]
Liu, Yong [2 ]
Zhao, Xiaoming [5 ]
Hao, Xiulan [1 ]
机构：
[1] School of Information Engineering, Huzhou University, Huzhou,313000, China
[2] National Laboratory of Industrial Control Technology, Zhejiang University, Hangzhou,310027, China
[3] School of Computer Science, Hangzhou Dianzi University, Hangzhou,310018, China
[4] China Ship Development and Design Center, Wuhan,430064, China
[5] School of Mathematics and Information Engineering, Taizhou University, Linhai,317000, China
来源：
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) | 2015年 / 8971卷
关键词：
Data mining - Blogs - Cellular telephones - Statistical tests;
D O I：
10.1007/978-3-662-48247-6_23
中图分类号：
学科分类号：
摘要：
Because of the popularity of mobile phone and the development of mobile network, mobile data is growing explosively. Mobile data mining is more and more of attention. But single node-based data mining platform has been unable to store and analysis the massive data. According to cloud computing technology, we preset a distributed data mining framework based on Hadoop. Then, we present the implementation of this system framework and process mobile internet access log on the Hadoop cluster. Comparative tests will show that this distributed system framework is significantly efficient for processing huge scale dataset. © Springer-Verlag Berlin Heidelberg 2015.
引用
收藏
页码：243 / 252
相关论文
共 50 条
  • [21] Design of a Log Analysis System Based on Hadoop
    Li, Jingmin
    INDUSTRIAL ENGINEERING, MACHINE DESIGN AND AUTOMATION (IEMDA 2014) & COMPUTER SCIENCE AND APPLICATION (CCSA 2014), 2015, : 249 - 256
  • [22] Log Pattern Mining for Distributed System Maintenance
    Chen, Jia
    Wang, Peng
    Du, Shiqing
    Wang, Wei
    COMPLEXITY, 2020, 2020
  • [23] A distributed data mining system for a novel ubiquitous healthcare framework
    Viswanathan, M.
    Whangbo, T. K.
    Lee, K. J.
    Yang, Y. K.
    COMPUTATIONAL SCIENCE - ICCS 2007, PT 3, PROCEEDINGS, 2007, 4489 : 701 - +
  • [24] Financial Fund Investment System Based on Hadoop and Data Mining Technology
    Wang, Xixuan
    Zhang, Yaohua
    Meng, Ziru
    Liu, Hailong
    2021 6TH INTERNATIONAL CONFERENCE ON SMART GRID AND ELECTRICAL AUTOMATION (ICSGEA 2021), 2021, : 212 - 215
  • [25] Study on Geography Information OLAP and Data Mining System Based On Hadoop
    Yu, Jun
    Pang, Hengmao
    Mei, Zhu
    Song, Debing
    Zhu, Guangxin
    Chen, Haiyang
    Wang, Lin
    2018 4TH INTERNATIONAL CONFERENCE ON ENVIRONMENTAL SCIENCE AND MATERIAL APPLICATION, 2019, 252
  • [26] A secure data access method based on eID for mobile Internet
    Yang, M. H.
    Yao, J. J.
    Liu, Z. X.
    Manufacturing and Engineering Technology, 2015, : 405 - 408
  • [27] The Research on Distributed Data Stream Mining based on Mobile Agent
    Yue Fuqiang
    PEEA 2011, 2011, 23
  • [28] Mobile Agent and Distributed Data Mining
    Patel, Darshana
    Shah, J. S.
    PROCEEDINGS OF THE 2016 2ND INTERNATIONAL CONFERENCE ON APPLIED AND THEORETICAL COMPUTING AND COMMUNICATION TECHNOLOGY (ICATCCT), 2016, : 548 - 550
  • [29] Intrusion Detection System Based on data mining for Host Log
    Zhu, Ming
    Huang, ZiLi
    2017 IEEE 2ND ADVANCED INFORMATION TECHNOLOGY, ELECTRONIC AND AUTOMATION CONTROL CONFERENCE (IAEAC), 2017, : 1742 - 1746
  • [30] Malware Detection System Based on API Log Data Mining
    Fan, Chun-I
    Hsiao, Han-Wei
    Chou, Chun-Han
    Tseng, Yi-Fan
    IEEE 39TH ANNUAL COMPUTER SOFTWARE AND APPLICATIONS CONFERENCE WORKSHOPS (COMPSAC 2015), VOL 3, 2015, : 255 - 260
12345