Effective methods and strategies for massive small files processing based on Hadoop

被引:0
|
作者
机构
[1] [1,Xia, Dawen
[2] Wang, Binfeng
[3] Rong, Zhuobo
[4] Li, Yantao
[5] 1,Zhang, Zili
来源
Zhang, Z. (zhangzl@swu.edu.cn) | 1935年 / ICIC Express Letters Office卷 / 08期
关键词
D O I
暂无
中图分类号
学科分类号
摘要
16
引用
收藏
相关论文
共 50 条
  • [21] A Review of Various Optimization Schemes of Small Files Storage on Hadoop
    Huang, Liang
    Liu, Jun
    Meng, Weixiu
    2018 37TH CHINESE CONTROL CONFERENCE (CCC), 2018, : 4500 - 4506
  • [22] A Novel Approach to Improve the Performance of Hadoop in Handling of Small Files
    Gohil, Parth
    Panchal, Bakul
    Dhobi, J. S.
    2015 IEEE INTERNATIONAL CONFERENCE ON ELECTRICAL, COMPUTER AND COMMUNICATION TECHNOLOGIES, 2015,
  • [23] Strategy of Storing and Accessing Small Web Log Files on Hadoop
    Ban, Qiucheng
    Jin, Zhengping
    PROCEEDINGS OF 2017 3RD IEEE INTERNATIONAL CONFERENCE ON COMPUTER AND COMMUNICATIONS (ICCC), 2017, : 1232 - 1235
  • [24] A KIND OF DISTRIBUTED FILE SYSTEM BASED ON MASSIVE SMALL FILES STORAGE
    Liu, Di
    Kuang, Shi-Jie
    2012 INTERNATIONAL CONFERENCE ON WAVELET ACTIVE MEDIA TECHNOLOGY AND INFORMATION PROCESSING (LCWAMTIP), 2012, : 394 - 397
  • [25] A Hadoop Processing Method for Massive Sensor Network Data Based on Internet of Things
    Yanxin Zhang
    International Journal of Wireless Information Networks, 2020, 27 : 299 - 306
  • [26] A Hadoop Processing Method for Massive Sensor Network Data Based on Internet of Things
    Zhang, Yanxin
    INTERNATIONAL JOURNAL OF WIRELESS INFORMATION NETWORKS, 2020, 27 (02) : 299 - 306
  • [27] GPU Computations on Hadoop Clusters for Massive Data Processing
    Chen, Wenbo
    Xu, Shungou
    Jiang, Hai
    Weng, Tien-Hsiung
    Marino, Mario Donato
    Chen, Yi-Siang
    Li, Kuan-Ching
    PROCEEDINGS OF THE 3RD INTERNATIONAL CONFERENCE ON INTELLIGENT TECHNOLOGIES AND ENGINEERING SYSTEMS (ICITES2014), 2016, 345 : 515 - 521
  • [28] Heterogeneity-based files placement in Hadoop cluster
    Ambade, Suhas V.
    Deshpande, Priya R.
    2015 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMMUNICATION NETWORKS (CICN), 2015, : 876 - 880
  • [29] Performance Evaluation of a MapReduce Hadoop-based Implementation for Processing Large Virtual Campus Log Files
    Xhafa, Fatos
    Garcia, Daniel
    Ramirez, Daniel
    Caballe, Santi
    2015 10TH INTERNATIONAL CONFERENCE ON P2P, PARALLEL, GRID, CLOUD AND INTERNET COMPUTING (3PGCIC), 2015, : 200 - 206
  • [30] Research on database massive data processing and mining method based on hadoop cloud platform
    Xiaoyong, Zhao
    Chunrong, Yang
    Open Automation and Control Systems Journal, 2014, 6 (01): : 1463 - 1467