Distributed processing from large scale sensor network using Hadoop

被引:2
|
作者
Pereira, Rosangela de Fatima [1 ]
de Andrade, Marcelo Risse [1 ]
Zucchi, Artur Carvalho [1 ]
Langona, Karen [1 ]
Goya, Walter Akio [1 ]
Gonzalez, Nelson Mimura [1 ]
Melo Brito de Carvalho, Tereza Cristina [1 ]
Mangs, Jan-Erik [2 ]
Sefidcon, Azimeh [2 ]
机构
[1] Univ Sao Paulo, Escola Politecn, Lab Comp Networks & Architecture, BR-05508 Sao Paulo, Brazil
[2] Ericsson Res, Stockholm, Sweden
关键词
sensor network; cloud computing; Hadoop;
D O I
10.1109/BigData.Congress.2013.64
中图分类号
TP301 [理论、方法];
学科分类号
081202 ;
摘要
Big data refers to large amounts of data, normally in unstructured forms, such as text, sensor data, audio, video, log files, and more. When collecting from a large number of nodes, sensor networks can produce large data sets. Climate and sensor network data are applied to assist the decision making process in agricultural production. In this paper we present the main aspects of a prototype to test Hadoop framework applied to process climate related data sets in a cloud computing infrastructure.
引用
收藏
页码:417 / +
页数:2
相关论文
共 50 条
  • [1] Hadoop-EDF: Large-scale Distributed Processing of Electrophysiological Signal Data in Hadoop MapReduce
    Wu, Yuanyuan
    Li, Xiaojin
    Liu, Jinze
    Cui, Licong
    [J]. 2019 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2019, : 2265 - 2271
  • [2] Dependable large scale behavioral patterns mining from sensor data using Hadoop platform
    Rashid, Md. Mamunur
    Gondal, Iqbal
    Kamruzzaman, Joarder
    [J]. INFORMATION SCIENCES, 2017, 379 : 128 - 145
  • [3] Large Scale Image Dataset Construction Using Distributed Crawling with Hadoop YARN
    Ali, Asmat
    Ali, Rahman
    Khattak, Asad Masood
    Aslam, Muhammad Saqlain
    [J]. 2018 JOINT 10TH INTERNATIONAL CONFERENCE ON SOFT COMPUTING AND INTELLIGENT SYSTEMS (SCIS) AND 19TH INTERNATIONAL SYMPOSIUM ON ADVANCED INTELLIGENT SYSTEMS (ISIS), 2018, : 394 - 399
  • [4] Distributed processing of biological interactions using Hadoop
    Auer, Bence
    Antal, Balint
    [J]. 2015 6TH IEEE INTERNATIONAL CONFERENCE ON COGNITIVE INFOCOMMUNICATIONS (COGINFOCOM), 2015, : 175 - 178
  • [5] Distributed Image Processing Using Hadoop and HIPI
    Arsh, Swapnil
    Bhatt, Abhishek
    Kumar, Praveen
    [J]. 2016 INTERNATIONAL CONFERENCE ON ADVANCES IN COMPUTING, COMMUNICATIONS AND INFORMATICS (ICACCI), 2016, : 2673 - 2676
  • [6] Hadoop Processing Methods for Large Scale Video Data
    Wu, Guangzhi
    [J]. IEEE Access, 2024, 12 : 176247 - 176258
  • [7] Large Scale Distributed Data Processing for a Network of Humanoid Telepresence Robots
    Cardenas, Irvin Steve
    Paladugula, Pradeep Kumar
    Kim, Jong-Hoon
    [J]. 2020 IEEE INTERNATIONAL IOT, ELECTRONICS AND MECHATRONICS CONFERENCE (IEMTRONICS 2020), 2020, : 136 - 144
  • [8] THE DUAL BACKBONE NETWORK - DISTRIBUTED AND PARALLEL PROCESSING ON A LARGE-SCALE
    ENDRIZZI, A
    [J]. COMPUTER NETWORKS AND ISDN SYSTEMS, 1987, 14 (2-5): : 373 - 381
  • [9] Distributed sensor network data fusion using image processing
    Elmusrati, M
    Jäntti, R
    Koivo, H
    [J]. 2005 Systems Communications, Proceedings: ICW 2005, WIRELESS TECHNOLOGIES; ICHSN 2005, HIGH SPEED NETWORKS; ICMCS 2005, MULTIMEDIA COMMUNICATIONS SYSTEMS; SENET 2005, SENSOR NETWORKS, 2005, : 383 - 388
  • [10] MIPr - a Framework for Distributed Image Processing Using Hadoop
    Sozykin, Andrey
    Epanchintsev, Timofei
    [J]. 2015 9TH INTERNATIONAL CONFERENCE ON APPLICATION OF INFORMATION AND COMMUNICATION TECHNOLOGIES (AICT), 2015, : 35 - 39