The Optimization of Big Data Platform under the Internet of Things

被引：0
|
作者：
Wang, Suzhen [1 ]
Zhang, Yanpiao [1 ]
Zhang, Lu [1 ]
Cao, Ning [2 ]
机构：
[1] Hebei Univ Econ & Business, Sch Informat Technol, Shijiazhuang, Hebei, Peoples R China
[2] Univ Coll Dublin, Sch Comp Sci, Dublin, Ireland
来源：
2018 INTERNATIONAL CONFERENCE ON CYBER-ENABLED DISTRIBUTED COMPUTING AND KNOWLEDGE DISCOVERY (CYBERC 2018) | 2018年
关键词：
IOT; scheduling algorithm; Big Data;
D O I：
10.1109/CyberC.2018.00034
中图分类号：
TP301 [理论、方法];
学科分类号：
081202 ;
摘要：
The development of the Internet of things(IOT) has produced huge diversity of data. In view of the need for massive data processing and application by the Internet of things, the big data service platform arises at the historic moment. Our paper mainly studies the optimization of the big data platform in the background of Internet of things, and combines the Internet of things with the big data platform-Spark. In this paper, we proposed an improved Spark job scheduling scheme based on the genetic and tabu search algorithm. By optimizing the job scheduling algorithm of Spark, it will provide the better technical support for data processing in the Internet of things.
引用
收藏
页码：126 / 129
页数：4
相关论文
共 50 条
  • [21] Application of the Integration of the Internet of Things and Big Data
    Wang, Yingli
    [J]. PROCEEDINGS OF THE 2018 INTERNATIONAL CONFERENCE ON MECHANICAL, ELECTRONIC, CONTROL AND AUTOMATION ENGINEERING (MECAE 2018), 2018, 149 : 249 - 254
  • [22] Big Data Classification and Internet of Things in Healthcare
    Rghioui, Amine
    Lloret, Jaime
    Oumnad, Abedlmajid
    [J]. INTERNATIONAL JOURNAL OF E-HEALTH AND MEDICAL COMMUNICATIONS, 2020, 11 (02) : 20 - 37
  • [23] The Internet of Things and Big Data: Future Trends
    Carvalho, Goncalo
    Bernardino, Jorge
    [J]. 2017 12TH IBERIAN CONFERENCE ON INFORMATION SYSTEMS AND TECHNOLOGIES (CISTI), 2017,
  • [24] Deep Learning in Big Data and Internet of Things
    Tomar, Dimpal
    Tomar, Pradeep
    Kaur, Gurjit
    [J]. INFORMATION, COMMUNICATION AND COMPUTING TECHNOLOGY, ICICCT 2018, 2019, 835 : 70 - 81
  • [25] Big data, the Internet of things, and the interconnected society
    Liu, Yu-li
    Chou, Yuntsai Jessica
    [J]. TELECOMMUNICATIONS POLICY, 2018, 42 (04) : 277 - 281
  • [26] Big Sensed Data challenges in the Internet of Things
    Hassanein, Hossam S.
    Oteafy, Sharief M. A.
    [J]. 2017 13TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING IN SENSOR SYSTEMS (DCOSS), 2017, : 207 - 208
  • [27] The role of big data analytics in Internet of Things
    Ahmed, Ejaz
    Yaqoob, Ibrar
    Hashem, Ibrahim Abaker Targio
    Khan, Imran
    Ahmed, Abdelmuttlib Ibrahim Abdalla
    Imran, Muhammad
    Vasilakos, Athanasios V.
    [J]. COMPUTER NETWORKS, 2017, 129 : 459 - 471
  • [28] Applications of geospatial big data in the Internet of Things
    Silva, Dennis Savio
    Holanda, Maristela
    [J]. TRANSACTIONS IN GIS, 2022, 26 (01) : 41 - 71
  • [29] Image Processing Algorithm Design of Agricultural Internet of Things Platform Based on Big Data Analysis
    Sun, Han
    [J]. JOURNAL OF TESTING AND EVALUATION, 2024, 52 (03) : 1624 - 1635
  • [30] MNSSp3: Medical big data privacy protection platform based on Internet of things
    Wu, Xiang
    Zhang, Yongting
    Wang, Aming
    Shi, Minyu
    Wang, Huanhuan
    Liu, Lian
    [J]. NEURAL COMPUTING & APPLICATIONS, 2022, 34 (14): : 11491 - 11505
12345