The Optimization of Big Data Platform under the Internet of Things

被引：0

作者：

Wang, Suzhen ^{[1
]}

Zhang, Yanpiao ^{[1
]}

Zhang, Lu ^{[1
]}

Cao, Ning ^{[2
]}

机构：

[1] Hebei Univ Econ & Business, Sch Informat Technol, Shijiazhuang, Hebei, Peoples R China

[2] Univ Coll Dublin, Sch Comp Sci, Dublin, Ireland

来源：

2018 INTERNATIONAL CONFERENCE ON CYBER-ENABLED DISTRIBUTED COMPUTING AND KNOWLEDGE DISCOVERY (CYBERC 2018) | 2018年

关键词：

IOT; scheduling algorithm; Big Data;

D O I：

10.1109/CyberC.2018.00034

中图分类号：

TP301 [理论、方法];

学科分类号：

081202 ;

摘要：

The development of the Internet of things(IOT) has produced huge diversity of data. In view of the need for massive data processing and application by the Internet of things, the big data service platform arises at the historic moment. Our paper mainly studies the optimization of the big data platform in the background of Internet of things, and combines the Internet of things with the big data platform-Spark. In this paper, we proposed an improved Spark job scheduling scheme based on the genetic and tabu search algorithm. By optimizing the job scheduling algorithm of Spark, it will provide the better technical support for data processing in the Internet of things.

引用

页码：126 / 129

页数：4

共 50 条

[1] An Agricultural Data Gathering Platform Based on Internet of Things and Big Data
Chang, Hsi-Yuan
Wang, Jyun-Jie
Lin, Chi-Yuan
Chen, Chin-Hsing
[J]. 2018 INTERNATIONAL SYMPOSIUM ON COMPUTER, CONSUMER AND CONTROL (IS3C 2018), 2018, : 302 - 305
[2] Big data and the internet of things
Tom Breur
[J]. Journal of Marketing Analytics, 2015, 3 (1) : 1 - 4
[3] 'BIG DATA', THE 'INTERNET OF THINGS' AND THE 'INTERNET OF SIGNS'
O'Leary, Daniel E.
[J]. INTELLIGENT SYSTEMS IN ACCOUNTING FINANCE & MANAGEMENT, 2013, 20 (01): : 53 - 65
[4] Research on Optimization of Intelligent Traffic Dispatching Algorithms Based on Big Data in Chinese Urban Internet of Things Platform
Liu, Ying
[J]. MATHEMATICAL PROBLEMS IN ENGINEERING, 2022, 2022
[5] Research on Remote Monitoring and Control of Big Data Platform Based on Internet of Things
Zhu, Jianmiao
Fang, Yunzhong
Jiang, Chenghang
Hu, Siyuan
[J]. PROCEEDINGS OF THE 7TH ANNUAL MEETING OF RISK ANALYSIS COUNCIL OF CHINA ASSOCIATION FOR DISASTER PREVENTION, 2016, 128 : 870 - 876
[6] Research on the Deployment Strategy of Big Data Visualization Platform by the Internet of Things Technology
Zhang, Guangtao
[J]. EAI ENDORSED TRANSACTIONS ON SCALABLE INFORMATION SYSTEMS, 2023, 10 (04): : 1 - 11
[7] Big data fusion in Internet of Things
Yan, Zheng
Liu, Jun
Yang, Laurence T.
Chawla, Nitesh
[J]. INFORMATION FUSION, 2018, 40 : 32 - +
[8] Big Data for Internet of Things: A Survey
Ge, Mouzhi
Bangui, Hind
Buhnova, Barbora
[J]. FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 87 : 601 - 614
[9] Big Sensed Data in the Internet of Things
Hassanein, Hossam
[J]. PROCEEDINGS OF 2016 11TH INTERNATIONAL CONFERENCE ON COMPUTER ENGINEERING & SYSTEMS (ICCES), 2016, : XX - XX
[10] INTERNET Of THINGS AND Big DATA - CHALLENGES
Kaul, Lubhna
Goudar, R. H.
[J]. PROCEEDINGS OF 2016 ONLINE INTERNATIONAL CONFERENCE ON GREEN ENGINEERING AND TECHNOLOGIES (IC-GET), 2016,

← 1 2 3 4 5 →