REAL-TIME BIG DATA ANALYTICS FRAMEWORK WITH DATA BLENDING APPROACH FOR MULTIPLE DATA SOURCES IN SMART CITY APPLICATIONS

被引:5
|
作者
Manjunatha, S. [1 ]
Annappa, B. [1 ]
机构
[1] Natl Inst Technol Karnataka Surathkal, Dept Comp Sci & Engn, Mangalore 575025, India
来源
关键词
Big Data; Data blending; Preprocessing; Real time analytics; Public safety; Smart city; EVENT DETECTION;
D O I
10.12694/scpe.v21i4.1759
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Advancement in Information Communication Technology (ICT) and the Internet of Things (IoT) has to lead to the continuous generation of a large amount of data. Smart city projects are being implemented in various parts of the world where analysis of public data helps in providing a better quality of life. Data analytics plays a vital role in many such data-driven applications. Real-time analytics for finding valuable insights at the right time using smart city data is crucial in making appropriate decisions for city administration. It is essential to use multiple data sources as input for the analysis to achieve better and more accurate data-driven solutions. It helps in finding more accurate solutions and making appropriate decisions. Public safety is one of the major concerns in any smart city project in which real-time analytics is much useful in the early detection of valuable data patterns. It is crucial to find early predictions of crime-related incidents and generating emergency alerts for making appropriate decisions to provide security to the people and safety of the city infrastructure. This paper discusses the proposed real-time big data analytics framework with data blending approach using multiple data sources for smart city applications. Analytics using multiple data sources for a specific data-driven solution helps in finding more data patterns, which in turn increases the accuracy of analytics results. The data preprocessing phase is a challenging task in data analytics when data being ingested continuously in real-time into the analytics system. The proposed system helps in the preprocessing of real-time data with data blending of multiple data sources used in the analytics. The proposed framework is beneficial when data from multiple sources are ingested in real-time as input data and is also flexible to use any additional data source of interest. The experimental work carried out with the proposed framework using multiple data sources to find the crime-related insights in real-time helps the public safety solutions in the smart city. The experimental outcome shows that there is a significant increase in the number of identified useful data patterns as the number of data sources increases. A real-time based emergency alert system to help the public safety solution is implemented using a machine learning-based classification algorithm with the proposed framework. The experiment is carried out with different classification algorithms, and the results show that Naive Bayes classification performs better in generating emergency alerts.
引用
收藏
页码:611 / 623
页数:13
相关论文
共 50 条
  • [41] Near real-time big-data processing for data driven applications
    Kampars, Janis
    Grabis, Janis
    [J]. 2017 3RD INTERNATIONAL CONFERENCE ON BIG DATA INNOVATIONS AND APPLICATIONS (INNOVATE-DATA), 2017, : 35 - 42
  • [42] Big Data Real-Time Clickstream Data Ingestion Paradigm for E-Commerce Analytics
    Pal, Gautam
    Li, Gangmin
    Atkinson, Katie
    [J]. 2018 4TH INTERNATIONAL CONFERENCE FOR CONVERGENCE IN TECHNOLOGY (I2CT), 2018,
  • [43] Data Systems Fault Coping for Real-time Big Data Analytics Required Architectural Crucibles
    Cohen, Stephen
    Money, William
    [J]. PROCEEDINGS OF THE 50TH ANNUAL HAWAII INTERNATIONAL CONFERENCE ON SYSTEM SCIENCES, 2017, : 1023 - 1032
  • [44] Mapping the Big Data Landscape: Technologies, Platforms and Paradigms for Real-Time Analytics of Data Streams
    Dubuc, Timothee
    Stahl, Frederic
    Roesch, Etienne B.
    [J]. IEEE ACCESS, 2021, 9 : 15351 - 15374
  • [45] Real time data analytics platform for power grid smart applications
    Akram, Nihla
    De Silva, Sanjaya
    Foti, Magda
    Jayasinghe, Malith
    Dayarathna, Miyuru
    Vavalis, Manolis
    Perera, Srinath
    [J]. 2017 14TH INTERNATIONAL CONFERENCE ON THE EUROPEAN ENERGY MARKET (EEM 17), 2017,
  • [46] GPGPU for Real-Time Data Analytics
    He, Bingsheng
    Huynh Phung Huynh
    Mong, Rick Goh Siow
    [J]. PROCEEDINGS OF THE 2012 IEEE 18TH INTERNATIONAL CONFERENCE ON PARALLEL AND DISTRIBUTED SYSTEMS (ICPADS 2012), 2012, : 945 - +
  • [47] Improved Big Data Analytics Solution Using Deep Learning Model and Real-Time Sentiment Data Analysis Approach
    Chen, Chun-I Philip
    Zheng, Jiangbin
    [J]. ADVANCES IN BRAIN INSPIRED COGNITIVE SYSTEMS, BICS 2018, 2018, 10989 : 579 - 588
  • [48] Design and Implementation of Smart Environment Monitoring and Analytics in Real-Time System Framework Based on Internet of Underwater Things and Big Data
    Berlian, Muhammad Herwindra
    Sahputra, Tegar Esa Rindang
    Ardi, Buyung Jofi Wahana
    Dzatmika, Luhung Wahya
    Besari, Adnan Rachmat Anom
    Sudibyo, Rahardhita Widyatra
    Sukaridhoto, Sritrusta
    [J]. 2016 INTERNATIONAL ELECTRONICS SYMPOSIUM (IES), 2016, : 403 - 408
  • [49] Big data analytics on social networks for real-time depression detection
    Angskun, Jitimon
    Tipprasert, Suda
    Angskun, Thara
    [J]. JOURNAL OF BIG DATA, 2022, 9 (01)
  • [50] Engineering Scalable Distributed Services for Real-Time Big Data Analytics
    Jambi, Sahar
    Anderson, Kenneth M.
    [J]. 2017 THIRD IEEE INTERNATIONAL CONFERENCE ON BIG DATA COMPUTING SERVICE AND APPLICATIONS (IEEE BIGDATASERVICE 2017), 2017, : 131 - 140