Optimization and Application in Medical Big Document-Data of Apriori Algorithm based on MapReduce

被引：0

作者：

Li Wei ^{[1
]}

Liu Guangming ^{[1
]}

Shao Yachao ^{[2
]}

Liu Junlong ^{[2
]}

Zuo You ^{[2
]}

机构：

[1] Natl Univ Def Technol, Changsha, Hunan, Peoples R China

[2] Natl Supercomp Ctr Tianjin, Tianjin, Peoples R China

来源：

2016 INTERNATIONAL CONFERENCE ON COMPUTER COMMUNICATION AND INFORMATICS (ICCCI) | 2016年

关键词：

component; Medical big data; NoSQL; MapReduce; Data Mining; Apriori; optimization;

D O I：

暂无

中图分类号：

TP39 [计算机的应用];

学科分类号：

081203 ; 0835 ;

摘要：

For the challenges of redundancy, multi-dimension, complex and heterogeneous in medical documents, and to solve the problem that the value hidden in the huge amounts of medical document-data can't be mined, this paper proposed a system called MSPM based on NOSQL and MapReduce. Through storage of key-value pairs, complex and heterogeneous datas are summed up in a unified and convenient format of transaction for Apriori. Then Apriori is executed in parallel through MapReduce. At last, with the strategies of generating all the candidate sets non-recursively and constraint count for candidate sets of interest, it can solve the problem of low speed, high overhead and poor effectiveness for Apriori algorithm in the application of medical data. Testing results has shown the algorithm of optimization is available.

引用

页数：5

共 50 条

[31] Application of Landscape Design Optimization Algorithm Based on Big Data in CAD Platform
Qu Z.
Di W.
Computer-Aided Design and Applications, 2024, 21 (S21): : 19 - 36
[32] Big data analysis on medical field for drug recommendation using apriori algorithm and deep learning
Dasgupta, Sarbani
Saha, Banani
MULTIMEDIA TOOLS AND APPLICATIONS, 2024, 83 (35) : 83029 - 83051
[33] A Big Graph Clustering Algorithm Based on MapReduce
Leng, Yonglin
Zhang, Qingchen
MODERN TECHNOLOGIES IN MATERIALS, MECHANICS AND INTELLIGENT SYSTEMS, 2014, 1049 : 1467 - +
[34] In-Mapper combiner based MapReduce algorithm for processing of big climate data
Manogaran, Gunasekaran
Lopez, Daphne
Chilamkurti, Naveen
FUTURE GENERATION COMPUTER SYSTEMS-THE INTERNATIONAL JOURNAL OF ESCIENCE, 2018, 86 : 433 - 445
[35] Toward Conceptual MapReduce Algorithm for Big Data Platfrom
Sohn, Seungdae
Kim, Jinhong
2015 INTERNATIONAL CONFERENCE ON COMPUTATIONAL INTELLIGENCE AND COMMUNICATION NETWORKS (CICN), 2015, : 985 - 988
[36] An Enhanced Apriori Algorithm Using Hybrid Data Layout Based on Hadoop for Big Data Processing
Rochd, Yassir
Hafidi, Imad
INTERNATIONAL JOURNAL OF COMPUTER SCIENCE AND NETWORK SECURITY, 2018, 18 (06): : 161 - 167
[37] Big data classification with optimization driven MapReduce framework
Mohammed, Mujeeb Shaik
Rachapudy, Praveen Sam
Kasa, Madhavi
INTERNATIONAL JOURNAL OF KNOWLEDGE-BASED AND INTELLIGENT ENGINEERING SYSTEMS, 2021, 25 (02) : 173 - 183
[38] An Improved Parallel Association Rules Algorithm Based on MapReduce Framework for Big Data
Zhou, Xinhao
Huang, Yongfeng
2014 11TH INTERNATIONAL CONFERENCE ON FUZZY SYSTEMS AND KNOWLEDGE DISCOVERY (FSKD), 2014, : 284 - 288
[39] The method and application of big data mining formobile trajectory of taxi based on MapReduce
Kong, Fansheng
Lin, Xiaola
CLUSTER COMPUTING-THE JOURNAL OF NETWORKS SOFTWARE TOOLS AND APPLICATIONS, 2019, 22 (Suppl 5): : 11435 - 11442
[40] The Application Characteristics of Traditional Chinese Medical Science Treatment on Headache Based on Data-Mining Apriori Algorithm
Wang, Miao
Zhang, Lei
Zhang, Zihao
Xu, Chen
Chen, Guobin
Shang, Huiliang
Li, Xujun
2014 IEEE INTERNATIONAL CONFERENCE ON BIOINFORMATICS AND BIOMEDICINE (BIBM), 2014,

← 1 2 3 4 5 →