Scalable Quick Reduct Algorithm - Iterative MapReduce Approach

被引:1
|
作者
Singh, Praveen Kumar [1 ]
Prasad, P. S. V. S. Sai [2 ]
机构
[1] Tata Consultancy Serv India, Hyderabad, Andhra Pradesh, India
[2] Univ Hyderabad, Sch Comp & Informat Sci, Hyderabad, Telangana, India
关键词
Rough sets; Reduct; Parallel/ Distributed Algorithms; Granular Computing; Twister; In_MRQRA; Iterative MapReduce; ATTRIBUTE REDUCTION;
D O I
10.1145/2888451.2888476
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Feature selection by reduct computation is the key technique for knowledge acquistion using rough set theory. Existing MapReduce based reduct algorithms use Hadoop Map Reduce framework, which is not suitable for iterative algorithms. Paper aims to design and implementation of Iterative MapReduce based Quick reduct algorithm using Twister framework. The proposed In MRQRA Algorithm has partial granular level computations at mappers and granular computations at reducer. Experimental analysis on KDD-Cup99 dataset empirically established the relevence of proposed approach.
引用
收藏
页数:2
相关论文
共 50 条
  • [1] Scalable IQRA IG Algorithm: An Iterative MapReduce Approach for Reduct Computation
    Prasad, P. S. V. S. Sai
    Subrahmanyam, H. Bala
    Singh, Praveen Kumar
    DISTRIBUTED COMPUTING AND INTERNET TECHNOLOGY, (ICDCIT 2017), 2017, 10109 : 58 - 69
  • [2] Hashing Supported Iterative MapReduce Based Scalable SBE Reduct Computation
    Divya, U. Venkata
    Prasad, P. S. V. S. Sai
    DISTRIBUTED COMPUTING AND INTERNET TECHNOLOGY (ICDCIT 2018), 2018, 10722 : 163 - 170
  • [3] MapReduce based improved quick reduct algorithm with granular refinement using vertical partitioning scheme
    Sowkuntla, Pandu
    Prasad, P. S. V. S. Sai
    KNOWLEDGE-BASED SYSTEMS, 2020, 189
  • [4] IQuickReduct: An Improvement to Quick Reduct Algorithm
    Prasad, P. S. V. S. Sai
    Rao, C. Raghavendra
    ROUGH SETS, FUZZY SETS, DATA MINING AND GRANULAR COMPUTING, PROCEEDINGS, 2009, 5908 : 152 - 159
  • [5] MapReduce Implementation for Minimum Reduct Using Parallel Genetic Algorithm
    Alshammari, Mashaan A.
    El-Alfy, El-Sayed M.
    2015 6TH INTERNATIONAL CONFERENCE ON INFORMATION AND COMMUNICATION SYSTEMS (ICICS), 2015, : 13 - 18
  • [6] Quick attribute reduct algorithm for neighborhood rough set model
    Liu Yong
    Huang Wenliang
    Jiang Yunliang
    Zeng Zhiyong
    INFORMATION SCIENCES, 2014, 271 : 65 - 81
  • [7] Unsupervised Quick Reduct Algorithm Using Rough Set Theory
    C. Velayutham
    K. Thangavel
    Journal of Electronic Science and Technology, 2011, 9 (03) : 193 - 201
  • [8] Scalable Collaborative Filtering Recommendation Algorithm with MapReduce
    Shang, Yang
    Li, Zhiyang
    Qu, Wenyu
    Xu, Yujie
    Song, Zining
    Zhou, Xuefei
    2014 IEEE 12TH INTERNATIONAL CONFERENCE ON DEPENDABLE, AUTONOMIC AND SECURE COMPUTING (DASC)/2014 IEEE 12TH INTERNATIONAL CONFERENCE ON EMBEDDED COMPUTING (EMBEDDEDCOM)/2014 IEEE 12TH INTERNATIONAL CONF ON PERVASIVE INTELLIGENCE AND COMPUTING (PICOM), 2014, : 103 - 108
  • [9] A Scalable Approach for Improving Implementation of a Frequent Pattern Mining Algorithm using MapReduce Programming
    Hasan, Md Abed
    Hassan, Naima
    Hasibuzzaman, Md
    Huq, Mohammad Rezwanul
    2019 5TH INTERNATIONAL CONFERENCE ON SCIENCE ININFORMATION TECHNOLOGY (ICSITECH): EMBRACING INDUSTRY 4.0 - TOWARDS INNOVATION IN CYBER PHYSICAL SYSTEM, 2019, : 106 - 111
  • [10] Classification rule discovery with ant colony optimization and improved quick reduct algorithm
    Jaganathan, P.
    Thangavel, K.
    Pethalakshmi, A.
    Karnan, A.
    IMECS 2006: INTERNATIONAL MULTICONFERENCE OF ENGINEERS AND COMPUTER SCIENTISTS, 2006, : 286 - +