CBMR: An optimized MapReduce for item-based collaborative filtering recommendation algorithm with empirical analysis

被引:19
|
作者
Li, Chenyang [1 ]
He, Kejing [1 ]
机构
[1] South China Univ Technol, Sch Comp Sci & Engn, Guangzhou 510641, Guangdong, Peoples R China
来源
基金
中国国家自然科学基金;
关键词
collaborative filtering; empirical analysis; MapReduce; scalability; shuffle phase overhead;
D O I
10.1002/cpe.4092
中图分类号
TP31 [计算机软件];
学科分类号
081202 ; 0835 ;
摘要
Item-based collaborative filtering (CF) is amodel-based algorithm for making recommendations. In the algorithm, the similarity between items are calculated by using a number of similarity measures, and then these similarity values are used to predict ratings for users. However, if the number of items and users grows to millions, the scalability and the processing efficiency of item-based CF can be hindered by some hardware constraints. To solve this problem, we propose an optimized MapReduce for item-based CF algorithm integrated with empirical analysis. Through extensive experiments on real-world datasets, we demonstrate the advantages of our approach by evaluating its execution time and by comparing its shuffle phase overhead with the conventional methods. The experimental results suggest that our approach has better performance when processing large-scale datasets.
引用
收藏
页数:7
相关论文
共 50 条
  • [1] AN OPTIMIZED ITEM-BASED COLLABORATIVE FILTERING RECOMMENDATION ALGORITHM
    Zhang, Jinbo
    Lin, Zhiqing
    Xiao, Bo
    Zhang, Chuang
    [J]. 2009 IEEE INTERNATIONAL CONFERENCE ON NETWORK INFRASTRUCTURE AND DIGITAL CONTENT, PROCEEDINGS, 2009, : 414 - 418
  • [2] An optimized item-based collaborative filtering algorithm
    Ajaegbu, Chigozirim
    [J]. JOURNAL OF AMBIENT INTELLIGENCE AND HUMANIZED COMPUTING, 2021, 12 (12) : 10629 - 10636
  • [3] An optimized item-based collaborative filtering algorithm
    Chigozirim Ajaegbu
    [J]. Journal of Ambient Intelligence and Humanized Computing, 2021, 12 : 10629 - 10636
  • [4] Enhanced prediction algorithm for item-based collaborative filtering recommendation
    Kim, Heung-Nam
    Ji, Ae-Ttie
    Jo, Geun-Sik
    [J]. E-COMMERCE AND WEB TECHNOLOGIES, PROCEEDINGS, 2006, 4082 : 41 - 50
  • [5] Pipeline Item-based Collaborative Filtering based on MapReduce
    Zhao, Zhi-Lin
    Wang, Chang-Dong
    Wan, Yuan-Yu
    Huang, Zi-Wei
    Lai, Jian-Huang
    [J]. PROCEEDINGS 2015 IEEE FIFTH INTERNATIONAL CONFERENCE ON BIG DATA AND CLOUD COMPUTING BDCLOUD 2015, 2015, : 9 - 14
  • [6] Userrank for item-based collaborative filtering recommendation
    Gao, Min
    Wu, Zhongfu
    Jiang, Feng
    [J]. INFORMATION PROCESSING LETTERS, 2011, 111 (09) : 440 - 446
  • [7] Research on personalized recommendation system on Item-based collaborative filtering algorithm
    Zhao, Ji-chun
    Liu, Shi-hong
    Zhang, Junfeng
    [J]. PROCEEDINGS OF THE INTERNATIONAL CONFERENCE ON ADVANCES IN MECHANICAL ENGINEERING AND INDUSTRIAL INFORMATICS, 2015, 15 : 338 - 342
  • [8] An Improved Item-based Collaborative Filtering Recommendation System
    Yao, Lan-jun
    Shang, Li-hong
    Zhou, Mi
    [J]. INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND COMPUTER SCIENCE (AICS 2016), 2016, : 315 - 320
  • [9] Item-Based Collaborative Filtering in Movie Recommendation in Real time
    Kharita, Mukesh Kumar
    Kumar, Atul
    Singh, Pardeep
    [J]. 2018 FIRST INTERNATIONAL CONFERENCE ON SECURE CYBER COMPUTING AND COMMUNICATIONS (ICSCCC 2018), 2018, : 340 - 342
  • [10] An Item-based Collaborative Filtering Recommendation Algorithm Using Slope One Scheme Smoothing
    Zhang, DeJia
    [J]. PROCEEDINGS OF THE SECOND INTERNATIONAL SYMPOSIUM ON ELECTRONIC COMMERCE AND SECURITY, VOL II, 2009, : 215 - 217