Reputation Management in Crowdsourcing Systems

被引:40
|
作者
Allahbakhsh, Mohammad [1 ]
Ignjatovic, Aleksandar [1 ]
Benatallah, Boualem [1 ]
Beheshti, Seyed-Mehdi-Reza [1 ]
Bertino, Elisa [2 ]
Foo, Norman [1 ]
机构
[1] Univ New South Wales, Sydney, NSW 2052, Australia
[2] Purdue Univ, W Lafayette, IN 47907 USA
关键词
Reputation; Degree of Fairness; Crowdsourcing;
D O I
10.4108/icst.collaboratecom.2012.250499
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Worker selection is a significant and challenging issue in crowdsourcing systems. Such selection is usually based on an assessment of the reputation of the individual workers participating in such systems. However, assessing the credibility and adequacy of such calculated reputation is a real challenge. In this paper, we propose a reputation management model which leverages the values of the tasks completed, the credibility of the evaluators of the results of the tasks and time of evaluation of the results of these tasks in order to calculate more dependable quality metrics for workers and evaluators. The model has been implemented and experimentally validated.
引用
收藏
页码:664 / 671
页数:8
相关论文
共 50 条
  • [1] Incentive and Reputation Mechanisms for Online Crowdsourcing Systems
    Xie, Hong
    Lui, John C. S.
    Towsley, Don
    [J]. 2015 IEEE 23RD INTERNATIONAL SYMPOSIUM ON QUALITY OF SERVICE (IWQOS), 2015, : 207 - 212
  • [2] SACRM: Social Aware Crowdsourcing with Reputation Management in mobile sensing
    Ren, Ju
    Zhang, Yaoxue
    Zhang, Kuan
    Shen, Xuemin
    [J]. COMPUTER COMMUNICATIONS, 2015, 65 : 55 - 65
  • [3] Blockchain-Assisted Unsupervised Learning Method for Crowdsourcing Reputation Management
    Wang, Tianyu
    Chen, Kongyang
    [J]. CMES-COMPUTER MODELING IN ENGINEERING & SCIENCES, 2024, 140 (03): : 2297 - 2314
  • [4] Reputation management in distributed systems
    De Paola, Alessandra
    Tamburo, Adriano
    [J]. 2008 3RD INTERNATIONAL SYMPOSIUM ON COMMUNICATIONS, CONTROL AND SIGNAL PROCESSING, VOLS 1-3, 2008, : 666 - 670
  • [5] Bringing Reputation-awareness into Crowdsourcing
    Yu, Han
    Shen, Zhiqi
    Leung, Cyril
    [J]. 2013 9TH INTERNATIONAL CONFERENCE ON INFORMATION, COMMUNICATIONS AND SIGNAL PROCESSING (ICICS), 2013,
  • [6] Reputation management in collaborative computing systems
    Arenas, Alvaro E.
    Aziz, Benjamin
    Silaghi, Gheorghe Cosmin
    [J]. SECURITY AND COMMUNICATION NETWORKS, 2010, 3 (06) : 546 - 564
  • [7] Costs and Benefits of Reputation Management Systems
    Cascella, Roberto G.
    [J]. 2008 IEEE INTERNATIONAL SYMPOSIUM ON A WORLD OF WIRELESS, MOBILE AND MULTIMEDIA NETWORKS, VOLS 1 AND 2, 2008, : 431 - 438
  • [8] Designing Reputation and Trust Management Systems
    Beck, Roman
    Franke, Jochen
    [J]. JOURNAL OF ELECTRONIC COMMERCE IN ORGANIZATIONS, 2008, 6 (04) : 8 - 29
  • [9] CrowdR-FBC: A Distributed Fog-Blockchains for Mobile Crowdsourcing Reputation Management
    Yu, Yao
    Liu, Shumei
    Guo, Lei
    Yeoh, Phee Lep
    Vucetic, Branka
    Li, Yonghui
    [J]. IEEE INTERNET OF THINGS JOURNAL, 2020, 7 (09) : 8722 - 8735
  • [10] A Crowd Wisdom Management Framework for Crowdsourcing Systems
    Zhang, Xinglin
    Shangguan, Longfei
    Yuan, Ye
    [J]. IEEE ACCESS, 2016, 4 : 9764 - 9774