Challenges in Data Crowdsourcing

被引:87
|
作者
Garcia-Molina, Hector [1 ]
Joglekar, Manas [1 ]
Marcus, Adam [2 ]
Parameswaran, Aditya [3 ]
Verroios, Vasilis [1 ]
机构
[1] Stanford Univ, Dept Comp Sci, Stanford, CA 94305 USA
[2] Unltd Labs, San Francisco, CA 94103 USA
[3] Univ Illinois UIUC, Dept Comp Sci, Champaign, IL 61820 USA
关键词
Data crowdsourcing; data augmenting; data curation; data processing; crowdsourcing space; crowdsourcing design; crowdsourcing workflow; worker management;
D O I
10.1109/TKDE.2016.2518669
中图分类号
TP18 [人工智能理论];
学科分类号
081104 ; 0812 ; 0835 ; 1405 ;
摘要
Crowdsourcing refers to solving large problems by involving human workers that solve component sub-problems or tasks. In data crowdsourcing, the problem involves data acquisition, management, and analysis. In this paper, we provide an overview of data crowdsourcing, giving examples of problems that the authors have tackled, and presenting the key design steps involved in implementing a crowdsourced solution. We also discuss some of the open challenges that remain to be solved.
引用
收藏
页码:901 / 911
页数:11
相关论文
共 50 条
  • [1] Challenges in Crowdsourcing Geospatial Data to Replace or Enhance Official Sources
    Davis Junior, Clodoveu Augusto
    [J]. DISEGNARECON, 2018, 11 (20)
  • [3] Crowdsourcing sensitive data using public displays—opportunities, challenges, and considerations
    Andy Alorwu
    Niels van Berkel
    Jorge Goncalves
    Jonas Oppenlaender
    Miguel Bordallo López
    Mahalakshmy Seetharaman
    Simo Hosio
    [J]. Personal and Ubiquitous Computing, 2022, 26 : 681 - 696
  • [4] Crowdsourcing in biomedicine: challenges and opportunities
    Khare, Ritu
    Good, Benjamin M.
    Leaman, Robert
    Su, Andrew I.
    Lu, Zhiyong
    [J]. BRIEFINGS IN BIOINFORMATICS, 2016, 17 (01) : 23 - 32
  • [5] Methodological challenges of research on crowdsourcing
    Lenart-Gansiniec, Regina
    [J]. JOURNAL OF ENTREPRENEURSHIP MANAGEMENT AND INNOVATION, 2018, 14 (04) : 107 - 125
  • [6] URBAN CROWDSOURCING: POTENTIAL AND CHALLENGES
    Marzano, Gilberto
    Grewinski, Miroslaw
    Lizut, Joanna
    [J]. GEOGRAPHIC INFORMATION SYSTEMS CONFERENCE AND EXHIBITION (GIS ODYSSEY 2017), 2017, : 247 - 253
  • [7] Crowdsourcing Security - Opportunities and Challenges
    Mohan, Lalit S.
    Reddy, Y. R.
    [J]. 2018 IEEE/ACM 11TH INTERNATIONAL WORKSHOP ON COOPERATIVE AND HUMAN ASPECTS OF SOFTWARE ENGINEERING (CHASE), 2018, : 37 - 40
  • [8] On moderating software crowdsourcing challenges
    de Souza, Cleidson R.B.
    Machado, Leticia S.
    Melo, Ricardo Rodrigo M.
    [J]. Proceedings of the ACM on Human-Computer Interaction, 2020, 4 (GROUP):
  • [9] Crowdsourcing and SMEs: Opportunities and Challenges
    Maiolini, R.
    Naggi, R.
    [J]. INFORMATION TECHNOLOGY AND INNOVATION TRENDS IN ORGANIZATIONS, 2011, : 399 - 406
  • [10] Crowdsourcing sensitive data using public displays-opportunities, challenges, and considerations
    Alorwu, Andy
    van Berkel, Niels
    Goncalves, Jorge
    Oppenlaender, Jonas
    Lopez, Miguel Bordallo
    Seetharaman, Mahalakshmy
    Hosio, Simo
    [J]. PERSONAL AND UBIQUITOUS COMPUTING, 2020, 26 (3) : 681 - 696