Creation of Reliable Relevance Judgments in Information Retrieval Systems Evaluation Experimentation through Crowdsourcing: A Review

Figure 4

Flow of submitting and completing tasks via crowdsourcing.