Authors: E.A. Taran, V.A. Malanina, F. Casati

Title of the article: Algorithm for using crowdsourcing tools for collecting and analysis of scientific research data (by the example of preparation of systematized literature review)

Year: 2020, Issue: 4, Pages: 39-46

Branch of knowledge: 08.00.05 Economics and Management of National Economy

Index UDK: 330

DOI: 10.26730/2587-5574-2020-4-39-46

Abstract: The number of publications devoted to conducting a systematic literature review in recent years has a steady upward trend and is accompanied by a high citation rate of this type of publications in abstract databases. A survey of researchers with experience in compiling a systematic review of the literature made it possible to determine that the implementation of this laborious process is accompanied by the presence of a fairly large number of difficulties. The purpose of this article is to develop an algorithm for using crowdsourcing tools for collecting and analyzing scientific research (using the example of preparing a systematized literature review). Based on the developed and validated algorithm, a template was created for the crowdsourcing platform Yandex.Toloka. It includes the following stages: determination of selection criteria; definition of keywords for search; checking the correctness of the questions; selection of questions for crowd-sourcing; creation of instructions for performers; placement of instructions on a crowdsourcing platform; creation of a test / training pool of articles; rating of questions for crowdsourcing; determination of the cost of performers' work; creation of control elements; launch of crowdsourcing. Using a template to carry out a systematic review of literature using crowdsourcing tools on the platform Yandex.Toloka will significantly reduce the work of researchers aimed at selecting articles for further analysis.

Key words: systematic literature review crowdsourcing template algorithm YandexToloka

Receiving date: 05.11.2020

Publication date: 29.12.2020

CITE DOWNLOAD