Worker ranking determination in crowdsourcing platforms using aggregation functions
Visualitza/Obre
10.1109/FUZZ-IEEE.2014.6891807
Inclou dades d'ús des de 2022
Cita com:
hdl:2117/26147
Tipus de documentText en actes de congrés
Data publicació2014
EditorInstitute of Electrical and Electronics Engineers (IEEE)
Condicions d'accésAccés obert
Tots els drets reservats. Aquesta obra està protegida pels drets de propietat intel·lectual i
industrial corresponents. Sense perjudici de les exempcions legals existents, queda prohibida la seva
reproducció, distribució, comunicació pública o transformació sense l'autorització del titular dels drets
Abstract
The increasing adoption of crowdsourcing for commercial and industrial purposes rises the need for creating sophisticated mechanisms in crowd-based digital platforms for efficient worker management. One of the main challenges in this area is worker motivation and skill set control and its impact on the output quality. The quality delivered by the workers in the crowd depends on different aspects such as their skills, experience, commitment, etc. The lack of generic and detailed proposals to incentive workers and the need for creating ad-hoc solutions depending on the domain make it difficult to evaluate the best rewarding functions in each scenario. In this paper, we make a step further in this direction and propose the use of aggregation functions to evaluate the professional skills of crowd-workers based on the quality of their past tasks. Additionally, we present a real industrial crowdsourcing solution for software localisation in which the proposed solutions are put into practice with real text translations quality measures.
CitacióSanchez, D. [et al.]. Worker ranking determination in crowdsourcing platforms using aggregation functions. A: IEEE International Conference on Fuzzy Systems. "2014 IEEE International Conference on Fuzzy Systems (FUZZ-IEEE)". Beijing: Institute of Electrical and Electronics Engineers (IEEE), 2014, p. 1801-1808.
ISBN978-1-4799-2073-0
Fitxers | Descripció | Mida | Format | Visualitza |
---|---|---|---|---|
owa_wcci.pdf | 552,0Kb | Visualitza/Obre |