Reputation-based Worker Filtering in Crowdsourcing
Reputation-based Worker Filtering in Crowdsourcing, Jagabathula, S., Subramanian, L., & Venkataraman, A. (2014). In Advances in Neural Information Processing Systems, 2492-2500.
In this paper, we study the problem of aggregating noisy labels from crowd workers to infer the underlying true labels of binary tasks. Unlike most prior work which has examined this problem under the random worker paradigm, we consider a much broader class of adversarial workers with no specific assumptions on their labeling strategy…