On September 30, at 6 pm, the AI Master Class ”Juggling Speed, Cost and Quality on the Road Towards Data Excellence” will be held.
The rise of the crowdsourcing paradigm for data collection and annotation allowed the industry to overcome some of the limitations it faced in the past (such as scalability and diversity). However, this shift brought a new set of challenges. Contrarily to data created in-house by experts, and in order to guarantee comparable performance levels, gathering data through crowdsourcing requests for stricter and more systematic approaches to quality (checking for both fraud and substandard work). Furthermore, a modern crowdsourcing platform, such as Neevo, also has to take into account the expectations of cost and speed for both requesters (clients) and contributors (crowd), while maintaining a sustainable and ethical data ecosystem. In this presentation, we will present some of the challenges (and hopefully some solutions) across these dimensions at DefinedCrowd.
Mais informação
Ler mais