In order to provide an additional incentive or even avoid paying clickworkers, the concept of gamification, i.e., the usage of games or game elements in non-game contexts, has been exploited a lot in this domain. This particular form of crowdsourcing is called playsourcing. Playsourcing refers to the usage of games with high numbers of players - such as online and smartphone games - for solving real world problems. Probably the most popular examples for the application of playsourcing to scientific problems so far are the games "FoldIt", "nanocrafter", and "play to cure". Recently, there have been the first attempts to use crowdsourcing also in the area of computer vision and pattern recognition.
In this seminar we will discuss several principles as well as application examples of gamification in the context of crowdsourcing - with a particular focus on computer vision.
(1) Luis Von Ahn and Laura Dabbish. Designing games with a purpose. Communications of the ACM 51.8 (2008): 58-67.
(2) Seth Cooper, Firas Khatib, Adrien Treuille, Janos Barbero, Jeehyung Lee, Michael Beenen, Andrew Leaver-Fay, David Baker, Zoran Popović, Foldit players (2010). Predicting protein structures with a multiplayer online game. Nature 446 p. 756-760 (2010).
(3) Gabe Zichermann and Christopher Cunningham. Gamification by design: Implementing game mechanics in web and mobile apps. O'Reilly (2011).
(4) Lafourcade, Mathieu , and Joubert, Alain and Le Brun, Nathalie. Games with a Purpose (Gwaps). Wiley (2015)
(5) Play to cure: Genes in space
(6) Catherine Wah. Crowdsourcing and Its Applications in Computer Vision. technical report (2011).
(7) Greg Little, Lydia B. Chilton, Max Goldman, Robert C. Miller. TurKit?: Human Computation Algorithms on Mechanical Turk. Proceedings of the 23nd annual ACM symposium on User interface software and technology (2010).
(8) Richard Souvenir et al. Gamesourcing to acquire labeled human pose estimation data. Computer Vision and Pattern Recognition Workshops (CVPRW), 2012 IEEE Computer Society Conference on , vol., no., pp.1-6, 16-21 June 2012.
(9) Catherine Wah, Grant Van Horn, Steven Branson, Subhransu Maji, Pietro Perona, Serge Belongie. Similarity Comparisons for Interactive Fine-Grained Categorization. Workshop on Computer Vision and Human Computation at CVPR (2014).
(10) Ejaz Ahmed, Subhransu Maji, Gregory Shakhnarovich, Larry Davis. Using Human Knowledge to Judge Part Goodness: Interactive Part Selection. Workshop on Computer Vision and Human Computation at CVPR (2014).
(11) Michael Wilber, Sam Kwak, Serge Belongie. Cost-Effective HITs for Relative Similarity Comparisons. Workshop on Computer Vision and Human Computation at CVPR (2014).
(12) Carl Vondrick, Hamed Pirsiavash, Aude Oliva, Antonio Torralba. Acquiring Visual Classfiers from Human Imagination. Workshop on Computer Vision and Human Computation at CVPR (2014).
(13) Crowd Truth Project.
(14) Ferran Cabezas, Axel Carlier, Amaia Salvador, Xavier Giró-i-Nieto, Vincent Charvillat. Quality Control in Crowdsourced Object Segmentation. Preprint (2015).
TeachingForm | |
---|---|
Title: | Crowdsourcing and Gamification with Applications to Computer Vision (IN0014, IN2107) |
Professor: | Dr. Maximilian Baust |
Tutors: | Christoph Hennersperger, Julia Rackerseder |
Type: | Hauptseminar |
Information: | |
Term: | 2015WiSe |
Abstract: |