A. Checco, A. Roitero, E. Maddalena, S. Mizzaro, and G. Demartini. Let’s agree to disagree: Fix- ing agreement measures for crowdsourcing. In Proceedings of the Fifth AAAI Conference on Human Computation and Crowdsourcing (HCOMP-17), pages 11–20. AAAI Press, 2017.