We examine the reliability of clickthrough data as concept-based image annotations, by comparing them against manual annotations, for different concept categories. Our analysis shows that, for many concepts, the image annotations generated by using clickthrough data are reliable, with up to 90% of true positives in the automatically annotated images compared to the manual ground truth. Concept categories, though, do not provide additional evidence about the types of concepts for which clickthrough-based image annotation performs well.
Fraunhofer Verlag
Image Indexing and reTrievAL in the Large Scale
Theseus/ImageCLEF workshop on visual information retrieval evaluation
Human-Centered Data Analytics

Tsikrika, T., Diou, C., de Vries, A., & Delopoulos, A. (2009). Are clickthrough data reliable as image annotations?. In Proceedings of Theseus/ImageCLEF workshop on visual information retrieval evaluation 2009. Fraunhofer Verlag.