ImageCLEF's wikipediaMM task provides a testbed for the system-oriented evaluation of multimedia information retrieval from a collection of Wikipedia images. The aim is to investigate retrieval approaches in the context of a large and heterogeneous collection of images (similar to those encountered on the Web) that are searched for by users with diverse information needs. This paper presents an overview of the resources, topics, and assessments of the wikipediaMM task at ImageCLEF 2009, summarises the retrieval approaches employed by the participating groups, and provides a first analysis of the main evaluation results.

CLEF-campaign
Image Indexing and reTrievAL in the Large Scale
Workshop on Cross-Language Evaluation Forum
Human-Centered Data Analytics

Tsikrika, T., & Kludas, J. (2009). Overview of the wikipediaMM task at ImageCLEF 2009. In Working notes of the 10th Workshop of the Cross-Language Evaluation Forum. CLEF-campaign.