Within the INitiative for the Evaluation of XML Retrieval (INEX) a number of metrics to evaluate the effectiveness of content-oriented XML retrieval approaches were developed. Although these metrics provide a solution towards addressing the problem of overlap among returned result elements, they do not consider the problem of overlapping reference components within the recall-base, hence leading to skewed effectiveness scores. We propose alternative metrics that aim to provide a solution to both overlap issues.

, , , , , ,
ACM
Annual ACM SIGIR Conference
Database Architectures

Kazai, G., Lalmas, M., & de Vries, A. (2004). The overlap problem in content-oriented XML retrieval evaluation. In Proceedings of ACM SIGIR Conference on Research and Development in Information Retrieval 2004 (27) (pp. 72–79). ACM.