TRECVID has been running as a video retrieval benchmarking platform for a number of years now. Some progress seems to be made in the area of video retrieval, but also it has been shown that many of the differences in scores between tested approaches are nonsignificant. This paper studies the reliability of the TRECVID search collections for measuring video retrieval effectiveness and investigates how useful the collections are for re-use.

Multimedia Information Retrieval Workshop
Database Architectures

Westerveld, T. (2003). RECVID as a Re-Usable Test-Collection for Video Retrieval. In Proceedings of Multimedia Information Retrieval Workshop 2003 (0).