Human annotated data is a prerequisite for the training and evaluation of computer vision algorithms. Such data is referred to as “ground truth” data. In this chapter, we describe the strategies and systems we have devised in order to obtain the ground truth data required by each of the computer vision components within the Fish4Knowledge system, including fish detection, tracking, and recognition.
Human-centered Data Analysis

He, J, Spampinato, C, Boom, B.J, & Kavasidis, I. (2016). Data Groundtruthing and Crowdsourcing. In Fish4Knowledge: Collecting and Analyzing Massive Coral Reef Fish Video Data (pp. 207–227). doi:10.1007/978-3-319-30208-9_14