Skip to main content
Springer Nature Link
Log in

Understanding fish behavior during typhoon events in real-life underwater environments

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

The study of fish populations in their own natural environment is a task that has usually been tackled in invasive ways which inevitably influenced the behavior of the fish under observation. Recent projects involving the installation of permanent underwater cameras (e.g. the Fish4Knowledge (F4K) project, for the observation of Taiwan’s coral reefs) allow to gather huge quantities of video data, without interfering with the observed environment, but at the same time require the development of automatic processing tools, since manual analysis would be impractical for such amounts of videos. Event detection is one of the most interesting aspects from the biologists’ point of view, since it allows the analysis of fish activity during particular events, such as typhoons. In order to achieve this goal, in this paper we present an automatic video analysis approach for fish behavior understanding during typhoon events. The first step of the proposed system, therefore, involves the detection of “typhoon” events and it is based on video texture analysis and on classification by means of Support Vector Machines (SVM). As part of our behavior understanding efforts, trajectory extraction and clustering have been performed to study the differences in behavior when disruptive events happen. The integration of event detection with fish behavior understanding surpasses the idea of simply detecting events by low-level features analysis, as it supports the full semantic comprehension of interesting events.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Notes

  1. http://fish4knowledge.eu

  2. http://dbpedia.org/

References

  1. Albiol A, Silla J, Albiol A, Mossi J, Sanchis L (2009) Automatic video annotation and event detection for video surveillance. In: 3rd international conference on crime detection and prevention (ICDP 2009), pp 1–5

  2. Ballan L, Bertini M, Bimbo AD, Seidenari L, Serra G (2011) Event detection and recognition for semantic annotation of video. Multimed Tools Appl 51:279–302

    Article  Google Scholar 

  3. Benson B, Cho J, Goshorn D, Kastne R (2009) Field programmable gate array based fish detection using Haar classifiers. In: American academy of underwater science

  4. Bertails A, Prud’hommeaux E (2011) Interpreting relational databases in the rdf domain. In: Musen MA, Corcho Ó (eds) K-CAP. ACM, pp 129–136

  5. Bouaynaya N, Qu W, Schonfeld D (2005) An online motion-based particle filter for head tracking applications. In: Proc of the IEEE intl conf on acoustics, speech and signal processing

  6. Brehmer P, Do Chi T, Mouillot D (2006) Amphidromous fish school migration revealed by combining fixed sonar monitoring (horizontal beaming) with fishing data. J Exp Mar Biol Ecol 334:139–150

    Article  Google Scholar 

  7. Cannavo F, Nunnari G, Giordano D, Spampinato C (2006) Variational method for image denoising by distributed genetic algorithms on grid environment. In: Proceedings of the 15th IEEE international workshops on enabling technologies: infrastructure for collaborative enterprises. Washington, DC, USA, IEEE Computer Society, pp 227–232

    Chapter  Google Scholar 

  8. Chau DP, Bremond F, Thonnat M (2009) Online evaluation of tracking algorithm performance. In: The 3rd international conference on imaging for crime detection and prevention

  9. Cheung S-CS, Kamath C (2005) Robust background subtraction with foreground validation for urban traffic video. EURASIP J Appl Signal Process 2005(1):2330–2340

    Article  MATH  Google Scholar 

  10. Chou H, Shiau Y, Lo S, Lin S, Lin F, Kuo C, Lai C (2009) A real-time ecological observation video streaming system based on grid architecture. In: HPC Asia 2009

  11. Cline DE, Edgington DR, Mariette J (2008) An automated visual event detection system for cabled observatory video. In: VISAPP (1), pp 196–199

  12. Comaniciu D, Meer P (2002) Mean shift: a robust approach toward feature space analysis. IEEE Trans Pattern Anal Mach Intell 24(5):603–619

    Article  Google Scholar 

  13. Costa C, De Natale FGB, Granelli F (2004) Quality evaluation and nonuniform compression of geometrically distorted images using the quadtree distortion map. EURASIP J Appl Signal Process 2004:1899–1911

    Article  Google Scholar 

  14. Dasiopoulou S, Mezaris V, Kompatsiaris I, Papastathis V-K, Strintzis M (2005) Knowledge-assisted semantic video object detection. IEEE Trans Circuits Syst Video Technol 15(10):1210–1224

    Article  Google Scholar 

  15. Doermann D, Mihalcik D (2000) Tools and techniques for video performance evaluation. In: Proceedings 15th international conference on pattern recognition, 2000, vol 4, pp 167–170

  16. Doucet A, De Freitas N, Gordon N (eds) (2001) Sequential Monte Carlo methods in practice. Springer Verlag

  17. Edgington D, Salamy K, Risi M, Sherlock R, Walther D, Koch C (2003) Automated event detection in underwater video. In: OCEANS 2003. Proceedings, vol 5, pp 2749–2753

  18. Elgammal A, Duraiswami R, Davis LS (2003) Efficient kernel density estimation using the fast gauss transform with applications to color modeling and tracking. IEEE Trans Pattern Anal Mach Intell 25:1499–1504

    Article  Google Scholar 

  19. Elhabian S, El-Sayed K, Ahmed SH (2008) Moving object detection in spatial domain using background removal techniques—state-of-art. Recent Patents on Computer Science 1(1):32–54

    Article  Google Scholar 

  20. Erdem C, Tekalp AM, Sankur B (2001) Metrics for performance evaluation of video object segmentation and tracking without ground truth. In: Proceedings of internation conference on image processing, vol 2, pp 69–72

  21. Evans F (2003) Detecting fish in underwater video using the em algorithm. In: Proceedings of the 2003 international conference on image processing, ICIP 2003, vol 3, pp III – 1029–32, vol 2

  22. Faro A, Giordano D, Spampinato C (2006) Soft-computing agents processing webcam images to optimize metropolitan traffic systems. In: Wojciechowski K, Smolka B, Palus H, Kozera R, Skarbek W, Noakes L (eds) Computer vision and graphics. Computational imaging and vision, vol 32. Springer Netherlands, pp 968–974. doi:10.1007/1-4020-4179-9-141

    Google Scholar 

  23. Faro A, Giordano D, Spampinato C (2011) Adaptive background modeling integrated with luminosity sensors and occlusion processing for reliable vehicle detection. IEEE Trans Intell Trans Syst 12(4):1398–1412

    Article  Google Scholar 

  24. Faro A, Giordano D, Spampinato C (2011) Integrating location tracking, traffic monitoring and semantics in a layered its architecture. IET Intell Trans Syst 5(3):197–206

    Article  Google Scholar 

  25. Forstner W, Moonen B (1999) A metric for covariance matrices. Tech rep, Dept of Geodesy and Geoinformatics, Stuttgart University

  26. Gkalelis N, Mezaris V, Kompatsiaris I (2011) High-level event detection in video exploiting discriminant concepts. In: 9th international workshop on content-based multimedia indexing, Madrid, Spain (CBMI 2011)

  27. Gordon N, Doucet A, Freitas N (1979) An algorithm for tracking multiple targets. IEEE Trans Autom Contr 24(6):843–854

    Article  Google Scholar 

  28. Hariharakrishnan K, Schonfeld D (2005) Fast object tracking using adaptive block matching. IEEE Trans Multimed 7:853–859

    Article  Google Scholar 

  29. Hearst M, Dumais S, Osman E, Platt J, Scholkopf B (1998) Support vector machines. IEEE Intell Syst Appl 13:18–28

    Article  Google Scholar 

  30. Iqbal K, Abdul Salam R, Osman A, Zawawi Talib A (2002) Underwater image enhancement using an integrated colour model. AENG International Journal Of Computer Science 35(1):31–41

    Google Scholar 

  31. Junejo IN, Foroosh H (2008) Euclidean path modeling for video surveillance. Image Vis Comput 26:512–528 (ACM ID: 1332292)

    Article  Google Scholar 

  32. Khan Z, Gu I-H (2010) Joint feature correspondences and appearance similarity for robust visual object tracking. IEEE Transactions on Information Forensics and Security 5(3):591–606

    Article  Google Scholar 

  33. Kuo C (2011) Damage to the reefs of Siangjiao Bay marine protected area of Kenting National Park, southern Taiwan during typhoon Morakot. Zoological Studies Environmental Biology of Fishes 50:457–462

    Google Scholar 

  34. Larsen R, Olafsdottir H, Ersbll B (2009) Shape and texture based classification of fish species. In: Image analysis. Lecture notes in computer science, vol 5575. Springer Berlin / Heidelberg, pp 745–749

    Chapter  Google Scholar 

  35. Lazarevic-McManus N, Renno J, Jones GA (2006) Performance evaluation in visual surveillance using the f-measure. In: Proceedings of the 4th ACM international workshop on video surveillance and sensor networks, VSSN ’06. New York, NY, USA, ACM, pp 45–52

    Chapter  Google Scholar 

  36. Li W, Chen S, Wang H (2009) A rule-based sports video event detection method. In: International conference on computational intelligence and software engineering, 2009. CiSE, pp 1–4

  37. Lowe D (2004) Distinctive image features from scale-invariant key-points. Int J Comput Vis 60:91–110

    Article  Google Scholar 

  38. Morais EF, Campos MFM, Padua FLC, Carceroni RL (2005) Particle filter-based predictive tracking for robust fish counting. Brazilian Symposium on Computer Graphics and Image Processing 1:367–374

    Google Scholar 

  39. Nagashima Y, Ishimatsu T (1998) A morphological approach to fish discrimination. In: MVA98, pp xx–yy

  40. Nanami A, Nishihira M (2002) The structures and dynamics of fish communities in an Okinawan coral reef: effects of coral-based habitat structures at sites with rocky and sandy sea bottoms. Environ Biol Fish 63:353–372. doi:10.1023/A:1014952932694

    Article  Google Scholar 

  41. Nguyen H, Duhamel P, Brouet J, Rouffet D (2004 ) Robust vlc sequence decoding exploiting additional video stream properties with reduced complexity. In: IEEE international conference on multimedia and expo, 2004. ICME ’04., vol 1, pp 375–378

  42. Papadopoulos G, Mezaris V, Kompatsiaris I, Strintzis M (2008) Estimation and representation of accumulated motion characteristics for semantic event detection. In: 15th IEEE international conference on image processing, 2008. ICIP, pp 41–44

  43. Porikli F (2005) Multiplicative background-foreground estimation under uncontrolled illumination using intrinsic images. In: Proc of IEEE motion multi-workshop

  44. Porikli F (2006) Achieving real-time object detection and tracking under extreme conditions. J Real-Time Image Process 1(1):33–40

    Article  Google Scholar 

  45. Porikli F, Wren C (2005) Change detection by frequency decomposition: wave-back. In: Proc of workshop on image analysis for multimedia interactive services

  46. Porikli F, Tuzel O, Meer P (2005) Covariance tracking using model update based on lie algebra. In: Proc IEEE conf on computer vision and pattern recognition

  47. Reid D (1979) An algorithm for tracking multiple targets. IEEE Trans Autom Control 24(6):843–854

    Article  Google Scholar 

  48. Rouse W (2007) Population dynamics of barnacles in the intertidal zone. Marine Biology Research Experiment

  49. Sankaranarayanan A, Veeraraghavan A, Chellappa R (2008) Object detection, tracking and recognition for multiple smart cameras. Proc IEEE 96(10):1606–1624

    Article  Google Scholar 

  50. Scherp A, Franz T, Saathoff C, Staab S (2009) F–a model of events based on the foundational ontology DOLCE+DnS ultralight. In: Proceedings of the fifth international conference on knowledge capture KCAP 09. ACM, pp 137–144

  51. Scherp A, Jain R, Kankanhalli M, Mezaris V (2010) Modeling, detecting, and processing events in multimedia. In: Proceedings of the international conference on Multimedia, MM ’10. ACM, New York, NY, USA, pp 1739–1740

    Chapter  Google Scholar 

  52. Schettini R, Corchs S (2010) Underwater image processing: state of the art of restoration and image enhancement methods. EURASIP J Adv Signal Process 2010:14:1–14:7

    Google Scholar 

  53. Shaish L, Levy G, Katzir G, Rinkevich B (2010) Coral reef restoration (Bolinao, Philippines) in the face of frequent natural catastrophes. Restor Ecol 18(3):285–299

    Article  Google Scholar 

  54. Shaw, R, Troncy, R, and Hardman, L, (2009) LODE: linking open descriptions of events. In: Gómez-Pérez A, Yu Y, Ding Y (eds) ASWC, Lecture notes in computer science, vol 5926, Springer. pp 153–167

  55. Sheng H, Li C, Wei Q, Xiong Z (2008) Real-time detection of abnormal vehicle events with multi-feature over highway surveillance video. In: 11th international IEEE conference on intelligent transportation systems, 2008. ITSC, pp 550–556

  56. Shi J, Tomasi C (2008) Good features to track. In: Proc IEEE int conf comp vision and pattern recognition, pp 593–600

  57. Sillito RR, Fisher RB (2009) Parametric trajectory representations for behaviour classification. In: BMVC

  58. Siong Tew K, Han C-C, Chou W-R, Fang L-S (2002) Habitat and fish fauna structure in a subtropical mountain stream in Taiwan before and after a catastrophic typhoon. Environ Biol Fish 65:457–462. doi:10.1023/A:1021111800207

    Article  Google Scholar 

  59. Soori U, Arshad M (2009) Underwater crowd flow detection using Lagrangian dynamics. Ind J Mar Sci 38:359–364

    Google Scholar 

  60. Spampinato C, Chen-Burger Y-H, Nadarajan G, Fisher RB (2008) Detecting, tracking and counting fish in low quality unconstrained underwater videos. In: VISAPP (2), pp 514–519

  61. Spampinato C, Giordano D, Di Salvo R, Chen-Burger Y-HJ, Fisher RB, Nadarajan G (2010) Automatic fish classification for underwater species behavior understanding. In: Proceedings of the first ACM international workshop on analysis and retrieval of tracked events and motion in imagery streams, ARTEMIS ’10. ACM, pp 45–50

  62. Stauffer C, Grimson WEL (1999) Adaptive background mixture models for real-time tracking. In: Proceedings 1999 IEEE computer society conference on computer vision and pattern recognition Cat No PR00149, vol 2, no c, pp 246–252

  63. Sugar CA, James GM (2003) Finding the number of clusters in a dataset. J Am Stat Assoc 98:750–763

    Article  MATH  MathSciNet  Google Scholar 

  64. Toyama K, Krumm J, Brumitt B, Meyers B (1999) Wallflower: principles and practice of background maintenance. In: The Proceedings of the seventh IEEE international conference on computer vision, 1999, vol 1, pp 255–261

  65. Traiperm C, Kittitomkun S (2005) High-performance mpeg-4 multipoint conference unit. In: Proceedings of networks and communication system, pp 189–193

  66. Tuzel O, Porikli F, Meer P (2006) Region covariance: a fast descriptor for detection and classification. In: Proc. 9th European conf on computer vision

  67. Van Hage WR, Malais V, De Vries GKD, Schreiber G, Van Someren M (2012) Abstracting and reasoning over ship trajectories and Web data with the simple event model (SEM). Multimed Tools Appl 57(1):1–23

    Google Scholar 

  68. Varcheie P, Sills-Lavoie M, Bilodeau G-A (2010) A multiscale region-based motion detection and background subtraction algorithm. Sensors 10(2):1041–1061

    Article  Google Scholar 

  69. Walther D, Edgington D, Koch C (2004) Automated video analysis for oceanographic research. In: Proc computer vision and pattern recognition, CVPR 2004, pp 544–549

  70. Yilmaz A, Javed O, Shah M (2006) Object tracking: a survey. ACM Comput Surv 38(4):1–45

    Google Scholar 

  71. Zhou S, Chellappa R, Moghaddam B (2003) Visual tracking and recognition using appearance-based modeling in particle filters. In: Proc intl conf on multimedia and expo

  72. Zhou J, Clark C (2006) Autonomous fish tracking by rov using monocular camera. In: The 3rd Canadian conference on computer and robot vision, 2006. p 68

Download references

Author information

Authors and Affiliations

  1. Department of Electrical, Electronics and Computer Engineering, University of Catania, Catania, Italy

    Concetto Spampinato, Simone Palazzo, Isaak Kavasidis, Roberto Di Salvo & Daniela Giordano

  2. School of Informatics, University of Edinburgh, Edinburgh, UK

    Bastian Boom & Robert B Fisher

  3. Centrum voor Wiskunde en Informatica (CWI), University of Amsterdam, Amsterdam, Netherlands

    Jacco van Ossenbruggen & Lynda Hardman

  4. National Center of High Performance Computing, Hsinchu City, Taiwan

    Fang-Pang Lin

Authors
  1. Concetto Spampinato
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Simone Palazzo
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Bastian Boom
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jacco van Ossenbruggen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Isaak Kavasidis
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Roberto Di Salvo
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Fang-Pang Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Daniela Giordano
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Lynda Hardman
    View author publications

    You can also search for this author in PubMed Google Scholar

  10. Robert B Fisher
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Concetto Spampinato.

Additional information

This research was funded by European Commission FP7 grant 257024, for the Fish4Knowledge project (www.fish4knowledge.eu).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Spampinato, C., Palazzo, S., Boom, B. et al. Understanding fish behavior during typhoon events in real-life underwater environments. Multimed Tools Appl 70, 199–236 (2014). https://doi.org/10.1007/s11042-012-1101-5

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-012-1101-5

Keywords