|
Jose A. Garcia, David Masip, Valerio Sbragaglia, & Jacopo Aguzzi. (2016). Automated Identification and Tracking of Nephrops norvegicus (L.) Using Infrared and Monochromatic Blue Light. In 19th International Conference of the Catalan Association for Artificial Intelligence.
Abstract: Automated video and image analysis can be a very efficient tool to analyze
animal behavior based on sociality, especially in hard access environments
for researchers. The understanding of this social behavior can play a key role in the sustainable design of capture policies of many species. This paper proposes the use of computer vision algorithms to identify and track a specific specie, the Norway lobster, Nephrops norvegicus, a burrowing decapod with relevant commercial value which is captured by trawling. These animals can only be captured when are engaged in seabed excursions, which are strongly related with their social behavior.
This emergent behavior is modulated by the day-night cycle, but their social
interactions remain unknown to the scientific community. The paper introduces an identification scheme made of four distinguishable black and white tags (geometric shapes). The project has recorded 15-day experiments in laboratory pools, under monochromatic blue light (472 nm.) and darkness conditions (recorded using Infra Red light). Using this massive image set, we propose a comparative of state-ofthe-art computer vision algorithms to distinguish and track the different animals’ movements. We evaluate the robustness to the high noise presence in the infrared video signals and free out-of-plane rotations due to animal movement. The experiments show promising accuracies under a cross-validation protocol, being adaptable to the automation and analysis of large scale data. In a second contribution, we created an extensive dataset of shapes (46027 different shapes) from four daily experimental video recordings, which will be available to the community.
Keywords: computer vision; video analysis; object recognition; tracking; behaviour; social; decapod; Nephrops norvegicus
|
|
|
Jose A. Garcia, David Masip, Valerio Sbragaglia, & Jacopo Aguzzi. (2016). Using ORB, BoW and SVM to identificate and track tagged Norway lobster Nephrops Norvegicus (L.). In 3rd International Conference on Maritime Technology and Engineering.
Abstract: Sustainable capture policies of many species strongly depend on the understanding of their social behaviour. Nevertheless, the analysis of emergent behaviour in marine species poses several challenges. Usually animals are captured and observed in tanks, and their behaviour is inferred from their dynamics and interactions. Therefore, researchers must deal with thousands of hours of video data. Without loss of generality, this paper proposes a computer
vision approach to identify and track specific species, the Norway lobster, Nephrops norvegicus. We propose an identification scheme were animals are marked using black and white tags with a geometric shape in the center (holed
triangle, filled triangle, holed circle and filled circle). Using a massive labelled dataset; we extract local features based on the ORB descriptor. These features are a posteriori clustered, and we construct a Bag of Visual Words feature vector per animal. This approximation yields us invariance to rotation
and translation. A SVM classifier achieves generalization results above 99%. In a second contribution, we will make the code and training data publically available.
|
|
|
David Guillamet, & Jordi Vitria. (1999). Using Eigenspace analysis of color distributions for object recognition.
|
|
|
A. Martinez, & Jordi Vitria. (1998). Learning mixture models with the EM algorithm and genetic algorithms.
|
|
|
A. Martinez, S. Gonzalez, Jordi Vitria, & J. Lopez. (1997). NAT: a robot that recognizes offices..
|
|
|
David Guillamet, & Jordi Vitria. (1999). Skin segmentation using non linear principal component analysis..
|
|
|
A. Sanfeliu, Juan J. Villanueva, & Jordi Vitria. (1997). Image Analysis and Pattern Recognition..
|
|
|
A. Martinez, & Jordi Vitria. (1996). Dimensionality reduction for face recognition.
|
|
|
A. Martinez, & Jordi Vitria. (1997). From Visual Scanning to Object Recognition. In (SNRFAI’97) 7th Spanish National Symposium on Pattern Recognition and Image Analysis..
|
|
|
A. Martinez, Jordi Vitria, & J. Lopez. (1997). Visual Recognition of Surroundings: A robot that knows where it is..
|
|
|
Jordi Vitria, & J. Llacer. (1996). Reconstructing 3D light microscopic images using the EM algorithm. Pattern Recognition Letters, 1491–1498.
|
|
|
M. Bressan, David Guillamet, & Jordi Vitria. (2001). Using a local ICA Representation of High Dimensional Data for Object Recognition and Classification..
|
|
|
D. Seron, F. Moreso, C. Gratin, Jordi Vitria, & E. Condom. (1996). Automated classification of renal interstitium and tubules by local texture analysis and a neural network. Analytical and Quantitative Cytology and Histology, 18(5), 410–9, PMID: 8908314.
|
|
|
X. Binefa, & Jordi Vitria. (1996). A contrast based focusing criterium..
|
|
|
M. Bressan, & Jordi Vitria. (2001). Independent Modes of Variation in Point Distribution Models.
|
|