PT Journal
AU Marc Oliu
   Ciprian Corneanu
   Kamal Nasrollahi
   Olegs Nikisins
   Sergio Escalera
   Yunlian Sun
   Haiqing Li
   Zhenan Sun
   Thomas B. Moeslund
   Modris Greitans
TI Improved RGB-D-T based Face Recognition
SO IET Biometrics
JI BIO
PY 2016
BP 297
EP 303
VL 5
IS 4
AB Reliable facial recognition systems are of crucial importance in various applications from entertainment to security. Thanks to the deep-learning concepts introduced in the field, a significant improvement in the performance of the unimodal facial recognition systems has been observed in the recent years. At the same time a multimodal facial recognition is a promising approach. This study combines the latest successes in both directions by applying deep learning convolutional neural networks (CNN) to the multimodal RGB, depth, and thermal (RGB-D-T) based facial recognition problem outperforming previously published results. Furthermore, a late fusion of the CNN-based recognition block with various hand-crafted features (local binary patterns, histograms of oriented gradients, Haar-like rectangular features, histograms of Gabor ordinal measures) is introduced, demonstrating even better recognition performance on a benchmark RGB-D-T database. The obtained results in this study show that the classical engineered features and CNN-based features can complement each other for recognition purposes.
ER