TY - JOUR AU - Francisco Javier Orozco AU - Ognjen Rudovic AU - Jordi Gonzalez AU - Maja Pantic PY - 2013// TI - Hierarchical On-line Appearance-Based Tracking for 3D Head Pose, Eyebrows, Lips, Eyelids and Irises T2 - IMAVIS JO - Image and Vision Computing SP - 322 EP - 340 VL - 31 IS - 4 PB - Elsevier KW - On-line appearance models KW - Levenberg–Marquardt algorithm KW - Line-search optimization KW - 3D face tracking KW - Facial action tracking KW - Eyelid tracking KW - Iris tracking N2 - In this paper, we propose an On-line Appearance-Based Tracker (OABT) for simultaneous tracking of 3D head pose, lips, eyebrows, eyelids and irises in monocular video sequences. In contrast to previously proposed tracking approaches, which deal with face and gaze tracking separately, our OABT can also be used for eyelid and iris tracking, as well as 3D head pose, lips and eyebrows facial actions tracking. Furthermore, our approach applies an on-line learning of changes in the appearance of the tracked target. Hence, the prior training of appearance models, which usually requires a large amount of labeled facial images, is avoided. Moreover, the proposed method is built upon a hierarchical combination of three OABTs, which are optimized using a Levenberg–Marquardt Algorithm (LMA) enhanced with line-search procedures. This, in turn, makes the proposed method robust to changes in lighting conditions, occlusions and translucent textures, as evidenced by our experiments. Finally, the proposed method achieves head and facial actions tracking in real-time. UR - http://dx.doi.org/10.1016/j.imavis.2013.02.001 L1 - http://refbase.cvc.uab.es/files/ORG2013.pdf N1 - ISE; 605.203; 302.012; 302.018; 600.049 ID - Francisco Javier Orozco2013 ER -