TY - JOUR AU - Ferran Diego AU - Joan Serrat AU - Antonio Lopez PY - 2013// TI - Joint spatio-temporal alignment of sequences T2 - TMM JO - IEEE Transactions on Multimedia SP - 1377 EP - 1387 VL - 15 IS - 6 KW - video alignment N2 - Video alignment is important in different areas of computer vision such as wide baseline matching, action recognition, change detection, video copy detection and frame dropping prevention. Current video alignment methods usually deal with a relatively simple case of fixed or rigidly attached cameras or simultaneous acquisition. Therefore, in this paper we propose a joint video alignment for bringing two video sequences into a spatio-temporal alignment. Specifically, the novelty of the paper is to formulate the video alignment to fold the spatial and temporal alignment into a single alignment framework. This simultaneously satisfies a frame-correspondence and frame-alignment similarity; exploiting the knowledge among neighbor frames by a standard pairwise Markov random field (MRF). This new formulation is able to handle the alignment of sequences recorded at different times by independent moving cameras that follows a similar trajectory, and also generalizes the particular cases that of fixed geometric transformation and/or linear temporal mapping. We conduct experiments on different scenarios such as sequences recorded simultaneously or by moving cameras to validate the robustness of the proposed approach. The proposed method provides the highest video alignment accuracy compared to the state-of-the-art methods on sequences recorded from vehicles driving along the same track at different times. SN - 1520-9210 L1 - http://refbase.cvc.uab.es/files/dsl2013a.pdf UR - http://dx.doi.org/10.1109/TMM.2013.2247390 N1 - ADAS ID - Ferran Diego2013 ER -