%0 Conference Proceedings
%T With whom do I interact with? Social interaction detection in egocentric photo-streams
%A Maedeh Aghaei
%A Mariella Dimiccoli
%A Petia Radeva
%B 23rd International Conference on Pattern Recognition
%D 2016
%F Maedeh Aghaei2016
%O MILAB
%O exported from refbase (http://refbase.cvc.uab.es/show.php?record=2791), last updated on Thu, 20 Jan 2022 11:18:30 +0100
%X Given a user wearing a low frame rate wearable camera during a day, this work aims to automatically detect the moments when the user gets engaged into a social interaction solely by reviewing the automatically captured photos by the worn camera. The proposed method, inspired by the sociological concept of F-formation, exploits distance and orientation of the appearing individuals -with respect to the user- in the scene from a bird-view perspective. As a result, the interaction pattern over the sequence can be understood as a two-dimensional time series that corresponds to the temporal evolution of the distance and orientation features over time. A Long-Short Term Memory-based Recurrent Neural Network is then trained to classify each time series. Experimental evaluation over a dataset of 30.000 images has shown promising results on the proposed method for social interaction detection in egocentric photo-streams.
%U http://refbase.cvc.uab.es/files/ADR2016a.pdf