| |
Records |
Links |
|
Author |
German Barquero; Johnny Nuñez; Sergio Escalera; Zhen Xu; Wei-Wei Tu; Isabelle Guyon |
|
| |
Title |
Didn’t see that coming: a survey on non-verbal social human behavior forecasting |
Type |
Conference Article |
| |
Year |
2022 |
Publication |
Understanding Social Behavior in Dyadic and Small Group Interactions |
Abbreviated Journal |
|
|
| |
Volume |
173 |
Issue |
|
Pages |
139-178 |
|
| |
Keywords |
|
|
| |
Abstract |
Non-verbal social human behavior forecasting has increasingly attracted the interest of the research community in recent years. Its direct applications to human-robot interaction and socially-aware human motion generation make it a very attractive field. In this survey, we define the behavior forecasting problem for multiple interactive agents in a generic way that aims at unifying the fields of social signals prediction and human motion forecasting, traditionally separated. We hold that both problem formulations refer to the same conceptual problem, and identify many shared fundamental challenges: future stochasticity, context awareness, history exploitation, etc. We also propose a taxonomy that comprises
methods published in the last 5 years in a very informative way and describes the current main concerns of the community with regard to this problem. In order to promote further research on this field, we also provide a summarized and friendly overview of audiovisual datasets featuring non-acted social interactions. Finally, we describe the most common metrics used in this task and their particular issues. |
|
| |
Address |
Virtual; June 2022 |
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
PMLR |
|
| |
Notes  |
HuPBA; no proj |
Approved |
no |
|
| |
Call Number |
Admin @ si @ BNE2022 |
Serial |
3766 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Sergio Escalera; R. M. Martinez; Jordi Vitria; Petia Radeva; Maria Teresa Anguera |
|
| |
Title |
Dominance Detection in Face-to-face Conversations |
Type |
Conference Article |
| |
Year |
2009 |
Publication |
2nd IEEE Workshop on CVPR for Human communicative Behavior analysis |
Abbreviated Journal |
|
|
| |
Volume |
|
Issue |
|
Pages |
97–102 |
|
| |
Keywords |
|
|
| |
Abstract |
Dominance is referred to the level of influence a person has in a conversation. Dominance is an important research area in social psychology, but the problem of its automatic estimation is a very recent topic in the contexts of social and wearable computing. In this paper, we focus on dominance detection from visual cues. We estimate the correlation among observers by categorizing the dominant people in a set of face-to-face conversations. Different dominance indicators from gestural communication are defined, manually annotated, and compared to the observers opinion. Moreover, the considered indicators are automatically extracted from video sequences and learnt by using binary classifiers. Results from the three analysis shows a high correlation and allows the categorization of dominant people in public discussion video sequences. |
|
| |
Address |
Miami, USA |
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
2160-7508 |
ISBN |
978-1-4244-3994-2 |
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
CVPR |
|
| |
Notes |
HuPBA; OR; MILAB;MV |
Approved |
no |
|
| |
Call Number |
BCNPCL @ bcnpcl @ EMV2009 |
Serial |
1227 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Sergio Escalera; R. M. Martinez; Jordi Vitria; Petia Radeva; Maria Teresa Anguera |
|
| |
Title |
Deteccion automatica de la dominancia en conversaciones diadicas |
Type |
Journal Article |
| |
Year |
2010 |
Publication |
Escritos de Psicologia |
Abbreviated Journal |
EP |
|
| |
Volume |
3 |
Issue |
2 |
Pages |
41–45 |
|
| |
Keywords |
Dominance detection; Non-verbal communication; Visual features |
|
| |
Abstract |
Dominance is referred to the level of influence that a person has in a conversation. Dominance is an important research area in social psychology, but the problem of its automatic estimation is a very recent topic in the contexts of social and wearable computing. In this paper, we focus on the dominance detection of visual cues. We estimate the correlation among observers by categorizing the dominant people in a set of face-to-face conversations. Different dominance indicators from gestural communication are defined, manually annotated, and compared to the observers' opinion. Moreover, these indicators are automatically extracted from video sequences and learnt by using binary classifiers. Results from the three analyses showed a high correlation and allows the categorization of dominant people in public discussion video sequences. |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
1989-3809 |
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
HUPBA; OR; MILAB;MV |
Approved |
no |
|
| |
Call Number |
BCNPCL @ bcnpcl @ EMV2010 |
Serial |
1315 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Oriol Pujol |
|
| |
Title |
Model-based three dimensional interpolation of IVUS images |
Type |
Report |
| |
Year |
1999 |
Publication |
CVC Technical Report #27 |
Abbreviated Journal |
|
|
| |
Volume |
|
Issue |
|
Pages |
|
|
| |
Keywords |
|
|
| |
Abstract |
|
|
| |
Address |
CVC (UAB) |
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
HuPBA;MILAB |
Approved |
no |
|
| |
Call Number |
BCNPCL @ bcnpcl @ Puj1999 |
Serial |
49 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Oriol Pujol |
|
| |
Title |
A semi-Supervised Statistical Framework and Generative Snakes for IVUS Analysis |
Type |
Book Whole |
| |
Year |
2004 |
Publication |
PhD Thesis, Universitat Autonoma de Barcelona-CVC |
Abbreviated Journal |
|
|
| |
Volume |
|
Issue |
|
Pages |
|
|
| |
Keywords |
|
|
| |
Abstract |
|
|
| |
Address |
CVC (UAB), Bellaterra |
|
| |
Corporate Author |
|
Thesis |
Ph.D. thesis |
|
| |
Publisher |
|
Place of Publication |
|
Editor |
Petia Radeva |
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
HuPBA;MILAB |
Approved |
no |
|
| |
Call Number |
BCNPCL @ bcnpcl @ Puj2004 |
Serial |
512 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Antonio Hernandez |
|
| |
Title |
Pose and Face Recovery via Spatio-temporal GrabCut Human Segmentation |
Type |
Report |
| |
Year |
2010 |
Publication |
CVC Technical Report |
Abbreviated Journal |
|
|
| |
Volume |
153 |
Issue |
|
Pages |
|
|
| |
Keywords |
|
|
| |
Abstract |
|
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
Master's thesis |
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
HUPBA;MILAB |
Approved |
no |
|
| |
Call Number |
Admin @ si @ Her2010 |
Serial |
1347 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Eloi Puertas; Sergio Escalera; Oriol Pujol |
|
| |
Title |
Classifying Objects at Different Sizes with Multi-Scale Stacked Sequential Learning |
Type |
Conference Article |
| |
Year |
2010 |
Publication |
13th International Conference of the Catalan Association for Artificial Intelligence |
Abbreviated Journal |
|
|
| |
Volume |
220 |
Issue |
|
Pages |
193–200 |
|
| |
Keywords |
|
|
| |
Abstract |
Sequential learning is that discipline of machine learning that deals with dependent data. In this paper, we use the Multi-scale Stacked Sequential Learning approach (MSSL) to solve the task of pixel-wise classification based on contextual information. The main contribution of this work is a shifting technique applied during the testing phase that makes possible, thanks to template images, to classify objects at different sizes. The results show that the proposed method robustly classifies such objects capturing their spatial relationships. |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
R. Alquezar, A. Moreno, J. Aguilar |
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
978-1-60750-642-3 |
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
CCIA |
|
| |
Notes |
HUPBA;MILAB |
Approved |
no |
|
| |
Call Number |
BCNPCL @ bcnpcl @ PEP2010 |
Serial |
1448 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Xavier Perez Sala; Cecilio Angulo; Sergio Escalera |
|
| |
Title |
Biologically Inspired Turn Control in Robot Navigation |
Type |
Conference Article |
| |
Year |
2011 |
Publication |
14th Congrès Català en Intel·ligencia Artificial |
Abbreviated Journal |
|
|
| |
Volume |
|
Issue |
|
Pages |
187-196 |
|
| |
Keywords |
|
|
| |
Abstract |
An exportable and robust system for turn control using only camera images is proposed for path execution in robot navigation. Robot motion information is extracted in the form of optical flow from SURF robust descriptors of consecutive frames in the image sequence. This information is used to compute the instantaneous rotation angle. Finally, control loop is closed correcting robot displacements when it is requested for a turn command. The proposed system has been successfully tested on the four-legged Sony Aibo robot. |
|
| |
Address |
Lleida |
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
978-1-60750-841-0 |
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
CCIA |
|
| |
Notes |
HuPBA;MILAB |
Approved |
no |
|
| |
Call Number |
Admin @ si @ PAE2011a |
Serial |
1753 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Eloi Puertas; Sergio Escalera; Oriol Pujol |
|
| |
Title |
Multi-Class Multi-Scale Stacked Sequential Learning |
Type |
Conference Article |
| |
Year |
2011 |
Publication |
10th International Conference on Multiple Classifier Systems |
Abbreviated Journal |
|
|
| |
Volume |
6713 |
Issue |
|
Pages |
197-206 |
|
| |
Keywords |
|
|
| |
Abstract |
|
|
| |
Address |
Napoles, Italy |
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
Springer |
Place of Publication |
|
Editor |
Carlo Sansone; Josef Kittler; Fabio Roli |
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
MCS |
|
| |
Notes |
HuPBA;MILAB |
Approved |
no |
|
| |
Call Number |
Admin @ si @ PEP2011b |
Serial |
1772 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Xavier Perez Sala; Cecilio Angulo; Sergio Escalera |
|
| |
Title |
Biologically Inspired Path Execution Using SURF Flow in Robot Navigation |
Type |
Conference Article |
| |
Year |
2011 |
Publication |
11th International Work Conference on Artificial Neural Networks |
Abbreviated Journal |
|
|
| |
Volume |
II |
Issue |
|
Pages |
581--588 |
|
| |
Keywords |
|
|
| |
Abstract |
An exportable and robust system using only camera images is proposed for path execution in robot navigation. Motion information is extracted in the form of optical flow from SURF robust descriptors of consecutive frames, so the method is called SURF flow. This information is used to correct robot displacement when a straight forward path command is sent to the robot, but it is not really executed due to several robot and environmental concerns. The proposed system has been successfully tested on the legged robot Aibo. |
|
| |
Address |
Malaga |
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
Springer Berlin Heidelberg |
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
0302-9743 |
ISBN |
978-3-642-21497-4 |
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
IWANN |
|
| |
Notes |
HuPBA;MILAB |
Approved |
no |
|
| |
Call Number |
Admin @ si @ PAE2011b |
Serial |
1773 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Sergio Escalera |
|
| |
Title |
Multi-Modal Human Behaviour Analysis from Visual Data Sources |
Type |
Journal |
| |
Year |
2013 |
Publication |
ERCIM News journal |
Abbreviated Journal |
ERCIM |
|
| |
Volume |
95 |
Issue |
|
Pages |
21-22 |
|
| |
Keywords |
|
|
| |
Abstract |
The Human Pose Recovery and Behaviour Analysis group (HuPBA), University of Barcelona, is developing a line of research on multi-modal analysis of humans in visual data. The novel technology is being applied in several scenarios with high social impact, including sign language recognition, assisted technology and supported diagnosis for the elderly and people with mental/physical disabilities, fitness conditioning, and Human Computer Interaction. |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
0926-4981 |
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
|
|
| |
Notes |
HuPBA;MILAB |
Approved |
no |
|
| |
Call Number |
Admin @ si @ Esc2013 |
Serial |
2361 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Alex Pardo; Albert Clapes; Sergio Escalera; Oriol Pujol |
|
| |
Title |
Actions in Context: System for people with Dementia |
Type |
Conference Article |
| |
Year |
2013 |
Publication |
2nd International Workshop on Citizen Sensor Networks (Citisen2013) at the European Conference on Complex Systems |
Abbreviated Journal |
|
|
| |
Volume |
|
Issue |
|
Pages |
3-14 |
|
| |
Keywords |
Multi-modal data Fusion; Computer vision; Wearable sensors; Gesture recognition; Dementia |
|
| |
Abstract |
In the next forty years, the number of people living with dementia is expected to triple. In the last stages, people affected by this disease become dependent. This hinders the autonomy of the patient and has a huge social impact in time, money and effort. Given this scenario, we propose an ubiquitous system capable of recognizing daily specific actions. The system fuses and synchronizes data obtained from two complementary modalities – ambient and egocentric. The ambient approach consists in a fixed RGB-Depth camera for user and object recognition and user-object interaction, whereas the egocentric point of view is given by a personal area network (PAN) formed by a few wearable sensors and a smartphone, used for gesture recognition. The system processes multi-modal data in real-time, performing paralleled task recognition and modality synchronization, showing high performance recognizing subjects, objects, and interactions, showing its reliability to be applied in real case scenarios. |
|
| |
Address |
Barcelona; September 2013 |
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
Springer International Publishing |
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
0302-9743 |
ISBN |
978-3-319-04177-3 |
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
ECCS |
|
| |
Notes |
HUPBA;MILAB |
Approved |
no |
|
| |
Call Number |
Admin @ si @ PCE2013 |
Serial |
2354 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Miguel Reyes; Gabriel Dominguez; Sergio Escalera |
|
| |
Title |
Feature Weighting in Dynamic Time Warping for Gesture Recognition in Depth Data |
Type |
Conference Article |
| |
Year |
2011 |
Publication |
1st IEEE Workshop on Consumer Depth Cameras for Computer Vision |
Abbreviated Journal |
|
|
| |
Volume |
|
Issue |
|
Pages |
1182-1188 |
|
| |
Keywords |
|
|
| |
Abstract |
We present a gesture recognition approach for depth video data based on a novel Feature Weighting approach within the Dynamic Time Warping framework. Depth features from human joints are compared through video sequences using Dynamic Time Warping, and weights are assigned to features based on inter-intra class gesture variability. Feature Weighting in Dynamic Time Warping is then applied for recognizing begin-end of gestures in data sequences. The obtained results recognizing several gestures in depth data show high performance compared with classical Dynamic Time Warping approach. |
|
| |
Address |
|
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
978-1-4673-0062-9 |
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
CDC4CV |
|
| |
Notes |
HuPBA;MILAB |
Approved |
no |
|
| |
Call Number |
Admin @ si @ RDE2011 |
Serial |
1893 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Alvaro Cepero; Albert Clapes; Sergio Escalera |
|
| |
Title |
Quantitative analysis of non-verbal communication for competence analysis |
Type |
Conference Article |
| |
Year |
2013 |
Publication |
16th Catalan Conference on Artificial Intelligence |
Abbreviated Journal |
|
|
| |
Volume |
256 |
Issue |
|
Pages |
105-114 |
|
| |
Keywords |
|
|
| |
Abstract |
|
|
| |
Address |
Vic; October 2013 |
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
|
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
|
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
|
ISBN |
|
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
CCIA |
|
| |
Notes |
HUPBA;MILAB |
Approved |
no |
|
| |
Call Number |
Admin @ si @ CCE2013 |
Serial |
2324 |
|
| Permanent link to this record |
| |
|
| |
|
Author |
Albert Clapes; Miguel Reyes; Sergio Escalera |
|
| |
Title |
User Identification and Object Recognition in Clutter Scenes Based on RGB-Depth Analysis |
Type |
Conference Article |
| |
Year |
2012 |
Publication |
7th Conference on Articulated Motion and Deformable Objects |
Abbreviated Journal |
|
|
| |
Volume |
7378 |
Issue |
|
Pages |
1-11 |
|
| |
Keywords |
|
|
| |
Abstract |
We propose an automatic system for user identification and object recognition based on multi-modal RGB-Depth data analysis. We model a RGBD environment learning a pixel-based background Gaussian distribution. Then, user and object candidate regions are detected and recognized online using robust statistical approaches over RGBD descriptions. Finally, the system saves the historic of user-object assignments, being specially useful for surveillance scenarios. The system has been evaluated on a novel data set containing different indoor/outdoor scenarios, objects, and users, showing accurate recognition and better performance than standard state-of-the-art approaches. |
|
| |
Address |
Mallorca |
|
| |
Corporate Author |
|
Thesis |
|
|
| |
Publisher |
Springer Berlin Heidelberg |
Place of Publication |
|
Editor |
|
|
| |
Language |
|
Summary Language |
|
Original Title |
|
|
| |
Series Editor |
|
Series Title |
|
Abbreviated Series Title |
LNCS |
|
| |
Series Volume |
|
Series Issue |
|
Edition |
|
|
| |
ISSN |
0302-9743 |
ISBN |
978-3-642-31566-4 |
Medium |
|
|
| |
Area |
|
Expedition |
|
Conference |
AMDO |
|
| |
Notes |
HUPBA;MILAB |
Approved |
no |
|
| |
Call Number |
Admin @ si @ CRE2012 |
Serial |
2010 |
|
| Permanent link to this record |
