TY  - CONF
AU  - Idoia Ruiz
AU  - Lorenzo Porzi
AU  - Samuel Rota Bulo
AU  - Peter Kontschieder
AU  - Joan Serrat
A2  - WACVW
PY  - 2021//
TI  - Weakly Supervised Multi-Object Tracking and Segmentation
BT  - IEEE Winter Conference on Applications of Computer Vision Workshops
SP  - 125
EP  - 133
N2  - We introduce the problem of weakly supervised MultiObject Tracking and Segmentation, i.e. joint weakly supervised instance segmentation and multi-object tracking, in which we do not provide any kind of mask annotation.To address it, we design a novel synergistic training strategy by taking advantage of multi-task learning, i.e. classification and tracking tasks guide the training of the unsupervised instance segmentation. For that purpose, we extract weak foreground localization information, provided byGrad-CAM heatmaps, to generate a partial ground truth to learn from. Additionally, RGB image level information is employed to refine the mask prediction at the edges of theobjects. We evaluate our method on KITTI MOTS, the most representative benchmark for this task, reducing the performance gap on the MOTSP metric between the fully supervised and weakly supervised approach to just 12% and 12.7 % for cars and pedestrians, respectively.
L1  - http://refbase.cvc.uab.es/files/RPR2021.pdf
N1  - ADAS; 600.118; 600.124
ID  - Idoia Ruiz2021
ER  -