Search & Display Options
Search within Results:
Field:
author
title
year
keywords
abstract
type
contains:
...
Exclude matches
Display Options:
Field:
all fields
keywords & abstract
additional fields
records per page
Select All
Deselect All
[1–10]
<<
11
12
13
14
>>
List View
|
Citations
|
Details
Record
Links
Author
Xialei Liu; Joost Van de Weijer; Andrew Bagdanov
Title
Exploiting Unlabeled Data in CNNs by Self-Supervised Learning to Rank
Type
Journal Article
Year
2019
Publication
IEEE Transactions on Pattern Analysis and Machine Intelligence
Abbreviated Journal
TPAMI
Volume
41
Issue
8
Pages
1862-1878
Keywords
Task analysis;Training;Image quality;Visualization;Uncertainty;Labeling;Neural networks;Learning from rankings;image quality assessment;crowd counting;active learning
Abstract
For many applications the collection of labeled data is expensive laborious. Exploitation of unlabeled data during training is thus a long pursued objective of machine learning. Self-supervised learning addresses this by positing an auxiliary task (different, but related to the supervised task) for which data is abundantly available. In this paper, we show how ranking can be used as a proxy task for some regression problems. As another contribution, we propose an efficient backpropagation technique for Siamese networks which prevents the redundant computation introduced by the multi-branch network architecture. We apply our framework to two regression problems: Image Quality Assessment (IQA) and Crowd Counting. For both we show how to automatically generate ranked image sets from unlabeled data. Our results show that networks trained to regress to the ground truth targets for labeled data and to simultaneously learn to rank unlabeled data obtain significantly better, state-of-the-art results for both IQA and crowd counting. In addition, we show that measuring network uncertainty on the self-supervised proxy task is a good measure of informativeness of unlabeled data. This can be used to drive an algorithm for active learning and we show that this reduces labeling effort by up to 50 percent.
Address
Corporate Author
Thesis
Publisher
Place of Publication
Editor
Language
Summary Language
Original Title
Series Editor
Series Title
Abbreviated Series Title
Series Volume
Series Issue
Edition
ISSN
ISBN
Medium
Area
Expedition
Conference
Notes
LAMP; 600.109; 600.106; 600.120
Approved
no
Call Number
LWB2019
Serial
3267
Permanent link to this record
Select All
Deselect All
[1–10]
<<
11
12
13
14
>>
List View
|
Citations
|
Details