| Home | << 1 >> |
|
| Records | |||||
|---|---|---|---|---|---|
| Author | Boris N. Oreshkin; Pau Rodriguez; Alexandre Lacoste | ||||
| Title | TADAM: Task dependent adaptive metric for improved few-shot learning | Type | Conference Article | ||
| Year | 2018 | Publication  |
32nd Annual Conference on Neural Information Processing Systems | Abbreviated Journal | |
| Volume | Issue | Pages | |||
| Keywords | |||||
| Abstract | Few-shot learning has become essential for producing models that generalize from few examples. In this work, we identify that metric scaling and metric task conditioning are important to improve the performance of few-shot algorithms. Our analysis reveals that simple metric scaling completely changes the nature of few-shot algorithm parameter updates. Metric scaling provides improvements up to 14% in accuracy for certain metrics on the mini-Imagenet 5-way 5-shot classification task. We further propose a simple and effective way of conditioning a learner on the task sample set, resulting in learning a task-dependent metric space. Moreover, we propose and empirically test a practical end-to-end optimization procedure based on auxiliary task co-training to learn a task-dependent metric space. The resulting few-shot learning model based on the task-dependent scaled metric achieves state of the art on mini-Imagenet. We confirm these results on another few-shot dataset that we introduce in this paper based on CIFAR100. | ||||
| Address | Montreal; Canada; December 2018 | ||||
| Corporate Author | Thesis | ||||
| Publisher | Place of Publication | Editor | |||
| Language | Summary Language | Original Title | |||
| Series Editor | Series Title | Abbreviated Series Title | |||
| Series Volume | Series Issue | Edition | |||
| ISSN | ISBN | Medium | |||
| Area | Expedition | Conference | NIPS | ||
| Notes | ISE; 600.098; 600.119 | Approved | no | ||
| Call Number | Admin @ si @ ORL2018 | Serial | 3140 | ||
| Permanent link to this record | |||||
| Author | Abel Gonzalez-Garcia; Joost Van de Weijer; Yoshua Bengio | ||||
| Title | Image-to-image translation for cross-domain disentanglement | Type | Conference Article | ||
| Year | 2018 | Publication |
32nd Annual Conference on Neural Information Processing Systems | Abbreviated Journal | |
| Volume | Issue | Pages | |||
| Keywords | |||||
| Abstract | |||||
| Address | Montreal; Canada; December 2018 | ||||
| Corporate Author | Thesis | ||||
| Publisher | Place of Publication | Editor | |||
| Language | Summary Language | Original Title | |||
| Series Editor | Series Title | Abbreviated Series Title | |||
| Series Volume | Series Issue | Edition | |||
| ISSN | ISBN | Medium | |||
| Area | Expedition | Conference | NIPS | ||
| Notes | LAMP; 600.120 | Approved | no | ||
| Call Number | Admin @ si @ GWB2018 | Serial | 3155 | ||
| Permanent link to this record | |||||
| Author | Chenshen Wu; Luis Herranz; Xialei Liu; Joost Van de Weijer; Bogdan Raducanu | ||||
| Title | Memory Replay GANs: Learning to Generate New Categories without Forgetting | Type | Conference Article | ||
| Year | 2018 | Publication |
32nd Annual Conference on Neural Information Processing Systems | Abbreviated Journal | |
| Volume | Issue | Pages | 5966-5976 | ||
| Keywords | |||||
| Abstract | Previous works on sequential learning address the problem of forgetting in discriminative models. In this paper we consider the case of generative models. In particular, we investigate generative adversarial networks (GANs) in the task of learning new categories in a sequential fashion. We first show that sequential fine tuning renders the network unable to properly generate images from previous categories (ie forgetting). Addressing this problem, we propose Memory Replay GANs (MeRGANs), a conditional GAN framework that integrates a memory replay generator. We study two methods to prevent forgetting by leveraging these replays, namely joint training with replay and replay alignment. Qualitative and quantitative experimental results in MNIST, SVHN and LSUN datasets show that our memory replay approach can generate competitive images while significantly mitigating the forgetting of previous categories. | ||||
| Address | Montreal; Canada; December 2018 | ||||
| Corporate Author | Thesis | ||||
| Publisher | Place of Publication | Editor | |||
| Language | Summary Language | Original Title | |||
| Series Editor | Series Title | Abbreviated Series Title | |||
| Series Volume | Series Issue | Edition | |||
| ISSN | ISBN | Medium | |||
| Area | Expedition | Conference | NIPS | ||
| Notes | LAMP; 600.106; 600.109; 602.200; 600.120 | Approved | no | ||
| Call Number | Admin @ si @ WHL2018 | Serial | 3249 | ||
| Permanent link to this record | |||||