A flexible selection scheme for minimum-effort transfer learning
Royer A, Lampert C. 2020. A flexible selection scheme for minimum-effort transfer learning. 2020 IEEE Winter Conference on Applications of Computer Vision. WACV: Winter Conference on Applications of Computer Vision, 2180–2189.
Download (ext.)
http://arxiv.org/abs/2008.11995
[Preprint]
Conference Paper
| Published
| English
Scopus indexed
Author
Department
Abstract
Fine-tuning is a popular way of exploiting knowledge contained in a pre-trained convolutional network for a new visual recognition task. However, the orthogonal setting of transferring knowledge from a pretrained network to a visually different yet semantically close source is rarely considered: This commonly happens with real-life data, which is not necessarily as clean as the training source (noise, geometric transformations, different modalities, etc.).To tackle such scenarios, we introduce a new, generalized form of fine-tuning, called flex-tuning, in which any individual unit (e.g. layer) of a network can be tuned, and the most promising one is chosen automatically. In order to make the method appealing for practical use, we propose two lightweight and faster selection procedures that prove to be good approximations in practice. We study these selection criteria empirically across a variety of domain shifts and data scarcity scenarios, and show that fine-tuning individual units, despite its simplicity, yields very good results as an adaptation technique. As it turns out, in contrast to common practice, rather than the last fully-connected unit it is best to tune an intermediate or early one in many domain- shift scenarios, which is accurately detected by flex-tuning.
Publishing Year
Date Published
2020-03-01
Proceedings Title
2020 IEEE Winter Conference on Applications of Computer Vision
Publisher
IEEE
Article Number
2180-2189
Conference
WACV: Winter Conference on Applications of Computer Vision
Conference Location
Snowmass Village, CO, United States
Conference Date
2020-03-01 – 2020-03-05
ISBN
IST-REx-ID
Cite this
Royer A, Lampert C. A flexible selection scheme for minimum-effort transfer learning. In: 2020 IEEE Winter Conference on Applications of Computer Vision. IEEE; 2020. doi:10.1109/WACV45572.2020.9093635
Royer, A., & Lampert, C. (2020). A flexible selection scheme for minimum-effort transfer learning. In 2020 IEEE Winter Conference on Applications of Computer Vision. Snowmass Village, CO, United States: IEEE. https://doi.org/10.1109/WACV45572.2020.9093635
Royer, Amélie, and Christoph Lampert. “A Flexible Selection Scheme for Minimum-Effort Transfer Learning.” In 2020 IEEE Winter Conference on Applications of Computer Vision. IEEE, 2020. https://doi.org/10.1109/WACV45572.2020.9093635.
A. Royer and C. Lampert, “A flexible selection scheme for minimum-effort transfer learning,” in 2020 IEEE Winter Conference on Applications of Computer Vision, Snowmass Village, CO, United States, 2020.
Royer A, Lampert C. 2020. A flexible selection scheme for minimum-effort transfer learning. 2020 IEEE Winter Conference on Applications of Computer Vision. WACV: Winter Conference on Applications of Computer Vision, 2180–2189.
Royer, Amélie, and Christoph Lampert. “A Flexible Selection Scheme for Minimum-Effort Transfer Learning.” 2020 IEEE Winter Conference on Applications of Computer Vision, 2180–2189, IEEE, 2020, doi:10.1109/WACV45572.2020.9093635.
All files available under the following license(s):
Copyright Statement:
This Item is protected by copyright and/or related rights. [...]
Link(s) to Main File(s)
Access Level
Open Access
Material in ISTA:
Dissertation containing ISTA record
Export
Marked PublicationsOpen Data ISTA Research Explorer
Sources
arXiv 2008.11995