{"title":"Disentangling factors of variation using few labels","quality_controlled":"1","status":"public","oa":1,"oa_version":"Preprint","date_created":"2023-08-22T14:06:37Z","user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","year":"2019","scopus_import":"1","publication_status":"published","date_published":"2019-12-20T00:00:00Z","citation":{"ama":"Locatello F, Tschannen M, Bauer S, Rätsch G, Schölkopf B, Bachem O. Disentangling factors of variation using few labels. In: <i>8th International Conference on Learning Representations</i>. ; 2019.","ista":"Locatello F, Tschannen M, Bauer S, Rätsch G, Schölkopf B, Bachem O. 2019. Disentangling factors of variation using few labels. 8th International Conference on Learning Representations. ICLR: International Conference on Learning Representations.","apa":"Locatello, F., Tschannen, M., Bauer, S., Rätsch, G., Schölkopf, B., &#38; Bachem, O. (2019). Disentangling factors of variation using few labels. In <i>8th International Conference on Learning Representations</i>. Virtual.","chicago":"Locatello, Francesco, Michael Tschannen, Stefan Bauer, Gunnar Rätsch, Bernhard Schölkopf, and Olivier Bachem. “Disentangling Factors of Variation Using Few Labels.” In <i>8th International Conference on Learning Representations</i>, 2019.","short":"F. Locatello, M. Tschannen, S. Bauer, G. Rätsch, B. Schölkopf, O. Bachem, in:, 8th International Conference on Learning Representations, 2019.","mla":"Locatello, Francesco, et al. “Disentangling Factors of Variation Using Few Labels.” <i>8th International Conference on Learning Representations</i>, 2019.","ieee":"F. Locatello, M. Tschannen, S. Bauer, G. Rätsch, B. Schölkopf, and O. Bachem, “Disentangling factors of variation using few labels,” in <i>8th International Conference on Learning Representations</i>, Virtual, 2019."},"extern":"1","conference":{"name":"ICLR: International Conference on Learning Representations","start_date":"2020-04-26","location":"Virtual","end_date":"2020-05-01"},"department":[{"_id":"FrLo"}],"language":[{"iso":"eng"}],"_id":"14184","abstract":[{"text":"Learning disentangled representations is considered a cornerstone problem in\r\nrepresentation learning. Recently, Locatello et al. (2019) demonstrated that\r\nunsupervised disentanglement learning without inductive biases is theoretically\r\nimpossible and that existing inductive biases and unsupervised methods do not\r\nallow to consistently learn disentangled representations. However, in many\r\npractical settings, one might have access to a limited amount of supervision,\r\nfor example through manual labeling of (some) factors of variation in a few\r\ntraining examples. In this paper, we investigate the impact of such supervision\r\non state-of-the-art disentanglement methods and perform a large scale study,\r\ntraining over 52000 models under well-defined and reproducible experimental\r\nconditions. We observe that a small number of labeled examples (0.01--0.5\\% of\r\nthe data set), with potentially imprecise and incomplete labels, is sufficient\r\nto perform model selection on state-of-the-art unsupervised models. Further, we\r\ninvestigate the benefit of incorporating supervision into the training process.\r\nOverall, we empirically validate that with little and imprecise supervision it\r\nis possible to reliably learn disentangled representations.","lang":"eng"}],"main_file_link":[{"open_access":"1","url":"https://arxiv.org/abs/1905.01258"}],"type":"conference","day":"20","author":[{"orcid":"0000-0002-4850-0683","last_name":"Locatello","first_name":"Francesco","full_name":"Locatello, Francesco","id":"26cfd52f-2483-11ee-8040-88983bcc06d4"},{"last_name":"Tschannen","first_name":"Michael","full_name":"Tschannen, Michael"},{"full_name":"Bauer, Stefan","first_name":"Stefan","last_name":"Bauer"},{"full_name":"Rätsch, Gunnar","last_name":"Rätsch","first_name":"Gunnar"},{"full_name":"Schölkopf, Bernhard","last_name":"Schölkopf","first_name":"Bernhard"},{"full_name":"Bachem, Olivier","last_name":"Bachem","first_name":"Olivier"}],"publication":"8th International Conference on Learning Representations","external_id":{"arxiv":["1905.01258"]},"month":"12","article_processing_charge":"No","date_updated":"2023-09-12T07:01:34Z"}