{"year":"2020","publisher":"Curran Associates","oa_version":"Preprint","intvolume":"        33","oa":1,"user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","volume":33,"date_created":"2023-09-13T12:03:46Z","title":"Object-centric learning with slot attention","quality_controlled":"1","status":"public","article_processing_charge":"No","external_id":{"arxiv":["2006.15055"]},"date_updated":"2023-09-13T12:19:19Z","publication_identifier":{"isbn":["9781713829546"]},"type":"conference","author":[{"full_name":"Locatello, Francesco","id":"26cfd52f-2483-11ee-8040-88983bcc06d4","last_name":"Locatello","first_name":"Francesco","orcid":"0000-0002-4850-0683"},{"full_name":"Weissenborn, Dirk","first_name":"Dirk","last_name":"Weissenborn"},{"last_name":"Unterthiner","first_name":"Thomas","full_name":"Unterthiner, Thomas"},{"last_name":"Mahendran","first_name":"Aravindh","full_name":"Mahendran, Aravindh"},{"last_name":"Heigold","first_name":"Georg","full_name":"Heigold, Georg"},{"full_name":"Uszkoreit, Jakob","last_name":"Uszkoreit","first_name":"Jakob"},{"last_name":"Dosovitskiy","first_name":"Alexey","full_name":"Dosovitskiy, Alexey"},{"first_name":"Thomas","last_name":"Kipf","full_name":"Kipf, Thomas"}],"publication":"Advances in Neural Information Processing Systems","page":"11525-11538","_id":"14326","language":[{"iso":"eng"}],"department":[{"_id":"FrLo"}],"abstract":[{"lang":"eng","text":"Learning object-centric representations of complex scenes is a promising step towards enabling efficient abstract reasoning from low-level perceptual features. Yet, most deep learning approaches learn distributed representations that do not capture the compositional properties of natural scenes. In this paper, we present the Slot Attention module, an architectural component that interfaces with perceptual representations such as the output of a convolutional neural network and produces a set of task-dependent abstract representations which we call slots. These slots are exchangeable and can bind to any object in the input by specializing through a competitive procedure over multiple rounds of attention. We empirically demonstrate that Slot Attention can extract object-centric representations that enable generalization to unseen compositions when trained on unsupervised object discovery and supervised property prediction tasks.\r\n\r\n"}],"main_file_link":[{"url":"https://doi.org/10.48550/arXiv.2006.15055","open_access":"1"}],"extern":"1","conference":{"name":"NeurIPS: Neural Information Processing Systems","start_date":"2020-12-06","end_date":"2020-12-12","location":"Virtual"},"publication_status":"published","date_published":"2020-01-01T00:00:00Z","citation":{"ieee":"F. Locatello <i>et al.</i>, “Object-centric learning with slot attention,” in <i>Advances in Neural Information Processing Systems</i>, Virtual, 2020, vol. 33, pp. 11525–11538.","mla":"Locatello, Francesco, et al. “Object-Centric Learning with Slot Attention.” <i>Advances in Neural Information Processing Systems</i>, vol. 33, Curran Associates, 2020, pp. 11525–38.","short":"F. Locatello, D. Weissenborn, T. Unterthiner, A. Mahendran, G. Heigold, J. Uszkoreit, A. Dosovitskiy, T. Kipf, in:, Advances in Neural Information Processing Systems, Curran Associates, 2020, pp. 11525–11538.","ista":"Locatello F, Weissenborn D, Unterthiner T, Mahendran A, Heigold G, Uszkoreit J, Dosovitskiy A, Kipf T. 2020. Object-centric learning with slot attention. Advances in Neural Information Processing Systems. NeurIPS: Neural Information Processing Systems vol. 33, 11525–11538.","apa":"Locatello, F., Weissenborn, D., Unterthiner, T., Mahendran, A., Heigold, G., Uszkoreit, J., … Kipf, T. (2020). Object-centric learning with slot attention. In <i>Advances in Neural Information Processing Systems</i> (Vol. 33, pp. 11525–11538). Virtual: Curran Associates.","chicago":"Locatello, Francesco, Dirk Weissenborn, Thomas Unterthiner, Aravindh Mahendran, Georg Heigold, Jakob Uszkoreit, Alexey Dosovitskiy, and Thomas Kipf. “Object-Centric Learning with Slot Attention.” In <i>Advances in Neural Information Processing Systems</i>, 33:11525–38. Curran Associates, 2020.","ama":"Locatello F, Weissenborn D, Unterthiner T, et al. Object-centric learning with slot attention. In: <i>Advances in Neural Information Processing Systems</i>. Vol 33. Curran Associates; 2020:11525-11538."}}