{"title":"Learning representations for binary-classification without backpropagation","quality_controlled":"1","status":"public","publisher":"ICLR","scopus_import":"1","oa_version":"Published Version","oa":1,"date_created":"2022-01-25T15:50:00Z","user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","department":[{"_id":"GradSch"},{"_id":"ToHe"}],"abstract":[{"text":"The family of feedback alignment (FA) algorithms aims to provide a more biologically motivated alternative to backpropagation (BP), by substituting the computations that are unrealistic to be implemented in physical brains. While FA algorithms have been shown to work well in practice, there is a lack of rigorous theory proofing their learning capabilities. Here we introduce the first feedback alignment algorithm with provable learning guarantees. In contrast to existing work, we do not require any assumption about the size or depth of the network except that it has a single output neuron, i.e., such as for binary classification tasks. We show that our FA algorithm can deliver its theoretical promises in practice, surpassing the learning performance of existing FA methods and matching backpropagation in binary classification tasks. Finally, we demonstrate the limits of our FA variant when the number of output neurons grows beyond a certain quantity.","lang":"eng"}],"main_file_link":[{"open_access":"1","url":"https://openreview.net/forum?id=Bke61krFvS"}],"publication_status":"published","date_published":"2020-03-11T00:00:00Z","article_processing_charge":"No","month":"03","date_updated":"2023-04-03T07:33:40Z","tmp":{"short":"CC BY-NC-ND (3.0)","image":"/images/cc_by_nc_nd.png","name":"Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported (CC BY-NC-ND 3.0)","legal_code_url":"https://creativecommons.org/licenses/by-nc-nd/3.0/legalcode"},"license":"https://creativecommons.org/licenses/by-nc-nd/3.0/","type":"conference","file":[{"date_updated":"2022-01-26T07:35:17Z","success":1,"file_id":"10677","file_size":249431,"date_created":"2022-01-26T07:35:17Z","checksum":"ea13d42dd4541ddb239b6a75821fd6c9","relation":"main_file","content_type":"application/pdf","access_level":"open_access","creator":"mlechner","file_name":"iclr_2020.pdf"}],"day":"11","project":[{"name":"The Wittgenstein Prize","_id":"25F42A32-B435-11E9-9278-68D0E5697425","grant_number":"Z211","call_identifier":"FWF"}],"ddc":["000"],"file_date_updated":"2022-01-26T07:35:17Z","acknowledgement":"This research was supported in part by the Austrian Science Fund (FWF) under grant Z211-N23\r\n(Wittgenstein Award).\r\n","year":"2020","_id":"10672","language":[{"iso":"eng"}],"conference":{"end_date":"2020-05-01","location":"Virtual ; Addis Ababa, Ethiopia","name":"ICLR: International Conference on Learning Representations","start_date":"2020-04-26"},"citation":{"ieee":"M. Lechner, “Learning representations for binary-classification without backpropagation,” in <i>8th International Conference on Learning Representations</i>, Virtual ; Addis Ababa, Ethiopia, 2020.","mla":"Lechner, Mathias. “Learning Representations for Binary-Classification without Backpropagation.” <i>8th International Conference on Learning Representations</i>, ICLR, 2020.","short":"M. Lechner, in:, 8th International Conference on Learning Representations, ICLR, 2020.","apa":"Lechner, M. (2020). Learning representations for binary-classification without backpropagation. In <i>8th International Conference on Learning Representations</i>. Virtual ; Addis Ababa, Ethiopia: ICLR.","chicago":"Lechner, Mathias. “Learning Representations for Binary-Classification without Backpropagation.” In <i>8th International Conference on Learning Representations</i>. ICLR, 2020.","ista":"Lechner M. 2020. Learning representations for binary-classification without backpropagation. 8th International Conference on Learning Representations. ICLR: International Conference on Learning Representations.","ama":"Lechner M. Learning representations for binary-classification without backpropagation. In: <i>8th International Conference on Learning Representations</i>. ICLR; 2020."},"publication":"8th International Conference on Learning Representations","has_accepted_license":"1","author":[{"id":"3DC22916-F248-11E8-B48F-1D18A9856A87","full_name":"Lechner, Mathias","last_name":"Lechner","first_name":"Mathias"}]}