{"related_material":{"record":[{"relation":"extended_version","id":"10802","status":"public"}]},"status":"public","quality_controlled":"1","title":"On the impossibility of fairness-aware learning from corrupted data","scopus_import":"1","publisher":"ML Research Press","date_created":"2023-07-16T22:01:13Z","user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","oa":1,"oa_version":"Preprint","main_file_link":[{"open_access":"1","url":"https://arxiv.org/abs/2102.06004"}],"abstract":[{"lang":"eng","text":"Addressing fairness concerns about machine learning models is a crucial step towards their long-term adoption in real-world automated systems. Many approaches for training fair models from data have been developed and an implicit assumption about such algorithms is that they are able to recover a fair model, despite potential historical biases in the data. In this work we show a number of impossibility results that indicate that there is no learning algorithm that can recover a fair model when a proportion of the dataset is subject to arbitrary manipulations. Specifically, we prove that there are situations in which an adversary can force any learner to return a biased classifier, with or without degrading accuracy, and that the strength of this bias increases for learning problems with underrepresented protected groups in the data. Our results emphasize on the importance of studying further data corruption models of various strength and of establishing stricter data collection practices for fairness-aware learning."}],"department":[{"_id":"ChLa"}],"date_published":"2022-12-01T00:00:00Z","publication_status":"published","date_updated":"2023-09-26T10:44:37Z","article_processing_charge":"No","month":"12","day":"01","type":"conference","acknowledgement":"This paper is a shortened, workshop version of Konstantinov and Lampert (2021),\r\nhttps://arxiv.org/abs/2102.06004. For further results, including an analysis of algorithms achieving the lower bounds from this paper, we refer to the full version.","year":"2022","volume":171,"intvolume":"       171","language":[{"iso":"eng"}],"_id":"13241","citation":{"mla":"Konstantinov, Nikola H., and Christoph Lampert. “On the Impossibility of Fairness-Aware Learning from Corrupted Data.” <i>Proceedings of Machine Learning Research</i>, vol. 171, ML Research Press, 2022, pp. 59–83.","ieee":"N. H. Konstantinov and C. Lampert, “On the impossibility of fairness-aware learning from corrupted data,” in <i>Proceedings of Machine Learning Research</i>, 2022, vol. 171, pp. 59–83.","ama":"Konstantinov NH, Lampert C. On the impossibility of fairness-aware learning from corrupted data. In: <i>Proceedings of Machine Learning Research</i>. Vol 171. ML Research Press; 2022:59-83.","apa":"Konstantinov, N. H., &#38; Lampert, C. (2022). On the impossibility of fairness-aware learning from corrupted data. In <i>Proceedings of Machine Learning Research</i> (Vol. 171, pp. 59–83). ML Research Press.","ista":"Konstantinov NH, Lampert C. 2022. On the impossibility of fairness-aware learning from corrupted data. Proceedings of Machine Learning Research. vol. 171, 59–83.","chicago":"Konstantinov, Nikola H, and Christoph Lampert. “On the Impossibility of Fairness-Aware Learning from Corrupted Data.” In <i>Proceedings of Machine Learning Research</i>, 171:59–83. ML Research Press, 2022.","short":"N.H. Konstantinov, C. Lampert, in:, Proceedings of Machine Learning Research, ML Research Press, 2022, pp. 59–83."},"publication_identifier":{"eissn":["2640-3498"]},"external_id":{"arxiv":["2102.06004"]},"page":"59-83","author":[{"last_name":"Konstantinov","first_name":"Nikola H","full_name":"Konstantinov, Nikola H","id":"4B9D76E4-F248-11E8-B48F-1D18A9856A87"},{"orcid":"0000-0001-8622-7887","first_name":"Christoph","last_name":"Lampert","full_name":"Lampert, Christoph","id":"40C20FD2-F248-11E8-B48F-1D18A9856A87"}],"publication":"Proceedings of Machine Learning Research"}