{"date_published":"2019-08-01T00:00:00Z","publication_status":"published","department":[{"_id":"GaTk"}],"abstract":[{"lang":"eng","text":"We derive a tight lower bound on equivocation (conditional entropy), or equivalently a tight upper bound on mutual information between a signal variable and channel outputs. The bound is in terms of the joint distribution of the signals and maximum a posteriori decodes (most probable signals given channel output). As part of our derivation, we describe the key properties of the distribution of signals, channel outputs and decodes, that minimizes equivocation and maximizes mutual information. This work addresses a problem in data analysis, where mutual information between signals and decodes is sometimes used to lower bound the mutual information between signals and channel outputs. Our result provides a corresponding upper bound."}],"main_file_link":[{"url":"https://arxiv.org/abs/1812.01475","open_access":"1"}],"type":"conference","day":"01","article_processing_charge":"No","month":"08","date_updated":"2024-03-06T14:22:51Z","title":"A tight upper bound on mutual information","quality_controlled":"1","related_material":{"record":[{"id":"15020","relation":"dissertation_contains","status":"public"}]},"status":"public","oa":1,"oa_version":"Preprint","date_created":"2020-03-22T23:00:47Z","user_id":"c635000d-4b10-11ee-a964-aac5a93f6ac1","publisher":"IEEE","scopus_import":"1","ec_funded":1,"conference":{"location":"Visby, Sweden","end_date":"2019-08-28","start_date":"2019-08-25","name":"Information Theory Workshop"},"citation":{"mla":"Hledik, Michal, et al. “A Tight Upper Bound on Mutual Information.” <i>IEEE Information Theory Workshop, ITW 2019</i>, 8989292, IEEE, 2019, doi:<a href=\"https://doi.org/10.1109/ITW44776.2019.8989292\">10.1109/ITW44776.2019.8989292</a>.","ieee":"M. Hledik, T. R. Sokolowski, and G. Tkačik, “A tight upper bound on mutual information,” in <i>IEEE Information Theory Workshop, ITW 2019</i>, Visby, Sweden, 2019.","apa":"Hledik, M., Sokolowski, T. R., &#38; Tkačik, G. (2019). A tight upper bound on mutual information. In <i>IEEE Information Theory Workshop, ITW 2019</i>. Visby, Sweden: IEEE. <a href=\"https://doi.org/10.1109/ITW44776.2019.8989292\">https://doi.org/10.1109/ITW44776.2019.8989292</a>","chicago":"Hledik, Michal, Thomas R Sokolowski, and Gašper Tkačik. “A Tight Upper Bound on Mutual Information.” In <i>IEEE Information Theory Workshop, ITW 2019</i>. IEEE, 2019. <a href=\"https://doi.org/10.1109/ITW44776.2019.8989292\">https://doi.org/10.1109/ITW44776.2019.8989292</a>.","ista":"Hledik M, Sokolowski TR, Tkačik G. 2019. A tight upper bound on mutual information. IEEE Information Theory Workshop, ITW 2019. Information Theory Workshop, 8989292.","ama":"Hledik M, Sokolowski TR, Tkačik G. A tight upper bound on mutual information. In: <i>IEEE Information Theory Workshop, ITW 2019</i>. IEEE; 2019. doi:<a href=\"https://doi.org/10.1109/ITW44776.2019.8989292\">10.1109/ITW44776.2019.8989292</a>","short":"M. Hledik, T.R. Sokolowski, G. Tkačik, in:, IEEE Information Theory Workshop, ITW 2019, IEEE, 2019."},"language":[{"iso":"eng"}],"article_number":"8989292","_id":"7606","doi":"10.1109/ITW44776.2019.8989292","author":[{"full_name":"Hledik, Michal","id":"4171253A-F248-11E8-B48F-1D18A9856A87","first_name":"Michal","last_name":"Hledik"},{"orcid":"0000-0002-1287-3779","full_name":"Sokolowski, Thomas R","id":"3E999752-F248-11E8-B48F-1D18A9856A87","first_name":"Thomas R","last_name":"Sokolowski"},{"id":"3D494DCA-F248-11E8-B48F-1D18A9856A87","full_name":"Tkačik, Gašper","last_name":"Tkačik","first_name":"Gašper","orcid":"0000-0002-6699-1455"}],"publication":"IEEE Information Theory Workshop, ITW 2019","external_id":{"isi":["000540384500015"],"arxiv":["1812.01475"]},"publication_identifier":{"isbn":["9781538669006"]},"isi":1,"project":[{"call_identifier":"H2020","_id":"2564DBCA-B435-11E9-9278-68D0E5697425","name":"International IST Doctoral Program","grant_number":"665385"}],"year":"2019"}