{"status":"public","quality_controlled":"1","title":"SOM-VAE: Interpretable discrete representation learning on time series","year":"2018","user_id":"2DF688A6-F248-11E8-B48F-1D18A9856A87","date_created":"2023-08-22T14:12:48Z","oa":1,"oa_version":"Preprint","abstract":[{"lang":"eng","text":"High-dimensional time series are common in many domains. Since human\r\ncognition is not optimized to work well in high-dimensional spaces, these areas\r\ncould benefit from interpretable low-dimensional representations. However, most\r\nrepresentation learning algorithms for time series data are difficult to\r\ninterpret. This is due to non-intuitive mappings from data features to salient\r\nproperties of the representation and non-smoothness over time. To address this\r\nproblem, we propose a new representation learning framework building on ideas\r\nfrom interpretable discrete dimensionality reduction and deep generative\r\nmodeling. This framework allows us to learn discrete representations of time\r\nseries, which give rise to smooth and interpretable embeddings with superior\r\nclustering performance. We introduce a new way to overcome the\r\nnon-differentiability in discrete representation learning and present a\r\ngradient-based version of the traditional self-organizing map algorithm that is\r\nmore performant than the original. Furthermore, to allow for a probabilistic\r\ninterpretation of our method, we integrate a Markov model in the representation\r\nspace. This model uncovers the temporal transition structure, improves\r\nclustering performance even further and provides additional explanatory\r\ninsights as well as a natural representation of uncertainty. We evaluate our\r\nmodel in terms of clustering performance and interpretability on static\r\n(Fashion-)MNIST data, a time series of linearly interpolated (Fashion-)MNIST\r\nimages, a chaotic Lorenz attractor system with two macro states, as well as on\r\na challenging real world medical time series application on the eICU data set.\r\nOur learned representations compare favorably with competitor methods and\r\nfacilitate downstream tasks on the real world data."}],"main_file_link":[{"open_access":"1","url":"https://arxiv.org/abs/1806.02199"}],"language":[{"iso":"eng"}],"department":[{"_id":"FrLo"}],"_id":"14198","date_published":"2018-06-06T00:00:00Z","publication_status":"published","citation":{"mla":"Fortuin, Vincent, et al. “SOM-VAE: Interpretable Discrete Representation Learning on Time Series.” <i>International Conference on Learning Representations</i>, 2018.","ieee":"V. Fortuin, M. Hüser, F. Locatello, H. Strathmann, and G. Rätsch, “SOM-VAE: Interpretable discrete representation learning on time series,” in <i>International Conference on Learning Representations</i>, New Orleans, LA, United States, 2018.","ama":"Fortuin V, Hüser M, Locatello F, Strathmann H, Rätsch G. SOM-VAE: Interpretable discrete representation learning on time series. In: <i>International Conference on Learning Representations</i>. ; 2018.","ista":"Fortuin V, Hüser M, Locatello F, Strathmann H, Rätsch G. 2018. SOM-VAE: Interpretable discrete representation learning on time series. International Conference on Learning Representations. ICLR: International Conference on Learning Representations.","chicago":"Fortuin, Vincent, Matthias Hüser, Francesco Locatello, Heiko Strathmann, and Gunnar Rätsch. “SOM-VAE: Interpretable Discrete Representation Learning on Time Series.” In <i>International Conference on Learning Representations</i>, 2018.","apa":"Fortuin, V., Hüser, M., Locatello, F., Strathmann, H., &#38; Rätsch, G. (2018). SOM-VAE: Interpretable discrete representation learning on time series. In <i>International Conference on Learning Representations</i>. New Orleans, LA, United States.","short":"V. Fortuin, M. Hüser, F. Locatello, H. Strathmann, G. Rätsch, in:, International Conference on Learning Representations, 2018."},"conference":{"end_date":"2019-05-09","location":"New Orleans, LA, United States","name":"ICLR: International Conference on Learning Representations","start_date":"2019-05-06"},"extern":"1","date_updated":"2023-09-13T06:35:12Z","external_id":{"arxiv":["1806.02199"]},"month":"06","article_processing_charge":"No","author":[{"first_name":"Vincent","last_name":"Fortuin","full_name":"Fortuin, Vincent"},{"first_name":"Matthias","last_name":"Hüser","full_name":"Hüser, Matthias"},{"orcid":"0000-0002-4850-0683","id":"26cfd52f-2483-11ee-8040-88983bcc06d4","full_name":"Locatello, Francesco","first_name":"Francesco","last_name":"Locatello"},{"full_name":"Strathmann, Heiko","first_name":"Heiko","last_name":"Strathmann"},{"full_name":"Rätsch, Gunnar","last_name":"Rätsch","first_name":"Gunnar"}],"day":"06","publication":"International Conference on Learning Representations","type":"conference"}