Machine Learning Coffee seminar: "Infinitely deep models with continuous-time flows" Markus Heinonen

Weekly seminars held jointly by Aalto University and the University of Helsinki.

Helsinki region machine learning researchers will start our week by an exciting machine learning talk. The aim is to gather people from different fields of science with interest in machine learning. Porridge and coffee is served at 9:00 and the talk will begin at 9:15.

Subscribe to the mailing list where seminar topics are announced beforehand.

Venue: seminar room Exactum D122, Gustaf Hällströmin katu 2b, Kumpula
Date: Monday 10.9.2018

Infinitely deep models with continuous-time flows

Markus Heinonen
Academy of Finland Postdoctoral Fellow, Aalto University

Abstract: Bayesian formalism has recently entered the age of deep models. Deep generative models, such as VAEs, learn unimodal variational representations of complex data objects. Paired with Normalising flows these variational approximations can be successively transformed to the more powerful family of multimodal distributions. Similarly in predictive modelling stacking Gaussian processes into ‘layers’ produces a deep predictive models with increased capacity and multimodality. Both of these approaches are based on evolving random variables with discrete-time transformations, which are seriously hindered by the theoretical requirement of invertibility. We propose a novel paradigm of continuous time ‘flows’ that generalises the concept of discrete transformations into infinite continuous domain. We derive theory from fluid dynamics that does not require invertible transformations. We demonstrate initial results, which exceed the state-of-the-art.

**

See the next talks at the seminar webpage.

Please spread the news and join us for our weekly habit of beginning the week by an interesting machine learning talk!

Welcome!