Timezone: »

Memory-Based Dual Gaussian Processes for Sequential Learning
Paul Chang · Prakhar Verma · ST John · Arno Solin · Khan Emtiyaz

Tue Jul 25 02:00 PM -- 04:30 PM (PDT) @ Exhibit Hall 1 #536

Sequential learning with Gaussian processes (GPs) is challenging when access to past data is limited, for example, in continual and active learning. In such cases, errors can accumulate over time due to inaccuracies in the posterior, hyperparameters, and inducing points, making accurate learning challenging. Here, we present a method to keep all such errors in check using the recently proposed dual sparse variational GP. Our method enables accurate inference for generic likelihoods and improves learning by actively building and updating a memory of past data. We demonstrate its effectiveness in several applications involving Bayesian optimization, active learning, and continual learning.

Author Information

Paul Chang (Aalto University)
Prakhar Verma (Aalto University)
ST John (Aalto University, Finnish Center for Artificial Intelligence)
Arno Solin (Aalto University)
Arno Solin

Dr. Arno Solin is Assistant Professor in Machine Learning at the Department of Computer Science, Aalto University, Finland, and Adjunct Professor (Docent) at Tampere University, Finland. His research focuses on probabilistic models combining statistical machine learning and signal processing with applications in sensor fusion, robotics, computer vision, and online decision making. He has published around 50 peer-reviewed articles and one book. Previously, he has been a visiting researcher at Uppsala University (2019), University of Cambridge (2017-2018), and University of Sheffield (2014), and worked as a Team Lead in a tech startup. Prof. Solin is the winner of several prizes, hackathons, and modelling competitions, including the Schizophrenia Classification Challenge on Kaggle and the ISIF Jean-Pierre Le Cadre Best Paper Award. Homepage: http://arno.solin.fi

Khan Emtiyaz (RIKEN)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors