Expo Workshop

The theme of this workshop will be real world applications of reinforcement learning. We will give a demo/tutorial of the latest features and additions to Azure Personalizer, an award winning and easy to use RL cloud service (https://azure.microsoft.com/en-us/services/cognitive-services/personalizer/). The first release of Personalizer was presented in an ICML 2019 workshop. We will present the latest additions to the service, including multi-slot personalization.

We will demonstrate how to leverage the latest release of Vowpal Wabbit, an open source machine learning library (https://vowpalwabbit.org/). It provides fast, scalable machine learning and has unique capabilities such as learning to search, active learning, contextual memory, and extreme multiclass learning. It has a focus on reinforcement learning and provides production ready implementations of Contextual Bandit algorithms.

This part will include:

- Demo on COBA - benchmarking framework for CB algorithms (https://github.com/VowpalWabbit/coba)
- Using Panda Dataframes with pyVW
- AutoML & pyVW
- Hands on demo of continuous actions with VW
- Integrating VW with Apache Spark

Chat is not available.


Sun 5:00 a.m. - 5:30 a.m.
Introduction (Talk)   
John Langford
Sun 5:30 a.m. - 6:00 a.m.
Microsoft Azure Personalizer (Talk)   
Sheetal Lahabar
Sun 6:00 a.m. - 6:30 a.m.
CCB vs Slates (Talk)   
Pavithra Srinath
Sun 6:30 a.m. - 7:00 a.m.
AutoML (Talk)   
Qingyun Wu, Qingyun Wu
Sun 7:00 a.m. - 7:30 a.m.
Continuous Actions in VW (Talk)   
Olga Vrousgou
Sun 7:30 a.m. - 8:00 a.m.
COBA (Talk)   
Mark Rucker
Sun 8:00 a.m. - 8:30 a.m.
DFtoVW: using Panda Dataframes with pyvw (Talk)   
Etienne Kintzler
Sun 8:30 a.m. - 9:00 a.m.
VW & Apache Spark (Talk)   
Bogdan Mazoure
Sun 9:00 a.m. - 9:30 a.m.
VW update (Talk)   
Jack Gerrits