Timezone: »

 
Expo Workshop
Real World RL: Azure Personalizer & Vowpal Wabbit
Sheetal Lahabar · Etienne Kintzler · Mark Rucker · Bogdan Mazoure · Qingyun Wu · Pavithra Srinath · Jack Gerrits · Olga Vrousgou · John Langford · Eduardo Salinas

Sun Jul 18 05:00 AM -- 09:30 AM (PDT) @ None

The theme of this workshop will be real world applications of reinforcement learning. We will give a demo/tutorial of the latest features and additions to Azure Personalizer, an award winning and easy to use RL cloud service (https://azure.microsoft.com/en-us/services/cognitive-services/personalizer/). The first release of Personalizer was presented in an ICML 2019 workshop. We will present the latest additions to the service, including multi-slot personalization.

We will demonstrate how to leverage the latest release of Vowpal Wabbit, an open source machine learning library (https://vowpalwabbit.org/). It provides fast, scalable machine learning and has unique capabilities such as learning to search, active learning, contextual memory, and extreme multiclass learning. It has a focus on reinforcement learning and provides production ready implementations of Contextual Bandit algorithms.

This part will include:

- Demo on COBA - benchmarking framework for CB algorithms (https://github.com/VowpalWabbit/coba)
- Using Panda Dataframes with pyVW
- AutoML & pyVW
- Hands on demo of continuous actions with VW
- Integrating VW with Apache Spark

Sun 5:00 a.m. - 5:30 a.m.
Introduction (Talk)   
John Langford
Sun 5:30 a.m. - 6:00 a.m.
Microsoft Azure Personalizer (Talk)   
Sheetal Lahabar
Sun 6:00 a.m. - 6:30 a.m.
CCB vs Slates (Talk)   
Pavithra Srinath
Sun 6:30 a.m. - 7:00 a.m.
AutoML (Talk)   
Qingyun Wu, Qingyun Wu
Sun 7:00 a.m. - 7:30 a.m.
Continuous Actions in VW (Talk)   
Olga Vrousgou
Sun 7:30 a.m. - 8:00 a.m.
COBA (Talk)   
Mark Rucker
Sun 8:00 a.m. - 8:30 a.m.
DFtoVW: using Panda Dataframes with pyvw (Talk)   
Etienne Kintzler
Sun 8:30 a.m. - 9:00 a.m.
VW & Apache Spark (Talk)   
Bogdan Mazoure
Sun 9:00 a.m. - 9:30 a.m.
VW update (Talk)   
Jack Gerrits

Author Information

Sheetal Lahabar
Etienne Kintzler (-)
Mark Rucker
Bogdan Mazoure (MILA,McGill University)
Qingyun Wu
Pavithra Srinath (Microsoft Research)
Jack Gerrits
Olga Vrousgou
John Langford (Microsoft Research)
Eduardo Salinas (Microsoft)

More from the Same Authors