Timezone: »

 
Poster
BINOCULARS for efficient, nonmyopic sequential experimental design
Shali Jiang · Henry Chai · Javier Gonzalez · Roman Garnett

Thu Jul 16 06:00 AM -- 06:45 AM & Thu Jul 16 05:00 PM -- 05:45 PM (PDT) @
in Poster Session 41 »

Finite-horizon sequential experimental design (SED) arises naturally in many contexts, including hyperparameter tuning in machine learning among more traditional settings. Computing the optimal policy for such problems requires solving Bellman equations, which are generally intractable. Most existing work resorts to severely myopic approximations by limiting the decision horizon to only a single time-step, which can underweight exploration in favor of exploitation. We present BINOCULARS: Batch-Informed NOnmyopic Choices, Using Long-horizons for Adaptive, Rapid SED, a general framework for deriving efficient, nonmyopic approximations to the optimal experimental policy. Our key idea is simple and surprisingly effective: we first compute a one-step optimal batch of experiments, then select a single point from this batch to evaluate. We realize BINOCULARS for Bayesian optimization and Bayesian quadrature -- two notable example problems with radically different objectives -- and demonstrate that BINOCULARS significantly outperforms significantly outperforms myopic alternatives in real-world scenarios.

Keywords: Active Learning · Bayesian Methods · Gaussian Processes

Author Information

Shali Jiang (Washington University in St. Louis)
Henry Chai (Washington University in St. Louis)
Javier Gonzalez (Microsoft Research)
Roman Garnett (Washington University in St. Louis)

More from the Same Authors