Timezone: »

 
Augmenting Bayesian Optimization with Preference-based Expert Feedback
Daolang Huang · Louis Filstroff · Petrus Mikkola · Runkai Zheng · Milica Todorovic · Samuel Kaski
Event URL: https://openreview.net/forum?id=OJXfwj2hiP »

Bayesian optimization (BO) is a well-established method to optimize black-box functions whose direct evaluations are costly. In this paper, we tackle the problem of incorporating expert knowledge into BO, with the goal of further accelerating the optimization, which has received little attention so far. We design a multi-task learning architecture for this task, with the goal of jointly eliciting the expert knowledge and minimizing the objective function. In particular, this allows for the expert knowledge to be transferred into the BO task. We introduce a specific architecture based on Siamese neural networks to handle the knowledge elicitation from pairwise queries. Experiments on various benchmark functions show that the proposed method significantly speeds up BO even when the expert knowledge is biased.

Author Information

Daolang Huang (Aalto University)
Louis Filstroff (Ecole Nationale de la Statistique et de l'Analyse de l'information)
Petrus Mikkola (Aalto University)
Runkai Zheng (The Chinese University of Hong Kong, Shenzhen)
Milica Todorovic
Samuel Kaski (Aalto University and University of Manchester)

More from the Same Authors