Timezone: »

 
Oral
A Simple yet Universal Strategy for Online Convex Optimization
Lijun Zhang · Guanghui Wang · Jinfeng Yi · Tianbao Yang

Thu Jul 21 01:05 PM -- 01:25 PM (PDT) @ Ballroom 3 & 4
in T: Online Learning and Bandits »

Recently, several universal methods have been proposed for online convex optimization, and attain minimax rates for multiple types of convex functions simultaneously. However, they need to design and optimize one surrogate loss for each type of functions, making it difficult to exploit the structure of the problem and utilize existing algorithms. In this paper, we propose a simple strategy for universal online convex optimization, which avoids these limitations. The key idea is to construct a set of experts to process the original online functions, and deploy a meta-algorithm over the linearized losses to aggregate predictions from experts. Specifically, the meta-algorithm is required to yield a second-order bound with excess losses, so that it can leverage strong convexity and exponential concavity to control the meta-regret. In this way, our strategy inherits the theoretical guarantee of any expert designed for strongly convex functions and exponentially concave functions, up to a double logarithmic factor. As a result, we can plug in off-the-shelf online solvers as black-box experts to deliver problem-dependent regret bounds. For general convex functions, it maintains the minimax optimality and also achieves a small-loss bound.

Keywords: OPT: Convex · OPT: First-order · OPT: Optimization and Learning under Uncertainty · T: Online Learning and Bandits · T: Optimization

Author Information

Lijun Zhang (Nanjing University)
Guanghui Wang (Georgia Tech)
Jinfeng Yi (JD AI Research)
Tianbao Yang (The University of Iowa)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors