Tight Gap-Dependent Regret Bounds and Problem-Independent Bounds for Cost-aware Cascading Bandits
Yuji Tamakoshi ⋅ Shinji Ito
Abstract
We study cost-aware cascading bandits, where a learner selects an ordered
subset of options, tests them sequentially until the first success, and pays
the costs of all tested options. In this problem, regret comes from both
testing inefficient options and placing options in a suboptimal order, but
existing analyses do not separate these effects for inefficient options and
therefore yield an inverse-square dependence on the gap $c_i-\theta_i$. We
develop a regret decomposition based on intermediate policies that reorder the
remaining suffix and remove inefficient options one position at a time. This
allows us to quantify the incremental regret incurred when each option is
tested. As a consequence, we show that the regret of CC-UCB admits a
problem-dependent bound of
$O(\sum_{i:\theta_i/c_i<1}\log T/(c_i-\theta_i))$ up to additive terms
and a problem-independent bound of order $\tilde O(L\sqrt{T})$.
We further prove that the minimax regret is bounded from below by
$\Omega(\sqrt{LT})$ by reducing standard multi-armed bandits to a special
case of the model.
Finally, we propose CC-UCBv2, which removes the need to
specify a positive lower bound on costs and handles zero-cost options by
separating empirically zero-cost options from the others. Numerical
experiments show the effect of
misspecified cost lower bounds and demonstrate that the proposed modification
can reduce regret in representative instances involving zero or misspecified
costs.
Chat is not available.
Successful Page Load