Timezone: »

Cheng Zhang: Active Mini-Batch Sampling using Repulsive Point Processes
Cheng Zhang

Fri Jun 14 04:40 PM -- 05:20 PM (PDT) @

We explore active mini-batch selection using repulsive point processes for stochastic gradient descent (SGD). Our approach simultaneously introduces active bias and leads to stochastic gradients with lower variance. We show theoretically and empirically that our approach improves over standard SGD both in terms of convergence speed as well as final model performance.

Author Information

Cheng Zhang (Microsoft Research, Cambridge)

More from the Same Authors