Timezone: »
Stochastic optimization algorithms such as SGDs update the model sequentially with cheap per-iteration costs, making them amenable for large-scale data analysis. However, most of the existing studies focus on the classification accuracy which can not be directly applied to the important problems of maximizing the Area under the ROC curve (AUC) in imbalanced classification and bipartite ranking. In this paper, we develop a novel stochastic proximal algorithm for AUC maximization which is referred to as SPAM. Compared with the previous literature, our algorithm SPAM applies to a non-smooth penalty function, and achieves a convergence rate of O(log t/t) for strongly convex functions while both space and per-iteration costs are of one datum.
Author Information
Michael Natole Jr (University at Albany)
Yiming Ying (SUNY Albany)
Siwei Lyu (University at Albany, State University of New York)
Related Events (a corresponding poster, oral, or spotlight)
-
2018 Poster: Stochastic Proximal Algorithms for AUC Maximization »
Thu. Jul 12th 04:15 -- 07:00 PM Room Hall B #187
More from the Same Authors
-
2021 Poster: Stability and Generalization of Stochastic Gradient Methods for Minimax Problems »
Yunwen Lei · Zhenhuan Yang · Tianbao Yang · Yiming Ying -
2021 Oral: Stability and Generalization of Stochastic Gradient Methods for Minimax Problems »
Yunwen Lei · Zhenhuan Yang · Tianbao Yang · Yiming Ying -
2021 Poster: Federated Deep AUC Maximization for Hetergeneous Data with a Constant Communication Complexity »
Zhuoning Yuan · Zhishuai Guo · Yi Xu · Yiming Ying · Tianbao Yang -
2021 Spotlight: Federated Deep AUC Maximization for Hetergeneous Data with a Constant Communication Complexity »
Zhuoning Yuan · Zhishuai Guo · Yi Xu · Yiming Ying · Tianbao Yang -
2020 Poster: Fine-Grained Analysis of Stability and Generalization for Stochastic Gradient Descent »
Yunwen Lei · Yiming Ying -
2019 Poster: Stochastic Iterative Hard Thresholding for Graph-structured Sparsity Optimization »
Baojian Zhou · Feng Chen · Yiming Ying -
2019 Oral: Stochastic Iterative Hard Thresholding for Graph-structured Sparsity Optimization »
Baojian Zhou · Feng Chen · Yiming Ying