Timezone: »
Set functions predict a label from a permutation-invariant variable-size collection of feature vectors. We propose making set functions more understandable and regularized by capturing domain knowledge through shape constraints. We show how prior work in monotonic constraints can be adapted to set functions. Then we propose two new shape constraints designed to generalize the conditioning role of weights in a weighted mean. We show how one can train standard functions and set functions that satisfy these shape constraints with a deep lattice network. We propose a nonlinear estimation strategy we call the semantic feature engine that uses set functions with the proposed shape constraints to estimate labels for compound sparse categorical features. Experiments on real-world data show the achieved accuracy is similar to deep sets or deep neural networks, but provides guarantees of the model behavior and is thus easier to explain and debug.
Author Information
Andrew Cotter (Google AI)
Maya Gupta (Google)
Heinrich Jiang (Google Research)
Erez Louidor (Google, Inc.)
James Muller (Google)
Taman Narayan (Google)
Serena Wang (Google)
Tao Zhu (Google)
Related Events (a corresponding poster, oral, or spotlight)
-
2019 Poster: Shape Constraints for Set Functions »
Wed Jun 12th 01:30 -- 04:00 AM Room Pacific Ballroom
More from the Same Authors
-
2020 Poster: Multidimensional Shape Constraints »
Maya Gupta · Erez Louidor · Oleksandr Mangylov · Nobu Morioka · Taman Narayan · Sen Zhao -
2020 Poster: Deep k-NN for Noisy Labels »
Dara Bahri · Heinrich Jiang · Maya Gupta -
2019 Poster: Training Well-Generalizing Classifiers for Fairness Metrics and Other Data-Dependent Constraints »
Andrew Cotter · Maya Gupta · Heinrich Jiang · Nati Srebro · Karthik Sridharan · Serena Wang · Blake Woodworth · Seungil You -
2019 Poster: Metric-Optimized Example Weights »
Sen Zhao · Mahdi Milani Fard · Harikrishna Narasimhan · Maya Gupta -
2019 Oral: Training Well-Generalizing Classifiers for Fairness Metrics and Other Data-Dependent Constraints »
Andrew Cotter · Maya Gupta · Heinrich Jiang · Nati Srebro · Karthik Sridharan · Serena Wang · Blake Woodworth · Seungil You -
2019 Oral: Metric-Optimized Example Weights »
Sen Zhao · Mahdi Milani Fard · Harikrishna Narasimhan · Maya Gupta -
2018 Poster: Constrained Interacting Submodular Groupings »
Andrew Cotter · Mahdi Milani Fard · Seungil You · Maya Gupta · Jeff Bilmes -
2018 Oral: Constrained Interacting Submodular Groupings »
Andrew Cotter · Mahdi Milani Fard · Seungil You · Maya Gupta · Jeff Bilmes