Timezone: »
We provide a new approach to training neural models to exhibit transparency in a well-defined, functional manner. Our approach naturally operates over structured data and tailors the predictor, functionally, towards a chosen family of (local) witnesses. The estimation problem is setup as a co-operative game between an unrestricted \emph{predictor} such as a neural network, and a set of \emph{witnesses} chosen from the desired transparent family. The goal of the witnesses is to highlight, locally, how well the predictor conforms to the chosen family of functions, while the predictor is trained to minimize the highlighted discrepancy. We emphasize that the predictor remains globally powerful as it is only encouraged to agree locally with locally adapted witnesses. We analyze the effect of the proposed approach, provide example formulations in the context of deep graph and sequence models, and empirically illustrate the idea in chemical property prediction, temporal modeling, and molecule representation learning.
Author Information
Guang-He Lee (MIT CSAIL)
Wengong Jin (MIT)
David Alvarez-Melis (MIT)
Tommi Jaakkola (MIT)
Related Events (a corresponding poster, oral, or spotlight)
-
2019 Oral: Functional Transparency for Structured Data: a Game-Theoretic Approach »
Thu. Jun 13th 04:30 -- 04:35 PM Room Grand Ballroom
More from the Same Authors
-
2023 : Optimizing protein fitness using Bi-level Gibbs sampling with Graph-based Smoothing »
Andrew Kirjner · Jason Yim · Raman Samusevich · Tommi Jaakkola · Regina Barzilay · Ila R. Fiete -
2023 : Optimizing protein fitness using Gibbs sampling with Graph-based Smoothing »
Andrew Kirjner · Jason Yim · Raman Samusevich · Tommi Jaakkola · Regina Barzilay · Ila R. Fiete -
2023 : Invited Talk by Tommi Jaakkola »
Tommi Jaakkola -
2023 Poster: PFGM++: Unlocking the Potential of Physics-Inspired Generative Models »
Yilun Xu · Ziming Liu · Yonglong Tian · Shangyuan Tong · Max Tegmark · Tommi Jaakkola -
2023 Poster: Towards Coherent Image Inpainting Using Denoising Diffusion Implicit Models »
Guanhua Zhang · Jiabao Ji · Yang Zhang · Mo Yu · Tommi Jaakkola · Shiyu Chang -
2023 Poster: SE(3) diffusion model with application to protein backbone generation »
Jason Yim · Brian Trippe · Valentin De Bortoli · Emile Mathieu · Arnaud Doucet · Regina Barzilay · Tommi Jaakkola -
2022 Workshop: Workshop on Machine Learning in Computational Design »
Andrew Spielberg · Caitlin Mueller · Lydia Chilton · Rafael Gomez-Bombarelli · Vladimir Kim · Daniel Ritchie · Wengong Jin -
2022 Poster: Antibody-Antigen Docking and Design via Hierarchical Structure Refinement »
Wengong Jin · Regina Barzilay · Tommi Jaakkola -
2022 Spotlight: Antibody-Antigen Docking and Design via Hierarchical Structure Refinement »
Wengong Jin · Regina Barzilay · Tommi Jaakkola -
2022 Poster: Conformal Prediction Sets with Limited False Positives »
Adam Fisch · Tal Schuster · Tommi Jaakkola · Regina Barzilay -
2022 Poster: EquiBind: Geometric Deep Learning for Drug Binding Structure Prediction »
Hannes Stärk · Octavian Ganea · Lagnajit Pattanaik · Regina Barzilay · Tommi Jaakkola -
2022 Spotlight: Conformal Prediction Sets with Limited False Positives »
Adam Fisch · Tal Schuster · Tommi Jaakkola · Regina Barzilay -
2022 Spotlight: EquiBind: Geometric Deep Learning for Drug Binding Structure Prediction »
Hannes Stärk · Octavian Ganea · Lagnajit Pattanaik · Regina Barzilay · Tommi Jaakkola -
2021 : Invited Talk: David Alvarez-Melis. Comparing, Transforming, and Optimizing Datasets with Optimal Transport. »
David Alvarez-Melis -
2021 Poster: Few-Shot Conformal Prediction with Auxiliary Tasks »
Adam Fisch · Tal Schuster · Tommi Jaakkola · Regina Barzilay -
2021 Spotlight: Few-Shot Conformal Prediction with Auxiliary Tasks »
Adam Fisch · Tal Schuster · Tommi Jaakkola · Regina Barzilay -
2021 Poster: Information Obfuscation of Graph Neural Networks »
Peiyuan Liao · Han Zhao · Keyulu Xu · Tommi Jaakkola · Geoff Gordon · Stefanie Jegelka · Ruslan Salakhutdinov -
2021 Spotlight: Information Obfuscation of Graph Neural Networks »
Peiyuan Liao · Han Zhao · Keyulu Xu · Tommi Jaakkola · Geoff Gordon · Stefanie Jegelka · Ruslan Salakhutdinov -
2021 Poster: Dataset Dynamics via Gradient Flows in Probability Space »
David Alvarez-Melis · Nicolo Fusi -
2021 Poster: Learning Task Informed Abstractions »
Xiang Fu · Ge Yang · Pulkit Agrawal · Tommi Jaakkola -
2021 Spotlight: Learning Task Informed Abstractions »
Xiang Fu · Ge Yang · Pulkit Agrawal · Tommi Jaakkola -
2021 Spotlight: Dataset Dynamics via Gradient Flows in Probability Space »
David Alvarez-Melis · Nicolo Fusi -
2020 : 2.5 Geometric Dataset Distances via Optimal Transport »
David Alvarez-Melis -
2020 : Invited Talk: Tommi Jaakkola »
Tommi Jaakkola -
2020 Poster: Generalization and Representational Limits of Graph Neural Networks »
Vikas K Garg · Stefanie Jegelka · Tommi Jaakkola -
2020 Poster: Multi-Objective Molecule Generation using Interpretable Substructures »
Wengong Jin · Regina Barzilay · Tommi Jaakkola -
2020 Poster: Educating Text Autoencoders: Latent Representation Guidance via Denoising »
Tianxiao Shen · Jonas Mueller · Regina Barzilay · Tommi Jaakkola -
2020 Poster: Invariant Rationalization »
Shiyu Chang · Yang Zhang · Mo Yu · Tommi Jaakkola -
2020 Poster: Predicting deliberative outcomes »
Vikas K Garg · Tommi Jaakkola -
2020 Poster: Hierarchical Generation of Molecular Graphs using Structural Motifs »
Wengong Jin · Regina Barzilay · Tommi Jaakkola -
2020 Poster: Improving Molecular Design by Stochastic Iterative Target Augmentation »
Kevin Yang · Wengong Jin · Kyle Swanson · Regina Barzilay · Tommi Jaakkola -
2019 Poster: Learning Generative Models across Incomparable Spaces »
Charlotte Bunne · David Alvarez-Melis · Andreas Krause · Stefanie Jegelka -
2019 Oral: Learning Generative Models across Incomparable Spaces »
Charlotte Bunne · David Alvarez-Melis · Andreas Krause · Stefanie Jegelka -
2018 Poster: Junction Tree Variational Autoencoder for Molecular Graph Generation »
Wengong Jin · Regina Barzilay · Tommi Jaakkola -
2018 Oral: Junction Tree Variational Autoencoder for Molecular Graph Generation »
Wengong Jin · Regina Barzilay · Tommi Jaakkola -
2017 Poster: Learning Sleep Stages from Radio Signals: A Conditional Adversarial Architecture »
Mingmin Zhao · Shichao Yue · Dina Katabi · Tommi Jaakkola · Matt Bianchi -
2017 Talk: Learning Sleep Stages from Radio Signals: A Conditional Adversarial Architecture »
Mingmin Zhao · Shichao Yue · Dina Katabi · Tommi Jaakkola · Matt Bianchi -
2017 Poster: Sequence to Better Sequence: Continuous Revision of Combinatorial Structures »
Jonas Mueller · David Gifford · Tommi Jaakkola -
2017 Talk: Sequence to Better Sequence: Continuous Revision of Combinatorial Structures »
Jonas Mueller · David Gifford · Tommi Jaakkola -
2017 Poster: Deriving Neural Architectures from Sequence and Graph Kernels »
Tao Lei · Wengong Jin · Regina Barzilay · Tommi Jaakkola -
2017 Talk: Deriving Neural Architectures from Sequence and Graph Kernels »
Tao Lei · Wengong Jin · Regina Barzilay · Tommi Jaakkola