Timezone: »
A trained neural network can be interpreted as a structural causal model (SCM) that provides the effect of changing input variables on the model's output. However, if training data contains both causal and correlational relationships, a model that optimizes prediction accuracy may not necessarily learn the true causal relationships between input and output variables. On the other hand, expert users often have prior knowledge of the causal relationship between certain input variables and output from domain knowledge. Therefore, we propose a regularization method that aligns the learned causal effects of a neural network with domain priors, including both direct and total causal effects. We show that this approach can generalize to different kinds of domain priors, including monotonicity of causal effect of an input variable on output or zero causal effect of a variable on output for purposes of fairness. Our experiments on twelve benchmark datasets show its utility in regularizing a neural network model to maintain desired causal effects, without compromising on accuracy. Importantly, we also show that a model thus trained is robust and gets improved accuracy on noisy inputs.
Author Information
Sai Srinivas Kancheti (Indian Institute of Technology Hyderabad)
I am a second year PhD student at IITH supervised by Dr. Vineeth N Balasubramanian. I mainly work on understanding how consequential decision making systems can offer recourse to adversely affected individuals -- formally known as Algorithmic Recourse. I am also broadly interested in interpretable machine learning, causality in machine learning and decision making under strategic behaviour.
Gowtham Reddy Abbavaram (Indian Institute of Technology Hyderabad)
Vineeth N Balasubramanian (Indian Institute of Technology, Hyderabad)
Amit Sharma (Microsoft Research)
Related Events (a corresponding poster, oral, or spotlight)
-
2022 Spotlight: Matching Learned Causal Effects of Neural Networks with Domain Priors »
Tue. Jul 19th 09:35 -- 09:40 PM Room Ballroom 3 & 4
More from the Same Authors
-
2021 : DoWhy: Addressing Challenges in Expressing and Validating Causal Assumptions »
Amit Sharma · Vasilis Syrgkanis · cheng zhang · Emre Kiciman -
2022 : Modeling the Data-Generating Process is Necessary for Out-of-Distribution Generalization »
JIVAT NEET KAUR · Emre Kiciman · Amit Sharma -
2022 : Probing Classifiers are Unreliable for Concept Removal and Detection »
Abhinav Kumar · Chenhao Tan · Amit Sharma -
2023 : Towards Modular Machine Learning Pipelines »
Aditya Modi · JIVAT NEET KAUR · Maggie Makar · Pavan Mallapragada · Amit Sharma · Emre Kiciman · Adith Swaminathan -
2023 : Partial Label Learning meets Active Learning: Enhancing Annotation Efficiency through Binary Questioning »
Shivangana Rawat · Chaitanya Devaguptapu · Vineeth N Balasubramanian -
2021 Poster: Domain Generalization using Causal Matching »
Divyat Mahajan · Shruti Tople · Amit Sharma -
2021 Oral: Domain Generalization using Causal Matching »
Divyat Mahajan · Shruti Tople · Amit Sharma -
2020 Poster: Alleviating Privacy Attacks via Causal Learning »
Shruti Tople · Amit Sharma · Aditya Nori -
2019 : Submodular Batch Selection for Training Deep Neural Networks »
Vineeth N Balasubramanian -
2019 : Spotlight »
Tyler Scott · Kiran Thekumparampil · Jonathan Aigrain · Rene Bidart · Priyadarshini Panda · Dian Ang Yap · Yaniv Yacoby · Raphael Gontijo Lopes · Alberto Marchisio · Erik Englesson · Wanqian Yang · Moritz Graule · Yi Sun · Daniel Kang · Mike Dusenberry · Min Du · Hartmut Maennel · Kunal Menda · Vineet Edupuganti · Luke Metz · David Stutz · Vignesh Srinivasan · Timo Sämann · Vineeth N Balasubramanian · Sina Mohseni · Rob Cornish · Judith Butepage · Zhangyang Wang · Bai Li · Bo Han · Honglin Li · Maksym Andriushchenko · Lukas Ruff · Meet P. Vadera · Yaniv Ovadia · Sunil Thulasidasan · Disi Ji · Gang Niu · Saeed Mahloujifar · Aviral Kumar · SANGHYUK CHUN · Dong Yin · Joyce Xu Xu · Hugo Gomes · Raanan Rohekar -
2019 Poster: Neural Network Attributions: A Causal Perspective »
Aditya Chattopadhyay · Piyushi Manupriya · Anirban Sarkar · Vineeth N Balasubramanian -
2019 Oral: Neural Network Attributions: A Causal Perspective »
Aditya Chattopadhyay · Piyushi Manupriya · Anirban Sarkar · Vineeth N Balasubramanian