We propose a new attribution method for neural networks developed using first principles of causality (to the best of our knowledge, the first such). The neural network architecture is viewed as a Structural Causal Model, and a methodology to compute the causal effect of each feature on the output is presented. With reasonable assumptions on the causal structure of the input data, we propose algorithms to efficiently compute the causal effects, as well as scale the approach to data with large dimensionality. We also show how this method can be used for recurrent neural networks. We report experimental results on both simulated and real datasets showcasing the promise and usefulness of the proposed algorithm.
Aditya Chattopadhyay (Johns Hopkins University)
Piyushi Manupriya (IIT Hyderabad)
Anirban Sarkar (Indian Institute of Technology, Hyderabad)
I'm a 3rd year Ph.D. student at IIT Hyderabad, India. Before that, I completed my bachelors in mathematics and then was in IBM, India for 2.5 years as an associate system engineer. Then I did my masters in computer science before joining Ph.D.
Vineeth N Balasubramanian (Indian Institute of Technology, Hyderabad)
Related Events (a corresponding poster, oral, or spotlight)
2019 Poster: Neural Network Attributions: A Causal Perspective »
Fri Jun 14th 01:30 -- 04:00 AM Room Pacific Ballroom
More from the Same Authors
2019 : Submodular Batch Selection for Training Deep Neural Networks »
Vineeth N Balasubramanian
2019 : Spotlight »
Tyler Scott · Kiran Koshy · Jonathan Aigrain · Rene Bidart · Priyadarshini Panda · Dian Ang Yap · Yaniv Yacoby · Raphael Gontijo Lopes · Alberto Marchisio · Erik Englesson · Wanqian Yang · Moritz Graule · Yi Sun · Daniel Kang · Mike Dusenberry · Min Du · Hartmut Maennel · Kunal Menda · Vineet Edupuganti · Luke Metz · David Stutz · Vignesh Srinivasan · Timo Sämann · Vineeth N Balasubramanian · Sina Mohseni · Rob Cornish · Judith Butepage · Zhangyang Wang · Bai Li · Bo Han · Honglin Li · Maksym Andriushchenko · Lukas Ruff · Meet P. Vadera · Yaniv Ovadia · Sunil Thulasidasan · Disi Ji · Gang Niu · Saeed Mahloujifar · Aviral Kumar · SANGHYUK CHUN · Dong Yin · Joyce Xu Xu · Hugo Gomes · Raanan Rohekar