Poster
Towards a Deep and Unified Understanding of Deep Neural Models in NLP
Chaoyu Guan · Xiting Wang · Quanshi Zhang · Runjin Chen · Di He · Xing Xie

Thu Jun 13th 06:30 -- 09:00 PM @ Pacific Ballroom #62

We define a unified information-based measure to provide quantitative explanations on how intermediate layers of deep Natural Language Processing (NLP) models leverage information of input words. Our method advances existing explanation methods by addressing issues in coherency and generality. Explanations generated by using our method are consistent and faithful across different timestamps, layers, and models. We show how our method can be applied to four widely used models in NLP and explain their performances on three real-world benchmark datasets.

Author Information

Chaoyu Guan (Shanghai Jiao Tong University)
Xiting Wang (Microsoft Research Asia)
Quanshi Zhang (Shanghai Jiao Tong University)
Runjin Chen (Shanghai Jiao Tong University)
Di He (Peking University)
Xing Xie (Microsoft Research Asia)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors