Timezone: »

Training Neural Machines with Trace-Based Supervision
Matthew Mirman · Dimitar Dimitrov · Pavle Djordjevic · Timon Gehr · Martin Vechev

Thu Jul 12 09:15 AM -- 12:00 PM (PDT) @ Hall B #140

We investigate the effectiveness of trace-based supervision methods for training existing neural abstract machines. To define the class of neural machines amenable to trace-based supervision, we introduce the concept of a differential neural computational machine (dNCM) and show that several existing architectures (NTMs, NRAMs) can be described as dNCMs. We performed a detailed experimental evaluation with NTM and NRAM machines, showing that additional supervision on the interpretable portions of these architectures leads to better convergence and generalization capabilities of the learning phase than standard training, in both noise-free and noisy scenarios.

Author Information

Matthew Mirman (ETH Zürich)
Dimitar Dimitrov (ETH Zurich)
Pavle Djordjevic (ETH)
Timon Gehr (ETH Zurich)
Martin Vechev (ETH Zurich)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors