Timezone: »

Equivariance Through Parameter-Sharing
Siamak Ravanbakhsh · Jeff Schneider · Barnabás Póczos

Sun Aug 06 08:30 PM -- 08:48 PM (PDT) @ Darling Harbour Theatre

We propose to study equivariance in deep neural networks through parameter symmetries. In particular, given a group G that acts discretely on the input and output of a standard neural network layer, we show that its equivariance is linked to the symmetry group of network parameters. We then propose two parameter-sharing scheme to induce the desirable symmetry on the parameters of the neural network. Under some conditions on the action of G, our procedure for tying the parameters achieves G-equivariance and guarantees sensitivity to all other permutation groups outside of G.

Author Information

Siamak Ravanbakhsh (Carnegie Mellon University)
Jeff Schneider (CMU/Uber)
Barnabás Póczos (CMU)

Related Events (a corresponding poster, oral, or spotlight)

More from the Same Authors