Poster

Multiclass Neural Network Minimization via Tropical Newton Polytope Approximation

Georgios Smyrnis · Petros Maragos

Keywords: [ Dimensionality Reduction ] [ Supervised Learning ] [ Unsupervised and Semi-Supervised Learning ]

[ Abstract ] [ Join Zoom
[ Slides
Please do not share or post zoom links

Abstract:

The field of tropical algebra is closely linked with the domain of neural networks with piecewise linear activations, since their output can be described via tropical polynomials in the max-plus semiring. In this work, we attempt to make use of methods stemming from a form of approximate division of such polynomials, which relies on the approximation of their Newton Polytopes, in order to minimize networks trained for multiclass classification problems. We make theoretical contributions in this domain, by proposing and analyzing methods which seek to reduce the size of such networks. In addition, we make experimental evaluations on the MNIST and Fashion-MNIST datasets, with our results demonstrating a significant reduction in network size, while retaining adequate performance.

Chat is not available.