Workshop
2nd Annual Workshop on Topology, Algebra, and Geometry in Machine Learning (TAG-ML)
Tegan Emerson · Henry Kvinge · Tim Doster · Bastian Rieck · Sophia Sanborn · Nina Miolane · Mathilde Papillon
Meeting Room 317 B
Fri 28 Jul, noon PDT
Much of the data that is fueling current rapid advances in machine learning is high dimensional, structurally complex, and strongly nonlinear. This poses challenges for researcher intuition when they ask (i) how and why current algorithms work and (ii) what tools will lead to the next big break-though. Mathematicians working in topology, algebra, and geometry have more than a hundred years worth of finely-developed machinery whose purpose is to give structure to, help build intuition about, and generally better understand spaces and structures beyond those that we can naturally understand. Following on the success of the first TAG-ML workshop in 2022, this workshop will showcase work which brings methods from topology, algebra, and geometry and uses them to help answer challenging questions in machine learning. Topics include mathematical machine learning, explainability, training schemes, novel algorithms, performance metrics, and performance guarantees. All accepted papers will be included in an associated PMLR volume.
Schedule
Fri 12:00 p.m. - 12:10 p.m.
|
Open Remarks
(
Open Remarks
)
>
link
SlidesLive Video |
Tim Doster · Tegan Emerson · Henry Kvinge · Sophia Sanborn · Nina Miolane · Bastian Rieck · Mathilde Papillon 🔗 |
Fri 12:10 p.m. - 12:50 p.m.
|
Discrete Curvature and Applications in Graph-Based Learning
(
Keynote
)
>
SlidesLive Video |
Melanie Weber 🔗 |
Fri 12:50 p.m. - 1:00 p.m.
|
A new perspective on building efficient and expressive 3D equivariant graph neural networks
(
Spotlight
)
>
link
SlidesLive Video |
Yuanqi Du 🔗 |
Fri 1:00 p.m. - 1:30 p.m.
|
Coffee Break
(
Coffee Break
)
>
|
🔗 |
Fri 1:30 p.m. - 2:10 p.m.
|
Neural Approaches for Geometric Problems
(
Keynote
)
>
SlidesLive Video |
Yusu Wang 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Edge Importance Scores for Editing Graph Topology to Preserve Fairness ( Poster ) > link | Sree Harsha Tanneru 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Infusing invariances in neural representations ( Poster ) > link | Irene Cannistraci · Marco Fumero · Luca Moschella · Valentino Maiorca · Emanuele Rodola 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Expressive Sign Equivariant Networks for Spectral Geometric Learning ( Poster ) > link | Derek Lim · Joshua Robinson · Stefanie Jegelka · Haggai Maron 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Desiderata for Representation Learning from Identifiability, Disentanglement, and Group-Structuredness ( Poster ) > link | Hamza Keurti · Patrik Reizinger · Bernhard Schölkopf · Wieland Brendel 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Neural Networks Are Graphs! Graph Neural Networks for Equivariant Processing of Neural Networks ( Poster ) > link | David Zhang · Miltiadis (Miltos) Kofinas · Yan Zhang · Yunlu Chen · Gertjan Burghouts · Cees Snoek 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Hyperbolic VAE via Latent Gaussian Distributions ( Poster ) > link | Seunghyuk Cho · Juyong Lee · Dongwoo Kim 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Positional Encodings as Group Representations: A Unified Framework ( Poster ) > link | Derek Lim · Hannah Lawrence · Ningyuan Huang · Erik Thiede 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Fast computation of permutation equivariant layers with the partition algebra ( Poster ) > link | Charles Godfrey · Michael Rawson · Davis Brown · Henry Kvinge 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Evolving Computation Graphs ( Poster ) > link | Andreea Deac · Jian Tang 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
A Heat Diffusion Perspective on Geodesic Preserving Dimensionality Reduction ( Poster ) > link | Guillaume Huguet · Alexander Tong · Edward De Brouwer · Yanlei Zhang · Guy Wolf · Ian Adelstein · Smita Krishnaswamy 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
UGSL: A Unified Framework for Benchmarking Graph Structure Learning ( Poster ) > link | Bahare Fatemi · Sami Abu-El-Haija · Anton Tsitsulin · Mehran Kazemi · Dustin Zelle · Neslihan Bulut · Jonathan Halcrow · Bryan Perozzi 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Caveats of neural persistence in deep neural networks ( Poster ) > link | Leander Girrbach · Anders Christensen · A. Koepke · Ole Winther · Zeynep Akata 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Group Invariant Global Pooling ( Poster ) > link | Kamil Bujel · Yonatan Gideoni · Chaitanya Joshi · Pietro Lió 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Regression on Latent Spaces for the Analysis of Multi-Condition Single-Cell RNA-Seq Data ( Poster ) > link | Constantin Ahlmann-Eltze · Wolfgang Huber 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Learning Polynomial Problems with SL(2)-Equivariance ( Poster ) > link | Hannah Lawrence · Mitchell Harris 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Enriching Disentanglement: Definitions to Metrics ( Poster ) > link | Yivan Zhang · Masashi Sugiyama 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Geometric Algebra Transformers ( Poster ) > link | Johann Brehmer · Pim de Haan · Sönke Behrends · Taco Cohen 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Conditional Bisimulation for Generalization in Reinforcement Learning ( Poster ) > link | Anuj Mahajan · Amy Zhang 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
On the Expressive Power of Ollivier-Ricci Curvature on Graphs ( Poster ) > link | Josh Southern · Jeremy Wayland · Michael Bronstein · Bastian Rieck 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Can Euclidean Symmetry Help in Reinforcement Learning and Planning ( Poster ) > link | Linfeng Zhao · Owen Howell · Jung Yeon Park · Xupeng Zhu · Robin Walters · Lawson Wong 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Lie Point Symmetry and Physics Informed Networks ( Poster ) > link | Tara Akhound-Sadegh · Laurence Perreault-Levasseur · Johannes Brandstetter · Max Welling · Siamak Ravanbakhsh 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Equivariant Self-supervised Deep Pose Estimation for Cryo EM ( Poster ) > link | Gabriele Cesa · Kumar Pratik · Arash Behboodi 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Learning Lie Group Symmetry Transformations with Neural Networks ( Poster ) > link | Riccardo Valperga · Victoria Klein · Alex Gabel · Efstratios Gavves 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Sumformer: Universal Approximation for Efficient Transformers ( Poster ) > link | Silas Alberti · Niclas Dern · Laura Thesing · Gitta Kutyniok 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Deep Networks as Paths on the Manifold of Neural Representations ( Poster ) > link | Richard Lange · Devin Kwok · Jordan Matelsky · Xinyue Wang · David Rolnick · Konrad Kording 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Explaining Graph Neural Networks Using Interpretable Local Surrogates ( Poster ) > link | Farzaneh Heidari · Guillaume Rabusseau · Perouz Taslakian 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
An Exact Kernel Equivalence for Finite Classification Models ( Poster ) > link | Brian Bell · Michael Geyer · David Glickenstein · Amanda Fernandez · Juston Moore 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Learning to Explain Hypergraph Neural Networks ( Poster ) > link | Sepideh Maleki · Ehsan Hajiramezanali · Gabriele Scalia · Tommaso Biancalani · Kangway Chuang 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Homological Neural Networks: A Sparse Architecture for Multivariate Complexity ( Poster ) > link | Yuanrong Wang · Antonio Briola · Tomaso Aste 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Can strong structural encoding reduce the importance of Message Passing? ( Poster ) > link | Floor Eijkelboom · Erik Bekkers · Michael Bronstein · Francesco Di Giovanni 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Linear Regression on Manifold Structured Data: the Impact of Extrinsic Geometry on Solutions ( Poster ) > link | Liangchen Liu · Juncai He · Yen-Hsi Tsai 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
k-Means Clustering with Distance-Based Privacy ( Poster ) > link | Alessandro Epasto · Vahab Mirrokni · Shyam Narayanan · Peilin Zhong 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Episodic Memory Theory of Recurrent Neural Networks: Insights into Long-Term Information Storage and Manipulation ( Poster ) > link | Arjun Karuvally · Peter DelMastro · Hava Siegelmann 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
A new perspective on building efficient and expressive 3D equivariant graph neural networks ( Poster ) > link | weitao du · Yuanqi Du · Limei Wang · Dieqiao Feng · Guifeng Wang · Shuiwang Ji · Carla Gomes · Zhiming Ma 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Geometrically Regularized Wasserstein Dictionary Learning ( Poster ) > link | Marshall Mueller · Shuchin Aeron · James Murphy · Abiy Tasissa 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
The Weisfeiler-Lehman Distance: Reinterpretation and Connection with GNNs ( Poster ) > link | Samantha Chen · Sunhyuk Lim · Facundo Memoli · Zhengchao Wan · Yusu Wang 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Learning To See Topological Properties In 4D Using Convolutional Neural Networks ( Poster ) > link | Khalil Mathieu Hannouch · Stephan Chalup 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Learning Large Graph Property Prediction via Graph Segment Training ( Poster ) > link | Kaidi Cao · Phitchaya Phothilimthana · Sami Abu-El-Haija · Dustin Zelle · Yanqi Zhou · Charith Mendis · Jure Leskovec · Bryan Perozzi 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Fisher-Rao and pullback Hilbert cone distances on the multivariate Gaussian manifold with applications to simplification and quantization of mixtures ( Poster ) > link | Frank Nielsen 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
MASIL: Towards Maximum Separable Class Representation for Few Shot Class Incremental Learning ( Poster ) > link | Anant Khandelwal 🔗 |
Fri 2:10 p.m. - 3:00 p.m.
|
Poster Session 1
(
Poster Session
)
>
|
🔗 |
Fri 3:00 p.m. - 4:00 p.m.
|
Lunch
(
Lunch
)
>
|
🔗 |
Fri 4:00 p.m. - 4:40 p.m.
|
Graph Rewiring in GNNs
(
Keynote
)
>
SlidesLive Video |
Michael M. Bronstein 🔗 |
Fri 4:40 p.m. - 4:50 p.m.
|
GRIL: A $2$-parameter Persistence Based Vectorization for Machine Learning
(
Spotlight
)
>
link
SlidesLive Video |
Shreyas N. Samaga 🔗 |
Fri 4:50 p.m. - 5:00 p.m.
|
Breaking the Curse of Depth in Graph Convolutional Networks via Refined Initialization Strategy
(
Spotlight
)
>
link
SlidesLive Video |
Senmiao Wang 🔗 |
Fri 5:00 p.m. - 5:40 p.m.
|
Intuition for the Data Types and Interactions of Euclidean Neural Networks
(
Keynote
)
>
SlidesLive Video |
Tess Smidt 🔗 |
Fri 5:40 p.m. - 5:50 p.m.
|
Unsupervised Embedding Quality Evaluation
(
Spotlight
)
>
link
SlidesLive Video |
Anton Tsitsulin 🔗 |
Fri 5:50 p.m. - 6:00 p.m.
|
Topologically Attributed Graphs for Shape Discrimination
(
Spotlight
)
>
link
SlidesLive Video |
Florian Russold 🔗 |
Fri 6:00 p.m. - 6:30 p.m.
|
Coffee Break
(
Coffee Break
)
>
|
🔗 |
Fri 6:30 p.m. - 7:00 p.m.
|
Topological Deep Learning Challenge
(
Presentation
)
>
link
SlidesLive Video |
Mathilde Papillon · Nina Miolane · Sophia Sanborn 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Mixed-Curvature Transformers for Graph Representation Learning ( Poster ) > link | Sungjun Cho · Seunghyuk Cho · Sungwoo Park · Hankook Lee · Honglak Lee · Moontae Lee 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Sample Complexity Bounds for Estimating the Wasserstein Distance under Invariances ( Poster ) > link | Behrooz Tahmasebi · Stefanie Jegelka 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Which Features are Learned by Contrastive Learning? On the Role of Simplicity Bias in Class Collapse and Feature Suppression ( Poster ) > link | Yihao Xue · Siddharth Joshi · Eric Gan · Pin-Yu Chen · Baharan Mirzasoleiman 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Unsupervised Learning of 3-colorings using Simplicial Higher-Order Neural Networks ( Poster ) > link | Lucas Laird · Robin Walters · Wolfgang Gatterbauer 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Equivariant Representation Learning with Equivariant Convolutional Kernel Networks ( Poster ) > link | Soutrik Roy Chowdhury · Johan Suykens 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
On the Relationship Between Data Manifolds and Adversarial Examples ( Poster ) > link | Michael Geyer · Brian Bell · Amanda Fernandez · Juston Moore 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Asynchronous Algorithmic Alignment with Cocycles ( Poster ) > link | Andrew Dudzik · Tamara von Glehn · Razvan Pascanu · Petar Veličković 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
DeepEMD: A Transformer-based Fast Estimation of the Earth Mover's Distance ( Poster ) > link | Atul Kumar Sinha · François Fleuret 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Polyhedral Complex Extraction from ReLU Networks using Edge Subdivision ( Poster ) > link | Arturs Berzins 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
The Exact Sample Complexity Gain from Invariances for Kernel Regression ( Poster ) > link | Behrooz Tahmasebi · Stefanie Jegelka 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Implicitly Learned Invariance and Equivariance in Linear Regression ( Poster ) > link | Yonatan Gideoni 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Learning Structured Representations with Equivariant Contrastive Learning ( Poster ) > link | Sharut Gupta · Joshua Robinson · Derek Lim · Soledad Villar · Stefanie Jegelka 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Non-isotropic Persistent Homology ( Poster ) > link | Vincent Grande · Michael Schaub 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Gromov-Hausdorff Distances for Comparing Product Manifolds of Model Spaces ( Poster ) > link | Haitz Sáez de Ocáriz Borde · Alvaro Arroyo · Ismael Morales · Ingmar Posner · Xiaowen Dong 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Latent Space Symmetry Discovery ( Poster ) > link | Jianke Yang · Nima Dehmamy · Robin Walters · Rose Yu 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Assessing Neural Network Representations During Training Using Data Diffusion Spectra ( Poster ) > link | Danqi Liao · Chen Liu · Alexander Tong · Guillaume Huguet · Guy Wolf · Maximilian Nickel · Ian Adelstein · Smita Krishnaswamy 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Learned Gridification for Efficient Point Cloud Processing ( Poster ) > link | Putri van der Linden · David Romero · Erik Bekkers 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
FAM: Relative Flatness Aware Minimization ( Poster ) > link | Linara Adilova · Amr Abourayya · Jianning Li · Amin Dada · Henning Petzka · Jan Egger · Jens Kleesiek · Michael Kamp 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
One-Shot Neural Network Pruning via Spectral Graph Sparsification ( Poster ) > link | Steinar Laenen 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Topologically Attributed Graphs for Shape Discrimination ( Poster ) > link | Justin Curry · Washington Mio · Tom Needham · Osman Okutan · Florian Russold 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Visualizing and Analyzing the Topology of Neuron Activations in Deep Adversarial Training ( Poster ) > link | Youjia Zhou · Yi Zhou · Jie Ding · Bei Wang 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Bridging Equational Properties and Patterns on Graphs: an AI-Based Approach ( Poster ) > link | Oguzhan Keskin · Alisia Lupidi · Stefano Fioravanti · Lucie Charlotte Magister · Pietro Barbiero · Pietro Lió · Francesco Giannini 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Unsupervised Embedding Quality Evaluation ( Poster ) > link | Anton Tsitsulin · Marina Munkhoeva · Bryan Perozzi 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
A margin-based multiclass generalization bound via geometric complexity ( Poster ) > link | Michael Munn · Benoit Dherin · Xavi Gonzalvo 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
On genuine invariance learning without weight-tying ( Poster ) > link | Artem Moskalev · Anna Sepliarskaia · Erik Bekkers · Arnold Smeulders 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Breaking the Curse of Depth in Graph Convolutional Networks via Refined Initialization Strategy ( Poster ) > link | Senmiao Wang · Yupeng Chen · Yushun Zhang · Tian Ding · Ruoyu Sun 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Metric Space Magnitude and Generalisation in Neural Networks ( Poster ) > link | Rayna Andreeva · Katharina Limbeck · Bastian Rieck · Rik Sarkar 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Non-linear Embeddings in Hilbert Simplex Geometry ( Poster ) > link | Frank Nielsen · Ke Sun 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Product Manifold Learning with Independent Coordinate Selection ( Poster ) > link | Jesse He · Tristan Brugère · Gal Mishne 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Breaking the Structure of Multilayer Perceptrons with Complex Topologies ( Poster ) > link | Tommaso Boccato · Matteo Ferrante · Andrea Duggento · Nicola Toschi 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Data, Geometry and Homology ( Poster ) > link | Jens Agerberg · Wojciech Chacholski · Ryan Ramanujam 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Differentially Private Clustering in Data Streams ( Poster ) > link | Alessandro Epasto · Tamalika Mukherjee · Peilin Zhong 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
GRIL: A $2$-parameter Persistence Based Vectorization for Machine Learning ( Poster ) > link | Cheng Xin · Soham Mukherjee · Shreyas N. Samaga · Tamal Dey 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Hyperbolic Sliced-Wasserstein via Geodesic and Horospherical Projections ( Poster ) > link | Clément Bonet · Laetitia Chapel · Lucas Drumetz · Nicolas Courty 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
On the Ability of Graph Neural Networks to Model Interactions Between Vertices ( Poster ) > link | Noam Razin · Tom Verbin · Nadav Cohen 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
A Geometric Insight into Equivariant Message Passing Neural Networks on Riemannian Manifolds ( Poster ) > link | Ilyes Batatia 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
ReLU Neural Networks, Polyhedral Decompositions, and Persistent Homology ( Poster ) > link | Yajing Liu · Christina Cole · Chris Peterson · Michael Kirby 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
An ML approach to resolution of singularities ( Poster ) > link | Gergely Berczi · Honglu Fan · Mingcong Zeng 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
On Explicit Curvature Regularization in Deep Generative Models ( Poster ) > link | Yonghyeon Lee · Frank Chongwoo Park 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Topological Feature Selection ( Poster ) > link | Antonio Briola · Tomaso Aste 🔗 |
Fri 7:00 p.m. - 8:00 p.m.
|
Poster Session 2
(
Poster Session
)
>
|
🔗 |