Workshop
Differential Geometry meets Deep Learning (DiffGeo4DL)
Joey Bose · Emile Mathieu · Charline Le Lan · Ines Chami · Frederic Sala · Christopher De Sa · Maximilian Nickel · Christopher Ré · Will Hamilton
Fri 11 Dec, 5:45 a.m. PST
Recent years have seen a surge in research at the intersection of differential geometry and deep learning, including techniques for stochastic optimization on curved spaces (e.g., hyperbolic or spherical manifolds), learning embeddings for non-Euclidean data, and generative modeling on Riemannian manifolds. Insights from differential geometry have led to new state of the art approaches to modeling complex real world data, such as graphs with hierarchical structure, 3D medical data, and meshes.
Thus, it is of critical importance to understand, from a geometric lens, the natural invariances, equivariances, and symmetries that reside within data.
In order to support the burgeoning interest of differential geometry in deep learning, the primary goal for this workshop is to facilitate community building and to work towards the identification of key challenges in comparison with regular deep learning, along with techniques to overcome these challenges. With many new researchers beginning projects in this area, we hope to bring them together to consolidate this fast-growing area into a healthy and vibrant subfield. In particular, we aim to strongly promote novel and exciting applications of differential geometry for deep learning with an emphasis on bridging theory to practice which is reflected in our choices of invited speakers, which include both machine learning practitioners and researchers who are primarily geometers.
Schedule
Fri 5:00 a.m. - 3:00 p.m.
|
gather.town ( Social ) > link | 🔗 |
Fri 5:45 a.m. - 6:00 a.m.
|
Opening Remarks
(
Presentation
)
>
|
Joey Bose 🔗 |
Fri 6:00 a.m. - 6:30 a.m.
|
Invited Talk 1: Geometric deep learning for 3D human body synthesis
(
Talk by Michael Bronstein
)
>
SlidesLive Video |
Michael Bronstein 🔗 |
Fri 6:30 a.m. - 7:00 a.m.
|
Invited Talk 2: Gauge Theory in Geometric Deep Learning
(
Talk by Taco Cohen
)
>
SlidesLive Video |
Taco Cohen 🔗 |
Fri 7:00 a.m. - 7:05 a.m.
|
Contributed Talk 1: Learning Hyperbolic Representations for Unsupervised 3D Segmentation
(
Contributed Talk
)
>
SlidesLive Video |
Joy Hsu · Jeffrey Gu · Serena Yeung 🔗 |
Fri 7:06 a.m. - 7:11 a.m.
|
Contributed Talk 2: Witness Autoencoder: Shaping the Latent Space with Witness Complexes
(
Contributed Talk 2
)
>
SlidesLive Video |
Anastasiia Varava · Danica Kragic · Simon Schönenberger · Jen Jen Chung · Roland Siegwart · Vladislav Polianskii 🔗 |
Fri 7:12 a.m. - 7:17 a.m.
|
Contributed Talk 3: A Riemannian gradient flow perspective on learning deep linear neural networks
(
Contributed Talk 3
)
>
SlidesLive Video |
Ulrich Terstiege · Holger Rauhut · Bubacarr Bah · Michael Westdickenberg 🔗 |
Fri 7:18 a.m. - 7:23 a.m.
|
Contributed Talk 4: Directional Graph Networks
(
Contributed Talk 4
)
>
SlidesLive Video |
Dominique Beaini · Saro Passaro · Vincent Létourneau · Will Hamilton · Gabriele Corso · Pietro Liò 🔗 |
Fri 7:24 a.m. - 7:29 a.m.
|
Contributed Talk 5: A New Neural Network Architecture Invariant to the Action of Symmetry Subgroups
(
Contributed Talk 5
)
>
SlidesLive Video |
Mete Ozay · Piotr Kicki · Piotr Skrzypczynski 🔗 |
Fri 7:30 a.m. - 8:00 a.m.
|
Virtual Coffee Break on Gather.Town link | 🔗 |
Fri 8:00 a.m. - 8:30 a.m.
|
Invited Talk 3: Reparametrization invariance in representation learning
(
Talk by Søren Hauberg
)
>
SlidesLive Video |
Søren Hauberg 🔗 |
Fri 8:30 a.m. - 9:30 a.m.
|
Poster Session 1 on Gather.Town ( Poster Session ) > link | Joey Bose · Ines Chami 🔗 |
Fri 8:30 a.m. - 9:30 a.m.
|
Quaternion Graph Neural Networks
(
Poster
)
>
SlidesLive Video |
Dai Quoc Nguyen · Tu Dinh Nguyen · Dinh Phung 🔗 |
Fri 8:30 a.m. - 9:30 a.m.
|
Universal Approximation Property of Neural Ordinary Differential Equations
(
Poster
)
>
SlidesLive Video |
Takeshi Teshima · Koichi Tojo · Masahiro Ikeda · Isao Ishikawa · Kenta Oono 🔗 |
Fri 8:30 a.m. - 9:30 a.m.
|
Hermitian Symmetric Spaces for Graph Embeddings
(
Poster
)
>
SlidesLive Video |
Federico López · Beatrice Pozzetti · Steve Trettel · Anna Wienhard 🔗 |
Fri 8:30 a.m. - 9:30 a.m.
|
Isometric Gaussian Process Latent Variable Model
(
Poster
)
>
SlidesLive Video |
Martin Jørgensen · Søren Hauberg 🔗 |
Fri 8:30 a.m. - 9:30 a.m.
|
Grassmann Iterative Linear Discriminant Analysis with Proxy Matrix Optimization
(
Poster
)
>
SlidesLive Video |
Navya Nagananda · Breton Minnehan · Andreas Savakis 🔗 |
Fri 8:30 a.m. - 9:30 a.m.
|
Tree Covers: An Alternative to Metric Embeddings
(
Poster
)
>
SlidesLive Video |
Roshni Sahoo · Ines Chami · Christopher Ré 🔗 |
Fri 8:30 a.m. - 9:30 a.m.
|
Deep Networks and the Multiple Manifold Problem
(
Poster
)
>
SlidesLive Video |
Samuel Buchanan · Dar Gilboa · John Wright 🔗 |
Fri 8:30 a.m. - 9:30 a.m.
|
GENNI: Visualising the Geometry of Equivalences for Neural Network Identifiability
(
Poster
)
>
SlidesLive Video |
Arinbjörn Kolbeinsson · Nicholas Jennings · Marc Deisenroth · Daniel Lengyel · Janith Petangoda · Michalis Lazarou · Kate Highnam · John IF Falk 🔗 |
Fri 8:30 a.m. - 9:30 a.m.
|
Graph of Thrones : Adversarial Perturbations dismantle Aristocracy in Graphs
(
Poster
)
>
SlidesLive Video |
Adarsh Jamadandi · Uma Mudenagudi 🔗 |
Fri 8:30 a.m. - 9:30 a.m.
|
A Metric for Linear Symmetry-Based Disentanglement
(
Poster
)
>
SlidesLive Video |
Luis Armando Pérez Rey · Loek Tonnaer · Vlado Menkovski · Mike Holenderski · Jim Portegies 🔗 |
Fri 9:30 a.m. - 10:15 a.m.
|
Panel Discussion
(
Panel
)
>
|
Joey Bose · Emile Mathieu · Charline Le Lan · Ines Chami 🔗 |
Fri 10:15 a.m. - 10:45 a.m.
|
Virtual Coffee Break on Gather.Town link | 🔗 |
Fri 10:45 a.m. - 11:30 a.m.
|
Focused Breakout Session
(
Demonstration
)
>
link
SlidesLive Video |
Ines Chami · Joey Bose 🔗 |
Fri 10:45 a.m. -
|
Focused Breakout Session Companion Notebook: Poincare Embeddings ( Demonstration ) > link | 🔗 |
Fri 10:45 a.m. -
|
Focused Breakout Session Companion Notebook: Wrapped Normal Distribution ( Demonstration ) > link | 🔗 |
Fri 11:30 a.m. - 12:00 p.m.
|
Invited Talk 4: An introduction to the Calderon and Steklov inverse problems on Riemannian manifolds with boundary
(
Talk by Niky Kamran
)
>
SlidesLive Video |
Niky Kamran 🔗 |
Fri 12:00 p.m. - 1:00 p.m.
|
Poster Session 2 on Gather.Town ( Poster Session ) > link | Charline Le Lan · Emile Mathieu 🔗 |
Fri 12:00 p.m. - 1:00 p.m.
|
The Intrinsic Dimension of Images and Its Impact on Learning
(
Poster
)
>
SlidesLive Video |
Chen Zhu · Micah Goldblum · Ahmed Abdelkader · Tom Goldstein · Phillip Pope 🔗 |
Fri 12:00 p.m. - 1:00 p.m.
|
Sparsifying networks by traversing Geodesics
(
Poster
)
>
SlidesLive Video |
Guruprasad Raghavan · Matt Thomson 🔗 |
Fri 12:00 p.m. - 1:00 p.m.
|
Convex Optimization for Blind Source Separation on a Statistical Manifold
(
Poster
)
>
SlidesLive Video |
Simon Luo · lamiae azizi · Mahito Sugiyama 🔗 |
Fri 12:00 p.m. - 1:00 p.m.
|
Unsupervised Orientation Learning Using Autoencoders
(
Poster
)
>
SlidesLive Video |
Rembert Daems · Francis Wyffels 🔗 |
Fri 12:00 p.m. - 1:00 p.m.
|
Towards Geometric Understanding of Low-Rank Approximation
(
Poster
)
>
SlidesLive Video |
Mahito Sugiyama · Kazu Ghalamkari 🔗 |
Fri 12:00 p.m. - 1:00 p.m.
|
Deep Riemannian Manifold Learning
(
Poster
)
>
SlidesLive Video |
Aaron Lou · Maximilian Nickel · Brandon Amos 🔗 |
Fri 12:00 p.m. - 1:00 p.m.
|
Leveraging Smooth Manifolds for Lexical Semantic Change Detection across Corpora
(
Poster
)
>
SlidesLive Video |
Anmol Goel · Ponnurangam Kumaraguru 🔗 |
Fri 12:00 p.m. - 1:00 p.m.
|
Extendable and invertible manifold learning with geometry regularized autoencoders
(
Poster
)
>
SlidesLive Video |
Andres F Duque · Sacha Morin · Guy Wolf · Kevin Moon 🔗 |
Fri 12:00 p.m. - 1:00 p.m.
|
QuatRE: Relation-Aware Quaternions for Knowledge Graph Embeddings
(
Poster
)
>
SlidesLive Video |
Dai Quoc Nguyen · Dinh Phung 🔗 |
Fri 12:00 p.m. - 1:00 p.m.
|
Affinity guided Geometric Semi-Supervised Metric Learning
(
Poster
)
>
SlidesLive Video |
Ujjal Dutta · Mehrtash Harandi · C Chandra Shekhar 🔗 |
Fri 1:00 p.m. - 1:30 p.m.
|
Invited Talk 5: Disentangling Orientation and Camera Parameters from Cryo-Electron Microscopy Images Using Differential Geometry and Variational Autoencoders
(
Talk by Nina Miolane
)
>
SlidesLive Video |
Nina Miolane 🔗 |
Fri 1:30 p.m. - 2:00 p.m.
|
Invited Talk 6: Learning a robust classifier in hyperbolic space
(
Talk by Melanie Weber
)
>
SlidesLive Video |
Melanie Weber 🔗 |