Workshop
The Symbiosis of Deep Learning and Differential Equations -- III
Luca Herranz-Celotti · Martin Magill · Ermal Rrapaj · Winnie Xu · Qiyao Wei · Archis Joglekar · Michael Poli · Animashree Anandkumar
Room 255 - 257
Sat 16 Dec, 6:30 a.m. PST
In the deep learning community, a remarkable trend is emerging, where powerful architectures are created by leveraging classical mathematical modeling tools from diverse fields like differential equations, signal processing, and dynamical systems. Differential equations are a prime example: research on neural differential equations has expanded to include a large zoo of related models with applications ranging from time series analysis to robotics control. Score-based diffusion models are among state-of-the-art tools for generative modelling, drawing connections between diffusion models and neural differential equations. Other examples of deep architectures with important ties to classical fields of mathematical modelling include normalizing flows, graph neural diffusion models, Fourier neural operators, architectures exhibiting domain-specific equivariances, and latent dynamical models (e.g., latent NDEs, H3, S4, Hyena). The previous two editions of the Workshop on the Symbiosis of Deep Learning and Differential Equations have promoted the bidirectional exchange of ideas at the intersection of classical mathematical modelling and modern deep learning. On the one hand, this includes the use of differential equations and similar tools to create neural architectures, accelerate deep learning optimization problems, or study theoretical problems in deep learning. On the other hand, the Workshop also explores the use of deep learning methods to improve the speed, flexibility, or realism of computer simulations. Last year, we noted a particularly keen interest from the audience in neural architectures that leveraged classical mathematical models, such as those listed above. We therefore propose that the third edition of this Workshop focus on this theme.
Schedule
Sat 6:30 a.m. - 6:45 a.m.
|
Introduction and opening remarks
(
Introduction
)
>
SlidesLive Video |
🔗 |
Sat 6:45 a.m. - 7:30 a.m.
|
Philip M. Kim - Machine learning methods for protein, peptide and antibody design.
(
Keynote Talk
)
>
SlidesLive Video |
🔗 |
Sat 7:30 a.m. - 7:45 a.m.
|
Effective Latent Differential Equation Models via Attention and Multiple Shooting
(
Spotlight
)
>
link
SlidesLive Video |
Germán Abrevaya · Mahta Ramezanian-Panahi · Jean-Christophe Gagnon-Audet · Pablo Polosecki · Irina Rish · Silvina Ponce Dawson · Guillermo Cecchi · Guillaume Dumas 🔗 |
Sat 7:45 a.m. - 8:00 a.m.
|
Adaptive Resolution Residual Networks
(
Spotlight
)
>
link
SlidesLive Video |
Léa Demeule · Mahtab Sandhu · Glen Berseth 🔗 |
Sat 8:00 a.m. - 8:15 a.m.
|
Break
|
🔗 |
Sat 8:15 a.m. - 9:00 a.m.
|
Poster Session 1
(
Poster Session
)
>
|
🔗 |
Sat 9:00 a.m. - 9:45 a.m.
|
Yulia Rubanova - Learning efficient and scalable simulation using graph networks.
(
Keynote Talk
)
>
SlidesLive Video |
🔗 |
Sat 9:45 a.m. - 10:00 a.m.
|
Can Physics informed Neural Operators self improve?
(
Spotlight
)
>
link
SlidesLive Video |
Ritam Majumdar · Amey Varhade · Shirish Karande · Lovekesh Vig 🔗 |
Sat 10:00 a.m. - 11:00 a.m.
|
Lunch Break
(
Lunch Break
)
>
|
🔗 |
Sat 11:00 a.m. - 11:45 a.m.
|
Michael Bronstein - Physics-inspired learning on graphs.
(
Keynote Talk
)
>
SlidesLive Video |
🔗 |
Sat 11:45 a.m. - 12:00 p.m.
|
Vertical AI-driven Scientific Discovery
(
Spotlight
)
>
link
SlidesLive Video |
Yexiang Xue 🔗 |
Sat 12:00 p.m. - 12:15 p.m.
|
ELeGANt: An Euler-Lagrange Analysis of Wasserstein Generative Adversarial Networks
(
Spotlight
)
>
link
SlidesLive Video |
Siddarth Asokan · Chandra Seelamantula 🔗 |
Sat 12:15 p.m. - 1:00 p.m.
|
Albert Gu - Structured State Space Models for Deep Sequence Modeling.
(
Keynote Talk
)
>
SlidesLive Video |
🔗 |
Sat 1:00 p.m. - 1:15 p.m.
|
TANGO: Time-reversal Latent GraphODE for Multi-Agent Dynamical Systems
(
Spotlight
)
>
link
SlidesLive Video |
Zijie Huang · Wanjia Zhao · Jingdong Gao · Ziniu Hu · Xiao Luo · Yadi Cao · Yuanzhou Chen · Yizhou Sun · Wei Wang 🔗 |
Sat 1:15 p.m. - 1:30 p.m.
|
Break
|
🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Poster Session 2
(
Poster Session
)
>
|
🔗 |
Sat 2:30 p.m. - 2:45 p.m.
|
Closing Remarks
(
Closing Remarks
)
>
SlidesLive Video |
🔗 |
-
|
Physics-Informed Transformer Networks ( Poster ) > link | Fabricio Dos Santos · Tara Akhound-Sadegh · Siamak Ravanbakhsh 🔗 |
-
|
Generalized One-Shot Transfer Learning of Linear Ordinary and Partial Differential Equations ( Poster ) > link | Pavlos Protopapas · Hari Raval 🔗 |
-
|
Towards Optimal Network Depths: Control-Inspired Acceleration of Training and Inference in Neural ODEs ( Poster ) > link | Keyan Miao · Konstantinos Gatsis 🔗 |
-
|
Causal Graph ODE: Continuous Treatment Effect Modeling in Multi-agent Dynamical Systems ( Poster ) > link | Zijie Huang · Jeehyun Hwang · Junkai Zhang · Jinwoo Baik · Weitong ZHANG · Quanquan Gu · Dominik Wodarz · Yizhou Sun · Wei Wang 🔗 |
-
|
Data-Driven Neural-ODE Modeling for Breast Cancer Tumor Dynamics and Progression-Free Survival Predictions ( Poster ) > link | Jinlin Xiang · Bozhao Qi · Qi Tang · Marc Cerou · Wei Zhao 🔗 |
-
|
Orthogonal Polynomials Quadrature Algorithm: a functional analytic approach to inverse problems in deep learning ( Poster ) > link | Lilian Wong 🔗 |
-
|
Advancing Graph Neural Networks Through Joint Time-Space Dynamics ( Poster ) > link | Qiyu Kang · Yanan Zhao · Kai Zhao · Xuhao Li · Qinxu Ding · Wee Peng Tay · Sijie Wang 🔗 |
-
|
Two-Step Bayesian PINNs for Uncertainty Estimation ( Poster ) > link | Pablo Flores · Olga Graf · Pavlos Protopapas · Karim Pichara 🔗 |
-
|
$ODE$Solvers are also Wayfinders: Neural ODEs for Multi-Agent Pathplanning ( Poster ) > link | Progyan Das · Dwip Dalal 🔗 |
-
|
Physics-Informed Neural Operators with Exact Differentiation on Arbitrary Geometries ( Poster ) > link | Colin White · Julius Berner · Jean Kossaifi · Mogab Elleithy · David Pitt · Daniel Leibovici · Zongyi Li · Kamyar Azizzadenesheli · Animashree Anandkumar 🔗 |
-
|
PINNs-Torch: Enhancing Speed and Usability of Physics-Informed Neural Networks with PyTorch ( Poster ) > link | Reza Akbarian Bafghi · Maziar Raissi 🔗 |
-
|
One-Shot Transfer Learning for Nonlinear ODEs ( Poster ) > link | Wanzhou Lei · Pavlos Protopapas · Joy Parikh 🔗 |
-
|
Deep PDE Solvers for Subgrid Modelling and Out-of-Distribution Generalization ( Poster ) > link | Patrick Chatain · Adam Oberman 🔗 |
-
|
Multiscale Neural Operators for Solving Time-Independent PDEs ( Poster ) > link | Winfried Ripken · Lisa Coiffard · Felix Pieper · Sebastian Dziadzio 🔗 |
-
|
Individualized Dosing Dynamics via Neural Eigen Decomposition ( Poster ) > link | Stav Belogolovsky · Ido Greenberg · Danny Eytan · Shie Mannor 🔗 |
-
|
Neural Differential Recurrent Neural Network with Adaptive Time Steps ( Poster ) > link | Yixuan Tan · Liyan Xie · Xiuyuan Cheng 🔗 |
-
|
Evaluating Uncertainty Quantification approaches for Neural PDEs in scientific application ( Poster ) > link | Vardhan Dongre · Gurpreet Singh Hora 🔗 |
-
|
Multimodal base distributions for continuous-time normalising flows ( Poster ) > link | Shane Josias · Willie Brink 🔗 |
-
|
Unifying Neural Controlled Differential Equations and Neural Flow for Irregular Time Series Classification ( Poster ) > link | YongKyung Oh · Dongyoung Lim · SUNGIL KIM 🔗 |
-
|
Enhanced Distribution Modelling via Augmented Architectures For Neural ODE Flows ( Poster ) > link | Etrit Haxholli · Marco Lorenzi 🔗 |
-
|
Does In-Context Operator Learning Generalize to Domain-Shifted Settings? ( Poster ) > link | Jerry Liu · N. Benjamin Erichson · Kush Bhatia · Michael Mahoney · Christopher Ré 🔗 |
-
|
On the Generalization of Deep Neural Networks for Optimal Sensor Placement in Global Ocean Forecasting ( Poster ) > link | Alexander Lobashev · Nikita Turko · Konstantin Ushakov · Maxim Kaurkin · Rashit Ibrayev 🔗 |
-
|
A Holistic Vision: Modeling Patient Trajectories in Longitudinal Medical Imaging ( Poster ) > link | Nico Disch · David Zimmerer 🔗 |
-
|
Solving Noisy Inverse Problems via Posterior Sampling: A Policy Gradient View-Point ( Poster ) > link | Haoyue Tang · Tian Xie · Aosong Feng · Hanyu Wang · Chenyang Zhang · Yang Bai 🔗 |
-
|
Neural oscillators for generalizing parametric PDEs ( Poster ) > link | Taniya Kapoor · Abhishek Chandra · Daniel Tartakovsky · Hongrui Wang · Alfredo Nunez · Rolf Dollevoet 🔗 |