Workshop
UniReps: Unifying Representations in Neural Models
Marco Fumero · Zorah Lähner · Luca Moschella · Clémentine Dominé · Donato Crisostomi · Kimberly Stachenfeld
West Exhibition Hall C, B3
Sat 14 Dec, 8:15 a.m. PST
Neural models tend to learn similar representations when subject to similar stimuli; this behavior has been observed both in biological and artificial settings. The emergence of these similar representations is igniting a growing interest in the fields of neuroscience and artificial intelligence. To gain a theoretical understanding of this phenomenon, promising directions include: analyzing the learning dynamics and studying the problem of identifiability in the functional and parameter space. This has strong consequences in unlocking a plethora of applications in ML from model fusion, model stitching, to model reuse and in improving the understanding of biological and artificial neural models, including large retrained foundation models. The objective of the workshop is to discuss theoretical findings, empirical evidence and practical applications of this phenomenon, benefiting from the cross-pollination of different fields (ML, Neuroscience, Cognitive Science) to foster the exchange of ideas and encourage collaborations. Overall the questions we aim to investigate are when, why and how internal representations of distinct neural models can be unified into a common representation.
Schedule
Sat 8:15 a.m. - 8:30 a.m.
|
Opening Remarks
(
Presentation
)
>
SlidesLive Video |
🔗 |
Sat 8:30 a.m. - 9:00 a.m.
|
Learning dynamics describe the computational role of (universal) representations
(
Invited Talk
)
>
SlidesLive Video |
Erin Grant 🔗 |
Sat 9:00 a.m. - 9:30 a.m.
|
Interpretable Theories for Comparing Biological and Artificial Neural Networks
(
Invited Talk
)
>
SlidesLive Video |
SueYeon Chung 🔗 |
Sat 9:30 a.m. - 10:00 a.m.
|
The Platonic Representation Hypothesis
(
Invited Talk
)
>
SlidesLive Video |
Phillip Isola 🔗 |
Sat 10:00 a.m. - 10:30 a.m.
|
Coffee Break
|
🔗 |
Sat 10:30 a.m. - 11:45 a.m.
|
Contributed talks
SlidesLive Video |
🔗 |
Sat 11:45 a.m. - 12:45 p.m.
|
Panel Discussion
SlidesLive Video |
Alex Williams · Matthew Leavitt · Erin Grant 🔗 |
Sat 12:45 p.m. - 2:00 p.m.
|
Lunch
|
🔗 |
Sat 2:00 p.m. - 2:30 p.m.
|
On Using Optimal Transport Distances to Regularize Representation Learning
(
Invited Talk
)
>
SlidesLive Video |
Marco Cuturi 🔗 |
Sat 2:30 p.m. - 3:00 p.m.
|
Open Problems in Universality: A mechanistic interpretability perspective
(
Invited Talk
)
>
SlidesLive Video |
Neel Nanda 🔗 |
Sat 3:00 p.m. - 3:30 p.m.
|
Parameter Symmetries in Neural Networks: what they affect and what to do with them
(
Invited Talk
)
>
SlidesLive Video |
Stefanie Jegelka 🔗 |
Sat 3:30 p.m. - 3:45 p.m.
|
Closing Remarks
(
Talk
)
>
SlidesLive Video |
🔗 |
Sat 3:45 p.m. - 5:00 p.m.
|
Poster session
|
🔗 |
Sat 5:00 p.m. - 5:30 p.m.
|
Social Event
|
🔗 |
-
|
Equivalence between representational similarity analysis, centered kernel alignment, and canonical correlations analysis ( Poster ) > link | Alex Williams 🔗 |
-
|
From Lazy to Rich: Exact Learning Dynamics in Deep Linear Networks ( Poster ) > link | Clémentine Dominé · Nicolas Anguita · Alexandra Proca · Lukas Braun · Daniel Kunin · Pedro A.M Mediano · Andrew Saxe 🔗 |
-
|
Decision-margin consistency: a principled metric for human and machine performance alignment ( Poster ) > link | George Alvarez · Talia Konkle 🔗 |
-
|
Winning Tickets from Random Initialization: Aligning Masks for Sparse Training ( Poster ) > link | Rohan Jain · Mohammed Adnan · Ekansh Sharma · Yani Ioannou 🔗 |
-
|
A Framework for Standardizing Similarity Measures in a Rapidly Evolving Field ( Poster ) > link | Nathan Cloos · Guangyu Robert Yang · Christopher Cueva 🔗 |
-
|
Position: Maximizing Neural Regression Scores May Not Identify Good Models of the Brain ( Poster ) > link | Rylan Schaeffer · Mikail Khona · Sarthak Chandra · Mitchell Ostrow · Brando Miranda · Sanmi Koyejo 🔗 |
-
|
M3CoL: Harnessing Shared Relations via Multimodal Mixup Contrastive Learning for Multimodal Classification ( Poster ) > link | Raja Kumar · Raghav Singhal · Pranamya Kulkarni · Deval Mehta · Kshitij Jadhav 🔗 |
-
|
Understanding Variational Autoencoders with Intrinsic Dimension and Information Imbalance ( Poster ) > link | Charles Camboulin · Diego Doimo · Aldo Glielmo 🔗 |
-
|
Investigating the role of modality and training objective on representational alignment between transformers and the brain ( Poster ) > link | Willow Han · Ruchira Dhar · Qingqing Yang · Maryam Behbahani · Maria Alejandra Martinez Ortiz · Tolulope Oladele · Diana C Dima · Hsin-Hung Li · Anders Søgaard · Yalda Mohsenzadeh 🔗 |
-
|
Federated GNNs for EEG-Based Stroke Assessment ( Poster ) > link | Andrea Protani · Lorenzo Giusti · Albert Sund Aillet · Simona Sacco · Paolo Manganotti · Lucio Marinelli · Diogo Reis Santos · Pierpaolo Brutti · Pietro Caliandro · Luigi Serio 🔗 |
-
|
Language decoding from human brain activity via contrastive learning ( Poster ) > link | Matteo Ferrante · Nicola Toschi · Alexander Huth 🔗 |
-
|
An Information Criterion for Controlled Disentanglement of Multimodal Data ( Poster ) > link | Chenyu Wang · Sharut Gupta · Xinyi Zhang · Sana Tonekaboni · Stefanie Jegelka · Tommi Jaakkola · Caroline Uhler 🔗 |
-
|
Comparing the local information geometry of image representations ( Poster ) > link | David Lipshutz · Jenelle Feather · Sarah Harvey · Alex Williams · Eero Simoncelli 🔗 |
-
|
Symmetry Discovery in Neural Network Parameter Spaces ( Poster ) > link | Bo Zhao · Nima Dehmamy · Robin Walters · Rose Yu 🔗 |
-
|
Representation with a capital 'R' ( Poster ) > link | Jacob Prince · George Alvarez · Talia Konkle 🔗 |
-
|
Vision and language representations in multimodal AI models and human social brain regions during natural movie viewing ( Poster ) > link | Hannah Small · Haemy Lee Masson · Leyla Isik 🔗 |
-
|
A Cognitive Framework for Learning Debiased and Interpretable Representations via Debiasing Global Workspace ( Poster ) > link | Jinyung Hong · Eun Som Jeon · Changhoon Kim · Keun Hee Park · Utkarsh Nath · 'YZ' Yezhou Yang · Pavan Turaga · Theodore P. Pavlic 🔗 |
-
|
Unsupervised Learning of Categorical Structure ( Poster ) > link | Matteo Alleman · Stefano Fusi 🔗 |
-
|
Topology Preserving Regularization for Independent Training of Inter-operable Models ( Poster ) > link | Nicolas Zilberstein · Akshay Malhotra · Shahab Hamidi-Rad · Yugeswar Deenoo 🔗 |
-
|
Random Propagations in GNNs ( Poster ) > link | Thu Bui · Anugunj Naman · Carola-Bibiane Schönlieb · Bruno Ribeiro · Beatrice Bevilacqua · Moshe Eliasof 🔗 |
-
|
Modern Hopfield Networks meet Encoded Neural Representations - Addressing Practical Considerations ( Poster ) > link | Satyananda Kashyap · Niharika DSouza · Luyao Shi · Ken C. L. Wong · Hongzhi Wang · Tanveer Syeda-Mahmood 🔗 |
-
|
Hypernetworks for image recontextualization ( Poster ) > link | Maciej Zieba · Jakub Balicki · Tomasz Dróżdż · Konrad Karanowski · Pawel Lorek · Hong Lyu · Aleksander Skorupa · Tomasz Trzcinski · Oriol Caudevilla · Jakub Tomczak 🔗 |
-
|
What Representational Similarity Measures Imply about Decodable Information ( Poster ) > link | Sarah Harvey · David Lipshutz · Alex Williams 🔗 |
-
|
Connecting Neural Models Latent Geometries with Relative Geodesic Representations ( Poster ) > link | Hanlin Yu · Berfin Inal · Marco Fumero 🔗 |
-
|
CopRA: A Progressive LoRA Training Strategy ( Poster ) > link | Zhan Zhuang · XIEQUN WANG · Yulong Zhang · Wei Li · Yu Zhang · Ying Wei 🔗 |
-
|
DFM: Interpolant-free Dual Flow Matching ( Poster ) > link | Denis Gudovskiy · Tomoyuki Okuno · Yohei Nakata 🔗 |
-
|
Look-Ahead Selective Plasticity for Continual Learning of Visual Tasks ( Poster ) > link | Rouzbeh Meshkinnejad · Jie Mei · Zeduo Zhang · Daniel Lizotte · Yalda Mohsenzadeh 🔗 |
-
|
Emergence of Text Semantics in CLIP Image Encoders ( Poster ) > link | Sreeram Vennam · Shashwat Singh · Anirudh Govil · Ponnurangam Kumaraguru 🔗 |
-
|
Hybrid Dynamic High-Order Functional Correlations and Divisive Normalization for Improved Classification of Schizophrenia and Bipolar Disorder ( Poster ) > link | Qiang Li · Vince Calhoun 🔗 |
-
|
Video decoding from human fMRI data with a multi-stream sensory approach ( Poster ) > link | Matteo Ferrante · Matteo Ciferri · Nicola Toschi 🔗 |
-
|
Invariant Learning with Annotation-free Environments ( Poster ) > link | Phuong Quynh Le · Jörg Schlötterer · Christin Seifert 🔗 |
-
|
Workshop Submission: Towards Making Untrainable Networks Trainable ( Poster ) > link | Vighnesh Subramaniam · Tomaso Poggio · Boris Katz · Brian Cheung · Andrei Barbu 🔗 |
-
|
Circular Learning Provides Biological Plausibility ( Poster ) > link | Amin Tavakoli · ian domingo · Pierre Baldi 🔗 |
-
|
Auxiliary objectives improve generalization performance but reduce model specification for low-data neuroimaging-based brain age prediction ( Poster ) > link | Donghyun Kim · Eloy Geenjaar · Vince Calhoun 🔗 |
-
|
Evidence from fMRI Supports a Two-Phase Abstraction Process in Language Models ( Poster ) > link | Richard Antonello · Emily Cheng 🔗 |
-
|
Understanding Memorization using Representation Similarity Analysis and Model Stitching ( Poster ) > link | Aishwarya Gupta · Indranil Saha · Piyush Rai 🔗 |
-
|
Correlating Variational Autoencoders Natively For Multi-View Imputation ( Poster ) > link | Ella Orme · Marina Evangelou · Ulrich Paquet 🔗 |
-
|
On the cognitive alignment between humans and machines ( Poster ) > link | Marco Rothermel · Soroush Daftarian · Tahmineh A. Koosha · Mohammad-Ali Nikouei Mahani · Hamidreza Jamalabadi 🔗 |
-
|
Joint Learning for Visual Reconstruction from the Brain Activity: Hierarchical Representation of Image Perception with EEG-Vision Transformer ( Poster ) > link | Ali Ackbari · Kosar Arani · Tony Muhammad Yousefnezhad · Maryam Mirian · Emad Arasteh 🔗 |
-
|
Challenges in Explaining Representational Similarity through Identifiability ( Poster ) > link | Beatrix M. G. Nielsen · Luigi Gresele · Andrea Dittadi 🔗 |
-
|
Multi-task Learning yields Disentangled World Models: Impact and Implications ( Poster ) > link | Pantelis Vafidis · Aman Bhargava · Antonio Rangel 🔗 |
-
|
Improving OOD Generalization of Pre-trained Encoders via Aligned Embedding-Space Ensembles ( Poster ) > link | Shuman Peng · Arash Khoeini · Sharan Vaswani · Martin Ester 🔗 |
-
|
Relative Representations: Topological and Geometric Perspectives ( Poster ) > link | Alejandro García-Castellanos · Giovanni Luca Marchetti · Danica Kragic · Martina Scolamiero 🔗 |
-
|
Fast Imagic: Solving Overfitting in Text-guided Image Editing via Disentangled UNet with Forgetting Mechanism and Unified Vision-Language Optimization ( Poster ) > link | Shiwen Zhang 🔗 |
-
|
Disentangling the Effects of Data Augmentation and Format Transform in Self-Supervised Learning of Image Representations ( Poster ) > link | Neha Kalibhat · Warren Morningstar · Alex Bijamov · Luyang Liu · Karan Singhal · Philip Mansfield 🔗 |
-
|
It's All Relative: Relative Uncertainty in Latent Spaces using Relative Representations ( Poster ) > link | Fabian Mager · Valentino Maiorca · Lars Kai Hansen 🔗 |
-
|
Inducing Human-like Biases in Moral Reasoning Language Models ( Poster ) > link | Austin Meek · Artem Karpov · Seong Cho · Raymond Koopmanschap · Lucy Farnik · Bogdan-Ionut Cirstea 🔗 |
-
|
Revealing spatial-frequency channels in an ensemble encoding model of human fMRI ( Poster ) > link | Furkan Ozcelik · Ajay Subramanian · Najib Majaj · Denis Pelli 🔗 |
-
|
VISTA: A Panoramic View of Neural Representations ( Poster ) > link | Tom White 🔗 |
-
|
Representation Learning of Structured Data for Medical Foundation Models ( Poster ) > link | Vijay Prakash Dwivedi · Viktor Schlegel · Andy Liu · Thanh-Tung Nguyen · Abhinav Ramesh Kashyap · Jeng Wei · Wei-Hsian Yin · Stefan Winkler · Robby Tan 🔗 |
-
|
Unifying Causal Representation Learning with the Invariance Principle ( Poster ) > link | Dingling Yao · Dario Rancati · Riccardo Cadei · Marco Fumero · Francesco Locatello 🔗 |
-
|
Unsupervised Modality Adaptation in Human Action Recognition via Cross-modal Representation Learning ( Poster ) > link | Abhi Kamboj · Duy Nguyen · Minh Do 🔗 |
-
|
Understanding Task Knowledge Entanglement in Protein Language Model Representations ( Poster ) > link | Ria Vinod 🔗 |
-
|
Monkey See, Model Knew: Large Language Models accurately Predict Human AND Macaque Visual Brain Activity ( Poster ) > link | Colin Conwell · Emalie McMahon · Akshay Jagadeesh · Kasper Vinken · Saloni Sharma · Jacob Prince · George Alvarez · Talia Konkle · Leyla Isik · Margaret Livingstone 🔗 |
-
|
Rethinking Fine-tuning Through Geometric Perspective ( Poster ) > link | Krishna Sri Ipsit Mantri · Moshe Eliasof · Carola-Bibiane Schönlieb · Bruno Ribeiro 🔗 |
-
|
Improving Model Merging with Natural Niches ( Poster ) > link | João Abrantes · Robert Lange · Yujin Tang 🔗 |
-
|
Adapter to facilitate Foundation Model Communication for DLO Instance Segmentation ( Poster ) > link | Omkar Joglekar · Shir Simon (Kozlovsky) · Dotan Di Castro 🔗 |
-
|
Self-Supervised Pre-training of Spiking Neural Networks by Contrasting Events and Frames ( Poster ) > link | Raghav Singhal · Jan Finkbeiner · Emre Neftci 🔗 |
-
|
Understanding Permutation Based Model Merging with Feature Visualizations ( Poster ) > link | Congshu Zou · Geraldin Nanfack · Stefan Horoi · Eugene Belilovsky 🔗 |
-
|
DIETing: Self-Supervised Learning with Instance Discrimination Learns Identifiable Features ( Poster ) > link | Attila Juhos · Alice Bizeul · Patrik Reizinger · David Klindt · Randall Balestriero · Mark Ibrahim · Julia Vogt · Wieland Brendel 🔗 |
-
|
Comparing Representations in Static and Dynamic Vision Models to the Human Brain ( Poster ) > link | Hamed Karimi · Stefano Anzellotti 🔗 |
-
|
Locality-aware Concept Bottleneck Model ( Poster ) > link | sujin jeon · Inwoo Hwang · Sanghack Lee · Byoung-Tak Zhang 🔗 |
-
|
Artificial Neural Networks Explain Continuous Speech Perception in Humans ( Poster ) > link | Gasser Elbanna · Josh McDermott 🔗 |
-
|
Multimodal Lego: Model Merging and Fine-Tuning Across Topologies and Modalities ( Poster ) > link | Konstantin Hemker · Nikola Simidjievski · Mateja Jamnik 🔗 |
-
|
Conic Activation Functions ( Poster ) > link | Changqing Fu · Laurent Cohen 🔗 |
-
|
Shared Recurrent Memory Improves Multi-agent Pathfinding ( Poster ) > link | Alsu Sagirova · Yury Kuratov · Mikhail Burtsev 🔗 |
-
|
Task-Relevant Covariance from Manifold Capacity Theory Improves Robustness in Deep Networks ( Poster ) > link | William Yang · Chi-Ning Chou · SueYeon Chung 🔗 |
-
|
Small-scale adversarial perturbations expose differences between predictive encoding models of human fMRI responses ( Poster ) > link | Nikolas McNeal · Mainak Deb · N Apurva Ratan Murty 🔗 |
-
|
Delays in generalization match delayed changes in representational geometry ( Poster ) > link | Xingyu Zheng · Kyle Daruwalla · Ari Benjamin · David Klindt 🔗 |
-
|
Equivalence between representational similarity analysis, centered kernel alignment, and canonical correlations analysis ( Oral ) > link | Alex Williams 🔗 |
-
|
A Framework for Standardizing Similarity Measures in a Rapidly Evolving Field ( Oral ) > link | Nathan Cloos · Guangyu Robert Yang · Christopher Cueva 🔗 |
-
|
An Information Criterion for Controlled Disentanglement of Multimodal Data ( Oral ) > link | Chenyu Wang · Sharut Gupta · Xinyi Zhang · Sana Tonekaboni · Stefanie Jegelka · Tommi Jaakkola · Caroline Uhler 🔗 |
-
|
Representation with a capital 'R' ( Oral ) > link | Jacob Prince · George Alvarez · Talia Konkle 🔗 |
-
|
Modern Hopfield Networks meet Encoded Neural Representations - Addressing Practical Considerations ( Oral ) > link | Satyananda Kashyap · Niharika DSouza · Luyao Shi · Ken C. L. Wong · Hongzhi Wang · Tanveer Syeda-Mahmood 🔗 |
-
|
What Representational Similarity Measures Imply about Decodable Information ( Oral ) > link | Sarah Harvey · David Lipshutz · Alex Williams 🔗 |
-
|
Evidence from fMRI Supports a Two-Phase Abstraction Process in Language Models ( Oral ) > link | Richard Antonello · Emily Cheng 🔗 |
-
|
Multimodal Lego: Model Merging and Fine-Tuning Across Topologies and Modalities ( Oral ) > link | Konstantin Hemker · Nikola Simidjievski · Mateja Jamnik 🔗 |
-
|
Invited Talk: M.Cuturi
(
Talk
)
>
|
🔗 |