Skip to yearly menu bar Skip to main content


Poster
in
Workshop: 4th Workshop on Self-Supervised Learning: Theory and Practice

CCA with Shared Weights for Self-Supervised Learning

James Chapman · Lennie Wells


Abstract:

In this paper, we explore SSL-EY (Self-Supervised Learning with an Eckhart-Young characterization), a novel self-supervised learning loss function directly inspired by Deep Canonical Correlation Analysis (DCCA). Our key insight is that maximizing the correlation of learned representations can serve as both an effective and interpretable objective in self-supervised learning. We demonstrate that SSL-EY not only strengthens the theoretical underpinning of existing methods, such as Barlow Twins and VICReg, but also performs competitively on benchmark datasets.

Chat is not available.