Skip to yearly menu bar Skip to main content


Spotlight Poster

Saliency-driven Experience Replay for Continual Learning

Giovanni Bellitto · Federica Proietto Salanitri · Matteo Pennisi · Matteo Boschini · Lorenzo Bonicelli · Angelo Porrello · SIMONE CALDERARA · Simone Palazzo · Concetto Spampinato

West Ballroom A-D #5803
[ ] [ Project Page ]
Wed 11 Dec 4:30 p.m. PST — 7:30 p.m. PST

Abstract:

We present Saliency-driven Experience Replay - SER - a biologically-plausible approach based on replicating human visual saliency to enhance classification models in continual learning settings. Inspired by neurophysiological evidence that the primary visual cortex does not contribute to object manifold untangling for categorization and that primordial saliency biases are still embedded in the modern brain, we propose to employ auxiliary saliency prediction features as a modulation signal to drive and stabilize the learning of a sequence of non-i.i.d. classification tasks. Experimental results confirm that SER effectively enhances the performance (in some cases up to about twenty percent points) of state-of-the-art continual learning methods, both in class-incremental and task-incremental settings. Moreover, we show that saliency-based modulation successfully encourages the learning of features that are more robust to the presence of spurious features and to adversarial attacks than baseline methods. Code is available at: https://github.com/perceivelab/SER

Live content is unavailable. Log in and register to view live content