Skip to yearly menu bar Skip to main content


Full Presentation
in
Session: Creative AI Session 3

Sketchy Collections: Exploring Digital Museum Collections by Drawing via CLIP

Polo Sologub · Rebecca Fiebrink

East Ballroom C
[ ] [ Project Page ]
Wed 11 Dec 11 a.m. PST — 2 p.m. PST

Abstract:

In recent years, digital museum collections have made it possible for everyone to discover cultural heritage (CH) online. However, that does not mean that they are engaging or fun for casual users to explore. In this paper, we develop a web interface that lets users search and compare three museum collections by drawing images. We describe our approach of using CLIP as a feature extraction model for a Sketch-Based Image Retrieval (SBIR) model based on museum tags. Through qualitative experiments and a user study, we demonstrate that the model performs well in a CH context with interesting results and that the interface enables playful search and serendipitous discoveries.

Chat is not available.