Poster
in
Workshop: NeurIPS 2022 Workshop on Score-Based Methods
Self-Guided Diffusion Model
TAO HU · David Zhang · Yuki Asano · Gertjan Burghouts · Cees Snoek
Diffusion models have demonstrated remarkable progress in image generation quality, especially when guidance is used to control the generative process. However, such guidance requires a large amount of image-annotation pairs for training and is thus dependent on their availability, correctness and unbiasedness. In this paper, we aim to eliminate the need for such annotation by instead leveraging the flexibility of self-supervision signals to design a framework for self-guided diffusion models. By leveraging a feature extraction function and a self-annotation function, our method provides flexible guidance signals at various image granularities: from the level of holistic images to object boxes and even segmentation masks.