Video Presentation
in
Session: Creative AI Videos
Diffusion Model for Chinese Calligraphy Generation and Inpainting
Qisheng Liao
Chinese calligraphy, which is the artistic writing of Chinese characters and a prominent form of East Asian calligraphy, can be seen as a distinctive form of visual art. It involves writing Chinese characters with a brush and ink but is not just a means of communication but a visual art that has deep cultural and historical significance in China and other East Asian countries. Recent advancements in computer vision hold significant potential for the future development of generative models in the realm of Chinese calligraphy, but most previous works are related to traditional paintings or photographs. In our work, we train a conditional diffusion model that can generate high-quality Chinese calligraphy. We also apply the latest framework, RePaint and LORA, to do Chinese calligraphy inpainting and 1-shot style transfer fine-tuning.