Workshop
NeurIPS 2023 Workshop on Machine Learning for Creativity and Design
Yingtao Tian · Tom White · Lia Coleman · Hannah Johnston
Room 252 - 254
Sat 16 Dec, 6:15 a.m. PST
Machine co-creativity grows continually and exponentially with machine learning, especially with the recent surge of generative models on multiple domains. This workshop, as a continuation of a long series, explores these topics, including state-of-the-art algorithms for the creation, accessibility of these models for artists, social and cultural impact, as well as actual artistic applications. This workshop is consistent of Presentations by invited speakers, presentation of selected papers and artworks, two panels and an art showcase (collaborating with the chairs of the NeurIPS Creative AI track). The goal of this workshop is to bring together researchers and artists interested in exploring the intersection of human creativity and machine learning, and to look beyond technical issues to better understand the needs of artists and creators.
Schedule
Sat 6:15 a.m. - 6:30 a.m.
|
Welcome and Introduction
(
Opening/Closing Remarks
)
>
SlidesLive Video |
🔗 |
Sat 6:30 a.m. - 7:00 a.m.
|
Invited Talk 1 - Tianwei Yin
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Sat 7:00 a.m. - 7:25 a.m.
|
Invited Talk 2 - Misha Konstantinov & Daria Bakshandaeva
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Sat 7:30 a.m. - 7:55 a.m.
|
Invited Talk 3 - Alexander Mordvintsev & Ettore Randazzo
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Sat 7:50 a.m. - 8:30 a.m.
|
Art gallery / Coffee Break / Social
|
🔗 |
Sat 8:30 a.m. - 9:00 a.m.
|
Panel Discussion
(
Panel
)
>
SlidesLive Video |
🔗 |
Sat 9:00 a.m. - 10:00 a.m.
|
Paper & Artwork Spotlight
(
Spotlight
)
>
|
🔗 |
Sat 9:00 a.m. - 9:05 a.m.
|
Minecraft-ify: Minecraft Style Image Generation with Text-guided Image Editing for In-Game Application
(
Spotlight
)
>
link
SlidesLive Video |
Bumsoo Kim · Sanghyun Byun · Yonghoon Jung · Wonseop Shin · Sareer Ul Amin · Sanghyun Seo 🔗 |
Sat 9:05 a.m. - 9:10 a.m.
|
SyncDiffusion: Coherent Montage via Synchronized Joint Diffusions
(
Spotlight
)
>
link
SlidesLive Video |
Yuseung Lee · Kunho Kim · Hyunjin Kim · Minhyuk Sung 🔗 |
Sat 9:10 a.m. - 9:15 a.m.
|
Real-time Animation Generation and Control on Rigged Models via Large Language Models
(
Spotlight
)
>
SlidesLive Video |
Han Huang · Fernanda De La Torre · Cathy Mengying Fang · Andrzej Banburski · Judith Amores · Jaron Lanier 🔗 |
Sat 9:15 a.m. - 9:20 a.m.
|
Envisioning Distant Worlds: Training a Latent Diffusion Model with NASA's Exoplanet Data
(
Spotlight
)
>
link
SlidesLive Video |
Marissa Beaty · Terence Broad 🔗 |
Sat 9:20 a.m. - 9:25 a.m.
|
LEDITS++: Limitless Image Editing using Text-to-Image Models
(
Spotlight
)
>
SlidesLive Video |
Manuel Brack · Linoy Tsban · Katharina Kornmeier · Apolinário Passos · Felix Friedrich · Patrick Schramowski · Kristian Kersting 🔗 |
Sat 9:25 a.m. - 9:30 a.m.
|
Personalized Comic Story Generation
(
Spotlight
)
>
SlidesLive Video |
WENXUAN PENG · Peter Schaldenbrand · Jean Oh 🔗 |
Sat 9:30 a.m. - 9:35 a.m.
|
WordArt Designer API: User-Driven Artistic Typography with Large Language Models on ModelScope
(
Spotlight
)
>
link
SlidesLive Video |
13 presentersJUN-YAN HE · Zhi-Qi Cheng · Chenyang Li · Jingdong Sun · Wangmeng Xiang · Xianhui Lin · Xiaoyang Kang · Zengke Jin · Yusen Hu · Bin Luo · Yifeng Geng · Xuansong Xie · Jingren Zhou |
Sat 9:40 a.m. - 10:00 a.m.
|
Artworks spotlight (for multiple artworks)
(
Spotlight
)
>
|
Yingtao Tian · Lia Coleman 🔗 |
Sat 10:00 a.m. - 11:00 a.m.
|
Lunch
|
🔗 |
Sat 11:00 a.m. - 11:30 a.m.
|
Invited Talk 4 - Aleksander Holynski
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Sat 11:30 a.m. - 11:55 a.m.
|
Invited Talk 5 - Richard Zhang
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Sat 12:00 p.m. - 12:30 p.m.
|
Invited Talk 6 - Cristóbal Valenzuela
(
Invited Talk
)
>
SlidesLive Video |
🔗 |
Sat 12:30 p.m. - 1:00 p.m.
|
Panel/Open Discussion
(
Panel
)
>
SlidesLive Video |
🔗 |
Sat 1:00 p.m. - 1:30 p.m.
|
Art / Coffee Break / Social
|
🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Latent Painter ( Poster ) > link | Shih-Chieh Su 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Minecraft-ify: Minecraft Style Image Generation with Text-guided Image Editing for In-Game Application ( Poster ) > link | Bumsoo Kim · Sanghyun Byun · Yonghoon Jung · Wonseop Shin · Sareer Ul Amin · Sanghyun Seo 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
BioSpark: An End-to-end Generative System for Biological-Analogical Inspirations and Ideation
(
Poster
)
>
|
Hyeonsu Kang · David Chuan-En Lin · Nikolas Martelaro · Aniket Kittur · Yin-Ying Chen · Matthew Hong 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Interactive Machine Learning for Generative Models
(
Poster
)
>
|
Junichi Shimizu · Ireti Olowe · Terence Broad · Gabriel Vigliensoni · Prashanth Thattai Ravikumar · Rebecca Fiebrink 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
SyncDiffusion: Coherent Montage via Synchronized Joint Diffusions
(
Poster
)
>
|
Yuseung Lee · Kunho Kim · Hyunjin Kim · Minhyuk Sung 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Real-time Animation Generation and Control on Rigged Models via Large Language Models
(
Poster
)
>
|
Han Huang · Fernanda De La Torre · Cathy Mengying Fang · Andrzej Banburski · Judith Amores · Jaron Lanier 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
The Interface for Symbolic Music Loop Generation Conditioned on Musical Metadata
(
Poster
)
>
|
Sangjun Han · Hyeongrae Ihm · Woohyung Lim 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Weaving ML with Human Aesthetic Assessments to Augment Design Space Exploration
(
Poster
)
>
|
Youngseung Jeon · Matthew Hong · Yin-Ying Chen · Kalani Murakami · Jonathan Li · Xiang 'Anthony' Chen · Matt Klenk 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Envisioning Distant Worlds: Training a Latent Diffusion Model with NASA's Exoplanet Data ( Poster ) > link | Marissa Beaty · Terence Broad 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Zero2Story: Novel Generation Framework for Anyone ( Poster ) > link | Chansung Park · Youngbin Lee · Sangjoon Han · Jungue Lee 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
On the Distillation of Stories for Transferring Narrative Arcs in Collections of Independent Media
(
Poster
)
>
|
Dylan Ashley · Vincent Herrmann · Zachary Friggstad · Jürgen Schmidhuber 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Breaking Barriers to Creative Expression: Co-Designing and Implementing an Accessible Text-to-Image Interface
(
Poster
)
>
|
Atieh Taheri · Mohammad Izadi · Gururaj Shriram · Negar Rostamzadeh · Shaun Kane 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Multi-Subject Personalization
(
Poster
)
>
|
Arushi Jain · Shubham Paliwal · Monika Sharma · Vikram Jamwal · Lovekesh Vig 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
CalliPaint: Chinese Calligraphy Inpainting with Diffusion Model
(
Poster
)
>
|
Qisheng Liao · Zhinuo Wang · Muhammad Abdul-Mageed · Gus Xia 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
CAD-LLM: Large Language Model for CAD Generation
(
Poster
)
>
|
Sifan Wu · Amir Khasahmadi · Mor Katz · Pradeep Kumar Jayaraman · Yewen Pu · Karl Willis · Bang Liu 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Unrolling Virtual Worlds for Immersive Experiences ( Poster ) > link | Aleksei Tikhonov · Anton Repushko 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Setting Switcher: Changing genre-settings in text-based game environments populated by generative agents ( Poster ) > link | Oliver Wood · Rebecca Fiebrink 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
LEDITS++: Limitless Image Editing using Text-to-Image Models
(
Poster
)
>
|
Manuel Brack · Linoy Tsban · Katharina Kornmeier · Apolinário Passos · Felix Friedrich · Patrick Schramowski · Kristian Kersting 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
V2Meow: Meowing to the Visual Beat via Music Generation
(
Poster
)
>
|
11 presentersYue Li · Kun Su · Qingqing Huang · Dima Kuzmin · Joonseok Lee · Chris Donahue · Fei Sha · Aren Jansen · Yu Wang · Mauro Verzetti · Timo I. Denk |
Sat 1:30 p.m. - 2:30 p.m.
|
DiffuseBot: Breeding Soft Robots With Physics-Augmented Generative Diffusion Models
(
Poster
)
>
|
Tsun-Hsuan Johnson Wang · Juntian Zheng · Pingchuan Ma · Yilun Du · Byungchul Kim · Andrew Spielberg · Josh Tenenbaum · Chuang Gan · Daniela Rus 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
An Ontology of Co-Creative AI Systems
(
Poster
)
>
|
Zhiyu Lin · Mark Riedl 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
ObjectComposer: Consistent Generation of Multiple Objects Without Fine-tuning
(
Poster
)
>
|
Alec Helbling · Evan Montoya · Duen Horng Chau 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
HARP: Bringing Deep Learning to the DAW with Hosted, Asynchronous, Remote Processing
(
Poster
)
>
|
Hugo Flores Garcia · Christodoulos Benetatos · Patrick O'Reilly · Aldo Aguilar · Zhiyao Duan · Bryan Pardo 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Contextual Alchemy: A Framework for Enhanced Readability through Cross-Domain Entity Alignment ( Poster ) > link | Simra Shahid · Nikitha Srikanth · Surgan Jandial · Balaji Krishnamurthy 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
JamSketch Deep α: Towards Musical Improvisation based on Human-machine Collaboration
(
Poster
)
>
|
Tetsuro Kitahara · Akio Yonamine 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Hacking Generative Models with Differentiable Network Bending
(
Poster
)
>
|
Giacomo Aldegheri · Alina Rogalska · Ahmed Youssef · Eugenia Iofinova 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Lasagna: Layered Score Distillation for Disentangled Image Editing
(
Poster
)
>
|
Dina Bashkirova · Arijit Ray · Rupayan Mallick · Sarah Bargal · Jianming Zhang · Ranjay Krishna · Kate Saenko 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
CommonCanvas: An Open Diffusion Model Trained with Creative-Commons Images
(
Poster
)
>
|
Aaron Gokaslan · A. Feder Cooper · Jasmine Collins · Landan Seguin · Austin Jacobson · Mihir Patel · Jonathan Frankle · Cory Stephenson · Volodymyr Kuleshov 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Personalized Comic Story Generation
(
Poster
)
>
|
WENXUAN PENG · Peter Schaldenbrand · Jean Oh 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
Combating the "Sameness" in AI Art: Reflections on the Interactive AI Installation Fencing Hallucination ( Poster ) > link | Weihao Qiu · george legrady 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
SynthScribe: Deep Multimodal Tools for Synthesizer Sound Retrieval and Exploration
(
Poster
)
>
|
Stephen Brade · · Bryan Wang · Mauricio Sousa · Tovi Grossman · Gregory Lee Newsome 🔗 |
Sat 1:30 p.m. - 2:30 p.m.
|
WordArt Designer API: User-Driven Artistic Typography with Large Language Models on ModelScope
(
Poster
)
>
|
13 presentersJUN-YAN HE · Zhi-Qi Cheng · Chenyang Li · Jingdong Sun · Wangmeng Xiang · Xianhui Lin · Xiaoyang Kang · Zengke Jin · Yusen Hu · Bin Luo · Yifeng Geng · Xuansong Xie · Jingren Zhou |
Sat 2:30 p.m. - 2:40 p.m.
|
Conclusion
(
Opening/Closing Remarks
)
>
SlidesLive Video |
🔗 |