Skip to yearly menu bar Skip to main content


Spotlight
in
Workshop: NeurIPS 2023 Workshop on Machine Learning for Creativity and Design

Real-time Animation Generation and Control on Rigged Models via Large Language Models

Han Huang · Fernanda De La Torre · Cathy Mengying Fang · Andrzej Banburski · Judith Amores · Jaron Lanier


Abstract:

We introduce a novel method for real-time animation control and generation onrigged models using natural language input. First, we embed a large languagemodel (LLM) in Unity to output structured texts that can be parsed into diverseand realistic animations. Second, we illustrate LLM’s potential to enable flexiblestate transition between existing animations. We showcase the robustness of ourapproach through qualitative results on various rigged models and motions.

Chat is not available.