Workshop
Language Gamification
Shangmin Guo · Yi Ren · Elle Michelle Yang · Mathieu Rita · Florian Strub
West Meeting Room 220-222
Sat 14 Dec, 8:20 a.m. PST
Ludwig Wittgenstein, in his seminal work "Philosophical Investigations", introduced the concept of "language games." This framework views language as an adaptive system where words acquire meaning through use, emphasizing its social and interactive nature. Research in cognitive science reinforces this notion, highlighting that genuine language acquisition thrives on dynamic and context-driven interactions. Language emergence simulations further demonstrate the critical role of language transmission within a population of agents in shaping modern languages. Game theory experiments showcase the superiority of interactive self-play loops compared to traditional imitation-based models. But... meanwhile... the core training paradigm in language processing remains purely based on supervised and preference losses, and it has barely changed over the past years. Besides, some limitations in LLMs, e.g., restricted planning abilities and insufficient personalization, suggest a potential deficiency in their training: the lack of interaction. Inspired by these observations, our workshop explores the concept of Language Gamification to enable interactive LLM finetuning at scale.This training paradigm encompasses interactive training or evaluation loops that enable LLMs to bootstrap and ground their language through multi-agent interactions. Following this definition, the workshop invites an exploration of Language Gamification through a diverse set of methodological perspectives and research backgrounds, offering a series of presentations and unique panel discussions
Schedule
Sat 8:20 a.m. - 8:30 a.m.
|
Opening Remarks
(
Intro
)
>
SlidesLive Video |
Florian Strub · Elle Michelle Yang 🔗 |
Sat 8:30 a.m. - 9:10 a.m.
|
Nouha Dziri: In-Context Learning in LLMs: Potential and Limits
(
Invited Talk
)
>
SlidesLive Video |
Nouha Dziri 🔗 |
Sat 9:10 a.m. - 9:50 a.m.
|
Marc Lanctot: Mastering Board Games by External and Internal Planning with Language Models
(
Invited Talk
)
>
link
SlidesLive Video |
Marc Lanctot 🔗 |
Sat 10:00 a.m. - 10:05 a.m.
|
Efficacy of Language Model Self-Play in Non-Zero-Sum Games
(
Oral
)
>
link
SlidesLive Video |
Austen Liao · Nicholas Tomlin · Dan Klein 🔗 |
Sat 10:05 a.m. - 10:10 a.m.
|
Estimating Effects of Tokens in Preference Learning
(
Oral
)
>
link
SlidesLive Video |
Hsiao-Ru Pan · Maximilian Mordig · Bernhard Schölkopf 🔗 |
Sat 10:10 a.m. - 10:15 a.m.
|
Evolving Alignment via Asymmetric Self-Play
(
Oral
)
>
link
SlidesLive Video |
Ziyu Ye · Rishabh Agarwal · Tianqi Liu · Rishabh Joshi · Sarmishta Velury · Quoc V Le · Qijun Tan · Yuan Liu 🔗 |
Sat 10:15 a.m. - 10:20 a.m.
|
Multi-Step Preference Optimization via Two-Player Markov Games
(
Oral
)
>
link
SlidesLive Video |
Yongtao Wu · Luca Viano · Yihang Chen · Zhenyu Zhu · Quanquan Gu · Volkan Cevher 🔗 |
Sat 10:20 a.m. - 10:25 a.m.
|
Automated Design of Agentic Systems
(
Oral
)
>
link
SlidesLive Video |
Shengran Hu · Cong Lu · Jeff Clune 🔗 |
Sat 10:25 a.m. - 10:30 a.m.
|
Dynamic Planning with a LLM
(
Oral
)
>
link
SlidesLive Video |
Dagan · Frank Keller · Alex Lascarides 🔗 |
Sat 10:30 a.m. - 11:00 a.m.
|
Coffee Break
(
misc
)
>
|
🔗 |
Sat 10:30 a.m. - 11:00 a.m.
|
Poster Session 1
(
Poster Session
)
>
|
🔗 |
Sat 11:00 a.m. - 11:40 a.m.
|
Aaron Courville
(
Invited Talk
)
>
SlidesLive Video |
Aaron Courville 🔗 |
Sat 11:40 a.m. - 12:20 p.m.
|
Tom Schaul: Boundless Socratic Learning with Language Games
(
Invited Talk
)
>
link
SlidesLive Video |
Tom Schaul 🔗 |
Sat 12:20 p.m. - 2:00 p.m.
|
Lunch
|
🔗 |
Sat 12:20 p.m. - 2:00 p.m.
|
Poster Session 2
(
Poster Session
)
>
|
🔗 |
Sat 2:00 p.m. - 2:40 p.m.
|
Alane Suhr: The Cooperative Testing Initiative
(
Invited Talk
)
>
SlidesLive Video |
Alane Suhr 🔗 |
Sat 2:40 p.m. - 3:20 p.m.
|
Tom Griffiths: Understanding the behavior of large language models using tasks from cognitive science
(
Invited Talk
)
>
SlidesLive Video |
Tom Griffiths 🔗 |
Sat 3:20 p.m. - 3:40 p.m.
|
Coffee Break
|
🔗 |
Sat 3:20 p.m. - 3:40 p.m.
|
Poster Session 3
(
Poster Session
)
>
|
🔗 |
Sat 3:40 p.m. - 4:20 p.m.
|
Sam Devlin: WHAM! World and Human Action Modelling in a Modern Xbox Game
(
Invited Talk
)
>
SlidesLive Video |
Sam Devlin 🔗 |
Sat 4:20 p.m. - 5:20 p.m.
|
Panel Discussion
(
Panel
)
>
SlidesLive Video |
Aaron Courville · Alane Suhr · Tom Schaul · Marc Lanctot · Tom Griffiths · Florian Strub · Sam Devlin 🔗 |
Sat 5:20 p.m. - 5:30 p.m.
|
Closing Remarks
(
misc
)
>
|
Florian Strub · Elle Michelle Yang 🔗 |
-
|
What Makes Your Model a Low-empathy or Warmth Person: Exploring the Oringins of Personality in LLMs ( Poster ) > link | Shu Yang · Shenzhe Zhu · Liang Liu · Mengdi Li · Lijie Hu · Di Wang 🔗 |
-
|
Communication via Shared Memory Improves Multi-agent Pathfinding ( Poster ) > link | Alsu Sagirova · Yury Kuratov · Mikhail Burtsev 🔗 |
-
|
LlaMa meets Cheburashka: impact of cultural background for LLM quiz reasoning ( Poster ) > link | Mikhail Lifar · Bogdan Protsenko · Daniil Kupriianenko · Nazar Chubkov · Kulaev Dmitrievich · Alexander Guda · Irina Piontkovskaya 🔗 |
-
|
Rethinking Mixture-of-Agents: Is Mixing Different Large Language Models Beneficial? ( Poster ) > link | Wenzhe Li · Yong Lin · Mengzhou Xia · Chi Jin 🔗 |
-
|
GameBench: Evaluating Strategic Reasoning Abilities of LLM Agents ( Poster ) > link | Anthony Costarelli · Mat Allen · Roman Hauksson · Grace Sodunke · Suhas Hariharan · Carlson Cheng · Wenjie Li · Joshua Clymer · Arjun Yadav 🔗 |
-
|
OnThePlanning Abilities of OpenAI’s o1 Models: Feasibility, Optimality, and Generalizability ( Poster ) > link | Kevin Wang · Junbo Li · Neel Bhatt · Yihan Xi · Qiang Liu · Ufuk Topcu · Zhangyang "Atlas" Wang 🔗 |
-
|
Beyond Benchmarking: Automated Capability Discovery via Model Self-Exploration ( Poster ) > link | Cong Lu · Shengran Hu · Jeff Clune 🔗 |
-
|
Economics Arena for Large Language Models ( Poster ) > link | Shangmin Guo · Haochuan Wang · Haoran Bu · Yi Ren · Dianbo Sui · Yu-Ming Shang · Siting Estee Lu 🔗 |
-
|
Efficacy of Language Model Self-Play in Non-Zero-Sum Games ( Poster ) > link | Austen Liao · Nicholas Tomlin · Dan Klein 🔗 |
-
|
PokeChamp: an Expert-level Minimax Language Agent for Competitive Pokemon ( Poster ) > link | Seth Karten · Andy Nguyen · Chi Jin 🔗 |
-
|
Mimicking Human Emotions: Persona-Driven Behavior of LLMs in the ‘Buy and Sell’ Negotiation Game ( Poster ) > link | mingyu jeon · Jae Young Suh 🔗 |
-
|
PIANIST: Learning Partially Observable World Models with LLMs for Multi-Agent Decision Making ( Poster ) > link | Jonathan Li · Sixue Xing · Yuanzhe Liu · Weiqin Chen · Min Cai · Xiusi Chen · Guanzhi Wang · Wei Cheng · Yisong Yue · Ziniu Hu 🔗 |
-
|
Improving Branching Language via Self-Reflection ( Poster ) > link | Kolby T Nottingham · Ruo-Ping Dong · Ben Kasper · Wesley Kerr 🔗 |
-
|
AidanBench: Evaluating Novel Idea Generation on Open-Ended Questions ( Poster ) > link | Aidan McLaughlin · Anuja Uppuluri · James Campbell · Richard Ren 🔗 |
-
|
Dynamic Planning with a LLM ( Poster ) > link | Dagan · Frank Keller · Alex Lascarides 🔗 |
-
|
Stutter Makes Smarter: Learning Self-Improvement for Large Language Models ( Poster ) > link | Pei-Chen Ho · Meng-Hsi Chen · Alberto Bernacchia · Philipp Ennen · Yen-Chen Wu · Da-shan Shiu 🔗 |
-
|
ACE: Abstractions for Communicating Efficiently ( Poster ) > link | Jonathan Thomas · Andrea Silvi · Devdatt Dubhashi · Vikas Garg · Moa Johansson 🔗 |
-
|
Creativity Has Entered the Chat, With a Stranger: Novelty is a Nash Equilibrium ( Poster ) > link | Kotaro Sakamoto · Shiro Takagi · Shuhei Ogawa · Yutaka Matsuo 🔗 |
-
|
Positive Experience Reflection for Agents in Interactive Text Environments ( Poster ) > link | Philip Lippmann · Matthijs Spaan · Jie Yang 🔗 |
-
|
Automated Design of Agentic Systems ( Poster ) > link | Shengran Hu · Cong Lu · Jeff Clune 🔗 |
-
|
Strategic Collusion of LLM Agents: Market Division in Multi-Commodity Competitions ( Poster ) > link | Ryan Lin · Siddhartha Ojha · Kevin Cai · Maxwell Chen 🔗 |
-
|
Embodied LLM Agents Learn to Cooperate in Organized Teams ( Poster ) > link | Xudong Guo · Kaixuan Huang · Jiale Liu · Wenhui Fan · Natalia Vélez · Qingyun Wu · Huazheng Wang · Tom Griffiths · Mengdi Wang 🔗 |
-
|
Embodied-RAG: General Non-parametric Embodied Memory for Retrieval and Generation ( Poster ) > link | Quanting Xie · So Yeon Min · Tianyi Zhang · Kedi Xu · Aarav Bajaj · Ruslan Salakhutdinov · Matthew Johnson-Roberson · Yonatan Bisk 🔗 |
-
|
S2L-RM: Short-to-Long Reward Modeling ( Poster ) > link | Changyu CHEN · Zichen Liu · Haonan Wang · Chao Du · Tianyu Pang · Qian Liu · Arunesh Sinha · Pradeep Varakantham · Min Lin 🔗 |
-
|
Multi-Step Preference Optimization via Two-Player Markov Games ( Poster ) > link | Yongtao Wu · Luca Viano · Yihang Chen · Zhenyu Zhu · Quanquan Gu · Volkan Cevher 🔗 |
-
|
TICKing All the Boxes: Generated Checklists Improve LLM Evaluation and Generation ( Poster ) > link | Jonathan Cook · Tim Rocktäschel · Jakob Foerster · Dennis Aumiller · Alex Wang 🔗 |
-
|
Sharing Minds during MARL Training for Enhanced Cooperative LLM Agents ( Poster ) > link | Jiaxuan Gao · Yule Wen · Chao Yu · YI WU 🔗 |
-
|
Evaluating the role of ‘Constitutions’ for learning from AI feedback ( Poster ) > link | Saskia Redgate · Andrew M. Bean · Adam Mahdi 🔗 |
-
|
Evolving Alignment via Creator-Solver Games ( Poster ) > link | Ziyu Ye · Rishabh Agarwal · Tianqi Liu · Rishabh Joshi · Sarmishta Velury · Qijun Tan · Yuan Liu 🔗 |
-
|
Strategic Interactions between Large Language Models-based Agents in Beauty Contests ( Poster ) > link | Siting Estee Lu 🔗 |
-
|
Games as Ontology Engines: AI and LLMs Invoke Spatiotemporal and Metaphysical Realities in Virtual Worlds ( Poster ) > link | Jasmine Roberts · Andrzej Banburski 🔗 |
-
|
Estimating Effects of Tokens in Preference Learning ( Poster ) > link | Hsiao-Ru Pan · Maximilian Mordig · Bernhard Schölkopf 🔗 |
-
|
On Reward Functions For Self-Improving General-Purpose Reasoning ( Poster ) > link | Thomas Foster · Eltayeb Ahmed · Jonathan Cook · Shalev Lifshitz · Tim Rocktäschel · Jakob Foerster 🔗 |
-
|
CoPS: Empowering LLM Agents with Provable Cross-Task Experience Sharing ( Poster ) > link | Chen Yang · Chenyang Zhao · Quanquan Gu · Dongruo Zhou 🔗 |
-
|
Reinterpreting Signaling and Referential Games as Generative Models ( Poster ) > link | Ryo Ueda 🔗 |
-
|
Boundless Socratic Learning with Language Games ( Poster ) > link | Tom Schaul 🔗 |
-
|
Sample Efficient Alignment for LLMs ( Poster ) > link | Zichen Liu · Changyu CHEN · Chao Du · Wee Sun Lee · Min Lin 🔗 |
-
|
Situated Instruction Following Under Ambiguous Human Intent ( Poster ) > link | So Yeon Min · Xavier Puig · Devendra Singh Chaplot · Tsung-Yen Yang · Akshara Rai · Priyam Parashar · Ruslan Salakhutdinov · Yonatan Bisk · Roozbeh Mottaghi 🔗 |
-
|
SAPIENT: Mastering Multi-turn Conversational Recommendation with Strategic Planning and Monte Carlo Tree Search ( Poster ) > link | Hanwen Du · Bo Peng · Xia Ning 🔗 |