Workshop
Cooperative AI
Natasha Jaques · Edward Hughes · Jakob Foerster · Noam Brown · Kalesha Bullard · Charlotte Smith
Tue 14 Dec, 5:20 a.m. PST
The human ability to cooperate in a wide range of contexts is a key ingredient in the success of our species. Problems of cooperation—in which agents seek ways to jointly improve their welfare—are ubiquitous and important. They can be found at every scale, from the daily routines of highway driving, communicating in shared language and work collaborations, to the global challenges of climate change, pandemic preparedness and international trade. With AI agents playing an ever greater role in our lives, we must endow them with similar abilities. In particular they must understand the behaviors of others, find common ground by which to communicate with them, make credible commitments, and establish institutions which promote cooperative behavior. By construction, the goal of Cooperative AI is interdisciplinary in nature. Therefore, our workshop will bring together scholars from diverse backgrounds including reinforcement learning (and inverse RL), multi-agent systems, human-AI interaction, game theory, mechanism design, social choice, fairness, cognitive science, language learning, and interpretability. This year we will organize the workshop along two axes. First, we will discuss how to incentivize cooperation in AI systems, developing algorithms that can act effectively in general-sum settings, and which encourage others to cooperate. The second focus is on how to implement effective coordination, given that cooperation is already incentivized. For example, we may examine zero-shot coordination, in which AI agents need to coordinate with novel partners at test time. This setting is highly relevant to human-AI coordination, and provides a stepping stone for the community towards full Cooperative AI.
Schedule
Tue 5:20 a.m. - 5:30 a.m.
|
Welcome and Opening Remarks
(
Welcome and Opening Remarks
)
>
SlidesLive Video |
Edward Hughes · Natasha Jaques 🔗 |
Tue 5:30 a.m. - 6:00 a.m.
|
Invited Talk: Bo An (Nanyang Technological University) on Learning to Coordinate in Complex Environments
(
Invited Talk
)
>
SlidesLive Video |
Bo An 🔗 |
Tue 6:00 a.m. - 6:30 a.m.
|
Invited Talk: Michael Muthukrishna (London School of Economics) on Cultural Evolution and Human Cooperation
(
Invited Talk
)
>
SlidesLive Video |
Michael Muthukrishna 🔗 |
Tue 6:30 a.m. - 7:00 a.m.
|
Invited Talk: Pablo Castro (Google Brain) on Estimating Policy Functions in Payment Systems using Reinforcement Learning
(
Invited Talk
)
>
SlidesLive Video |
Pablo Samuel Castro 🔗 |
Tue 7:00 a.m. - 7:15 a.m.
|
(Live) Q&A with Invited Speaker (Bo An)
(
Live Q&A
)
>
SlidesLive Video |
🔗 |
Tue 7:15 a.m. - 7:30 a.m.
|
(Live) Q&A with Invited Speaker (Michael Muthukrishna)
(
Live Q&A
)
>
|
🔗 |
Tue 7:30 a.m. - 7:45 a.m.
|
(Live) Q&A with Invited Speaker (Pablo Castro)
(
Live Q&A
)
>
|
🔗 |
Tue 7:45 a.m. - 8:15 a.m.
|
Invited Talk: Ariel Procaccia (Harvard University) on Democracy and the Pursuit of Randomness
(
Invited Talk
)
>
SlidesLive Video |
Ariel Procaccia 🔗 |
Tue 8:15 a.m. - 8:45 a.m.
|
Invited Talk: Dorsa Sadigh (Stanford University) on The Role of Conventions in Adaptive Human-AI Interaction
(
Invited Talk
)
>
SlidesLive Video |
Dorsa Sadigh 🔗 |
Tue 8:45 a.m. - 9:15 a.m.
|
(Live) Invited Talk: Nika Haghtalab (UC Berkeley) on Collaborative Machine Learning: Training and Incentives
(
(Live) Invited Talk
)
>
SlidesLive Video |
Nika Haghtalab 🔗 |
Tue 9:15 a.m. - 9:30 a.m.
|
(Live) Q&A with Invited Speaker (Ariel Procaccia)
(
Live Q&A
)
>
|
🔗 |
Tue 9:30 a.m. - 9:45 a.m.
|
(Live) Q&A with Invited Speaker (Dorsa Sadigh)
(
Live Q&A
)
>
|
🔗 |
Tue 9:45 a.m. - 10:00 a.m.
|
(Live) Q&A with Invited Speaker (Nika Haghtalab)
(
Live Q&A
)
>
|
🔗 |
Tue 10:00 a.m. - 11:00 a.m.
|
Workshop Poster Session 1 (hosted in GatherTown) ( Poster Sessions (GatherTown) ) > link | 🔗 |
Tue 11:00 a.m. - 12:00 p.m.
|
Workshop Poster Session 2 (hosted in GatherTown) ( Poster Sessions (GatherTown) ) > link | 🔗 |
Tue 12:00 p.m. - 1:00 p.m.
|
(Live) Panel Discussion: Cooperative AI
(
Panel Discussion
)
>
SlidesLive Video |
Kalesha Bullard · Allan Dafoe · Fei Fang · Chris Amato · Elizabeth M. Adams 🔗 |
Tue 1:00 p.m. - 1:15 p.m.
|
Spotlight Talk: Interactive Inverse Reinforcement Learning for Cooperative Games
(
Spotlight Talk
)
>
link
SlidesLive Video |
Thomas Kleine Büning · Anne-Marie George · Christos Dimitrakakis 🔗 |
Tue 1:15 p.m. - 1:30 p.m.
|
Spotlight Talk: Learning to solve complex tasks by growing knowledge culturally across generations
(
Spotlight Talk
)
>
link
SlidesLive Video |
Noah Goodman · Josh Tenenbaum · Michael Tessler · Jason Madeano 🔗 |
Tue 1:30 p.m. - 1:45 p.m.
|
Spotlight Talk: On the Approximation of Cooperative Heterogeneous Multi-Agent Reinforcement Learning (MARL) using Mean Field Control (MFC)
(
Spotlight Talk
)
>
link
SlidesLive Video |
Mridul Agarwal · Vaneet Aggarwal · Washim Mondal · Satish Ukkusuri 🔗 |
Tue 1:45 p.m. - 2:00 p.m.
|
Spotlight Talk: Public Information Representation for Adversarial Team Games
(
Spotlight Talk
)
>
link
SlidesLive Video |
Luca Carminati · Federico Cacciamani · Marco Ciccone · Nicola Gatti 🔗 |
Tue 2:00 p.m. - 2:15 p.m.
|
Closing Remarks
(
Closing Remarks
)
>
SlidesLive Video |
Gillian Hadfield 🔗 |