Workshop
LaReL: Language and Reinforcement Learning
Laetitia Teodorescu · Laura Ruis · Tristan Karch · Cédric Colas · Paul Barde · Jelena Luketina · Athul Jacob · Pratyusha Sharma · Edward Grefenstette · Jacob Andreas · Marc-Alexandre Côté
Room 391
Fri 2 Dec, 6:30 a.m. PST
Language is one of the most impressive human accomplishments and is believed to be the core to our ability to learn, teach, reason and interact with others. Learning many complex tasks or skills would be significantly more challenging without relying on language to communicate, and language is believed to have a structuring impact on human thought. Written language has also given humans the ability to store information and insights about the world and pass it across generations and continents. Yet, the ability of current state-of-the art reinforcement learning agents to understand natural language is limited.
Practically speaking, the ability to integrate and learn from language, in addition to rewards and demonstrations, has the potential to improve the generalization, scope and sample efficiency of agents. For example, agents that are capable of transferring domain knowledge from textual corpora might be able to much more efficiently explore in a given environment or to perform zero or few shot learning in novel environments. Furthermore, many real-world tasks, including personal assistants and general household robots, require agents to process language by design, whether to enable interaction with humans, or simply use existing interfaces.
To support this field of research, we are interested in fostering the discussion around:
- Methods that can effectively link language to actions and observations in the environment;
- Research into language roles beyond encoding goal states, such as structuring hierarchical policies,
- Communicating domain knowledge or reward shaping;
- Methods that can help identify and incorporate outside textual information about the task, or general-purpose semantics learned from outside corpora;
- Novel environments and benchmarks enabling such research and approaching complexity of real-world problem settings.
The aim of the workshop on Language in Reinforcement Learning (LaReL) is to steer discussion and research of these problems by bringing together researchers from several communities, including reinforcement learning, robotics, natural language processing, computer vision and cognitive psychology.
Schedule
Fri 6:30 a.m. - 6:40 a.m.
|
Opening remarks
(
Opening remarks
)
>
|
🔗 |
Fri 6:40 a.m. - 7:20 a.m.
|
Invited Talk: Dorsa Sadigh
(
Invited Talk
)
>
SlidesLive Video |
Dorsa Sadigh · Siddharth Karamcheti 🔗 |
Fri 7:20 a.m. - 8:00 a.m.
|
Invited Talk: Chen Yan
(
Invited Talk
)
>
SlidesLive Video |
Chen Yan 🔗 |
Fri 8:00 a.m. - 8:15 a.m.
|
Morning Break + Posters
|
🔗 |
Fri 8:15 a.m. - 8:45 a.m.
|
Morning Poster Session
(
Poster Session
)
>
|
🔗 |
Fri 8:45 a.m. - 9:00 a.m.
|
Contributed Talk 1: ScriptWorld: A Scripts-based RL Environment
(
Contributed Talk
)
>
SlidesLive Video |
🔗 |
Fri 9:00 a.m. - 9:15 a.m.
|
Contributed Talk 2: How to talk so AI will learn: instructions, descriptions, and pragmatics
(
Contributed Talk
)
>
SlidesLive Video |
🔗 |
Fri 9:15 a.m. - 9:55 a.m.
|
Invited Talk: Noah Goodman
(
Invited Talk
)
>
SlidesLive Video |
Noah Goodman 🔗 |
Fri 9:55 a.m. - 10:00 a.m.
|
Best paper announcement
(
Best paper annoucement
)
>
SlidesLive Video |
🔗 |
Fri 10:00 a.m. - 11:05 a.m.
|
Lunch
|
🔗 |
Fri 11:05 a.m. - 11:45 a.m.
|
Invited Talk: Stephanie Tellex
(
Invited Talk
)
>
SlidesLive Video |
Stefanie Tellex 🔗 |
Fri 11:45 a.m. - 12:00 p.m.
|
Contributed talk 3: Collaborating with language models for embodied reasoning
(
Contributed talk
)
>
SlidesLive Video |
🔗 |
Fri 12:00 p.m. - 12:50 p.m.
|
Late-breaking results
(
Contributed talk
)
>
|
🔗 |
Fri 12:00 p.m. - 12:25 p.m.
|
Late-breaking results 1: Cicero: Combining Language Models and Strategic Reasoning in the Game of Diplomacy
(
Late-breaking results
)
>
SlidesLive Video |
🔗 |
Fri 12:25 p.m. - 12:50 p.m.
|
Late Breaking Result 2: VIMA: General Robot Manipulation with Multimodal Prompts
(
Late-breaking results
)
>
SlidesLive Video |
🔗 |
Fri 12:50 p.m. - 1:20 p.m.
|
Afternoon Poster Session
(
Poster Session
)
>
|
🔗 |
Fri 1:20 p.m. - 1:35 p.m.
|
Afternoon Break + Posters
|
🔗 |
Fri 1:35 p.m. - 2:15 p.m.
|
Invited Talk: Igor Mordatch
(
Invited Talk
)
>
SlidesLive Video |
Igor Mordatch 🔗 |
Fri 2:15 p.m. - 2:55 p.m.
|
Invited Talk: James McClelland
(
Invited Talk
)
>
SlidesLive Video |
James McClelland 🔗 |
Fri 2:55 p.m. - 3:00 p.m.
|
Closing Remarks
(
Closing Remarks
)
>
|
🔗 |
-
|
Toward Semantic History Compression for Reinforcement Learning ( Poster ) > link | Fabian Paischer · Thomas Adler · Andreas Radler · Markus Hofmarcher · Sepp Hochreiter 🔗 |
-
|
Towards an Enhanced, Faithful, and Adaptable Web Interaction Environment ( Poster ) > link | John Yang · Howard Chen · Karthik Narasimhan 🔗 |
-
|
Understanding Redundancy in Discrete Multi-Agent Communication ( Poster ) > link | Jonathan Thomas · Raul Santos-Rodriguez · Robert Piechocki 🔗 |
-
|
Language-Conditioned Reinforcement Learning to Solve Misunderstandings with Action Corrections ( Poster ) > link | Frank Röder · Manfred Eppe 🔗 |
-
|
Fantastic Rewards and How to Tame Them: A Case Study on Reward Learning for Task-Oriented Dialogue Systems ( Poster ) > link | Yihao Feng · Shentao Yang · Shujian Zhang · Jianguo Zhang · Caiming Xiong · Mingyuan Zhou · Huan Wang 🔗 |
-
|
ScriptWorld: A Scripts-based RL Environment ( Poster ) > link | Abhinav Joshi · areeb ahmad · Umang Pandey · Ashutosh Modi 🔗 |
-
|
$\ell$Gym: Natural Language Visual Reasoning with Reinforcement Learning ( Poster ) > link | Anne Wu · Kianté Brantley · Noriyuki Kojima · Yoav Artzi 🔗 |
-
|
Hierarchical Agents by Combining Language Generation and Semantic Goal Directed RL ( Poster ) > link | Bharat Prakash · Nicholas Waytowich · Tim Oates · Tinoosh Mohsenin 🔗 |
-
|
ProgPrompt: Generating Situated Robot Task Plans using Large Language Models ( Poster ) > link | Ishika Singh · Valts Blukis · Arsalan Mousavian · Ankit Goyal · Danfei Xu · Jonathan Tremblay · Dieter Fox · Jesse Thomason · Animesh Garg 🔗 |
-
|
Tackling AlfWorld with Action Attention and Common Sense from Language Models ( Poster ) > link | Yue Wu · So Yeon Min · Yonatan Bisk · Russ Salakhutdinov · Shrimai Prabhumoye 🔗 |
-
|
Collaborating with language models for embodied reasoning ( Poster ) > link | Ishita Dasgupta · Christine Kaeser-Chen · Kenneth Marino · Arun Ahuja · Sheila Babayan · Felix Hill · Rob Fergus 🔗 |
-
|
How to talk so AI will learn: instructions, descriptions, and pragmatics ( Poster ) > link | Theodore Sumers · Robert Hawkins · Mark Ho · Tom Griffiths · Dylan Hadfield-Menell 🔗 |
-
|
SCERL: A Benchmark for intersecting language and safe reinforcement learning ( Poster ) > link | Lan Hoang · Shivam Ratnakar · Nicolas Galichet · Akifumi Wachi · Keerthiram Murugesan · Songtao Lu · Mattia Atzeni · Michael Katz · Subhajit Chaudhury 🔗 |
-
|
LAD: Language Augmented Diffusion for Reinforcement Learning ( Poster ) > link | Edwin Zhang · Yujie Lu · William Yang Wang · Amy Zhang 🔗 |
-
|
Meta-learning from demonstrations improves compositional generalization ( Poster ) > link | Sam Spilsbury · Alexander Ilin 🔗 |
-
|
Language-guided Task Adaptation for Imitation Learning ( Poster ) > link | Prasoon Goyal · Raymond Mooney · Scott Niekum 🔗 |
-
|
Overcoming Referential Ambiguity in language-guided goal-conditioned Reinforcement Learning ( Poster ) > link | Hugo Caselles-Dupré · Olivier Sigaud · Mohamed CHETOUANI 🔗 |
-
|
On the Pitfalls of Visual Learning in Referential Games ( Poster ) > link | Shresth Verma 🔗 |