Workshop
Safe and Robust Control of Uncertain Systems
Ashwin Balakrishna · Brijen Thananjeyan · Daniel Brown · Marek Petrik · Melanie Zeilinger · Sylvia Herbert
Mon 13 Dec, 8 a.m. PST
Control and decision systems are becoming a ubiquitous part of our daily lives, ranging from serving advertisements or recommendations on the internet to controlling autonomous physical systems such as industrial equipment or robots. While these systems have shown the potential for significantly improving quality of life and industrial efficiency, the impact of the decisions made by these systems can also cause significant damages. For example, an online retailer recommending dangerous products to children, a social media platform serving content which polarizes society, or a household robot/autonomous car which collides with surrounding humans can all cause significant direct harm to society. These undesirable behaviors not only can be dangerous, but also lead to significant inefficiencies when deploying learning-based agents in the real world. This motivates developing algorithms for learning-based control which can reason about uncertainty and constraints in the environment to explicitly avoid undesirable behaviors. We believe hosting a discussion on safety in learning-based control at NeurIPS 2021 would have far-reaching societal impacts by connecting researchers from a variety of disciplines including machine learning, control theory, AI safety, operations research, robotics, and formal methods.
Schedule
Mon 8:00 a.m. - 8:15 a.m.
|
Introduction
(
Short Talk
)
>
SlidesLive Video |
Daniel Brown 🔗 |
Mon 8:15 a.m. - 8:40 a.m.
|
Ye Pu
(
Invited Talk
)
>
SlidesLive Video |
Ye Pu 🔗 |
Mon 8:40 a.m. - 8:45 a.m.
|
Ye Pu
(
Talk Q/A Session
)
>
|
Ye Pu 🔗 |
Mon 8:45 a.m. - 9:10 a.m.
|
Aleksandra Faust
(
Invited Talk
)
>
SlidesLive Video |
Aleksandra Faust 🔗 |
Mon 9:10 a.m. - 9:15 a.m.
|
Aleksandra Faust
(
Talk Q/A Session
)
>
|
Aleksandra Faust 🔗 |
Mon 9:15 a.m. - 9:40 a.m.
|
Shie Mannor
(
Invited Talk
)
>
SlidesLive Video |
Shie Mannor 🔗 |
Mon 9:40 a.m. - 9:45 a.m.
|
Shie Mannor
(
Talk Q/A Session
)
>
|
Shie Mannor 🔗 |
Mon 9:45 a.m. - 9:50 a.m.
|
Learning Contraction Policies from Offline Data
(
Oral
)
>
SlidesLive Video |
Navid Rezazadeh · Negar Mehr 🔗 |
Mon 9:50 a.m. - 9:55 a.m.
|
Safety-guaranteed trajectory planning and control based on GP estimation for unmanned surface vessels
(
Oral
)
>
SlidesLive Video |
Shuhao Zhang · Seth Siriya 🔗 |
Mon 9:55 a.m. - 10:00 a.m.
|
Efficiently Improving the Robustness of RL Agents against Strongest Adversaries
(
Oral
)
>
SlidesLive Video |
Yongyuan Liang · Yanchao Sun · Ruijie Zheng · Furong Huang 🔗 |
Mon 10:00 a.m. - 11:00 a.m.
|
Safe RL Panel Discussion
(
Discussion Panel
)
>
|
Animesh Garg · Marek Petrik · Shie Mannor · Claire Tomlin · Ugo Rosolia · Dylan Hadfield-Menell 🔗 |
Mon 11:00 a.m. - 12:00 p.m.
|
Poster Session I ( Poster Session I ) > link | 🔗 |
Mon 12:00 p.m. - 12:25 p.m.
|
Rohin Shah
(
Invited Talk
)
>
SlidesLive Video |
Rohin Shah 🔗 |
Mon 12:25 p.m. - 12:30 p.m.
|
Rohin Shah
(
Talk Q/A Session
)
>
|
Rohin Shah 🔗 |
Mon 12:30 p.m. - 12:55 p.m.
|
Angelique Taylor
(
Invited Talk
)
>
SlidesLive Video |
Angelique Taylor 🔗 |
Mon 12:55 p.m. - 1:00 p.m.
|
Angelique Taylor
(
Talk Q/A Session
)
>
|
Angelique Taylor 🔗 |
Mon 1:00 p.m. - 1:25 p.m.
|
Ugo Rosolia
(
Invited Talk
)
>
SlidesLive Video |
Ugo Rosolia 🔗 |
Mon 1:25 p.m. - 1:30 p.m.
|
Ugo Rosolia
(
Talk Q/A Session
)
>
|
Ugo Rosolia 🔗 |
Mon 1:30 p.m. - 2:30 p.m.
|
Safe RL Debate
(
Debate
)
>
|
Sylvia Herbert · Animesh Garg · Emma Brunskill · Aleksandra Faust · Dylan Hadfield-Menell 🔗 |
Mon 2:30 p.m. - 2:35 p.m.
|
Reinforcement Learning with Feedback from Multiple Humans with Diverse Skills
(
Oral
)
>
SlidesLive Video |
Taku Yamagata · Ryan McConville · Raul Santos-Rodriguez 🔗 |
Mon 2:35 p.m. - 2:40 p.m.
|
What Would the Expert do()?: Causal Imitation Learning
(
Oral
)
>
SlidesLive Video |
Gokul Swamy · Sanjiban Choudhury · James Bagnell · Steven Wu 🔗 |
Mon 2:40 p.m. - 2:45 p.m.
|
Who Is the Strongest Enemy? Towards Optimal and Efficient Evasion Attacks in Deep RL
(
Oral
)
>
SlidesLive Video |
Yanchao Sun · Ruijie Zheng · Yongyuan Liang · Furong Huang 🔗 |
Mon 2:45 p.m. - 3:45 p.m.
|
Poster Session II ( Poster Session II ) > link | 🔗 |
Mon 3:45 p.m. - 4:00 p.m.
|
Closing Remarks
(
Short Talk
)
>
SlidesLive Video |
Brijen Thananjeyan 🔗 |
-
|
Learning Behavioral Soft Constraints from Demonstrations
(
Poster
)
>
|
Arie Glazier · Andrea Loreggia · Nicholas Mattei · Taher Rahgooy · Francesca Rossi · Brent Venable 🔗 |
-
|
Conservative and Adaptive Penalty for Model-Based Safe Reinforcement Learning
(
Poster
)
>
|
Jason Yecheng Ma · Andrew Shen · Osbert Bastani · Dinesh Jayaraman 🔗 |
-
|
Execute Order 66: Targeted Data Poisoning for Reinforcement Learning via Minuscule Perturbations
(
Poster
)
>
|
Harrison Foley · Liam Fowl · Tom Goldstein · Gavin Taylor 🔗 |
-
|
Learning Robustly Safe Output Feedback Controllers from Noisy Data with Performance Guarantees
(
Poster
)
>
|
Luca Furieri 🔗 |
-
|
State Augmented Constrained Reinforcement Learning: Overcoming the Limitations of Learning with Rewards
(
Poster
)
>
|
Miguel Calvo-Fullana · Santiago Paternain · Alejandro Ribeiro 🔗 |
-
|
Safe Learning of Linear Time-Invariant Systems
(
Poster
)
>
|
Farhad Farokhi · Alex Leong · Mohammad Zamani · Iman Shames 🔗 |
-
|
MESA: Offline Meta-RL for Safe Adaptation and Fault Tolerance
(
Poster
)
>
|
Michael Luo · Ashwin Balakrishna · Brijen Thananjeyan · Suraj Nair · Julian Ibarz · Jie Tan · Chelsea Finn · Ion Stoica · Ken Goldberg 🔗 |
-
|
Risk Sensitive Model-Based Reinforcement Learning using Uncertainty Guided Planning
(
Poster
)
>
|
Stefan Radic Webster 🔗 |
-
|
Adversarial Training Blocks Generalization in Neural Policies
(
Poster
)
>
|
Ezgi Korkmaz 🔗 |
-
|
Robust Physical Parameter Identification through Global Linearisation of System Dynamics
(
Poster
)
>
|
Yordan Hristov · Subramanian Ramamoorthy 🔗 |
-
|
Specification-Guided Learning of Nash Equilibria with High Social Welfare
(
Poster
)
>
|
Kishor Jothimurugan · Suguman Bansal · Osbert Bastani · Rajeev Alur 🔗 |
-
|
Safe Reinforcement Learning for Grid Voltage Control
(
Poster
)
>
|
Thanh Long Vu · Sayak Mukherjee · Renke Huang · Qiuhua Huang 🔗 |
-
|
Distributionally robust chance constrained programs using maximum mean discrepancy
(
Poster
)
>
|
Yassine Nemmour · Bernhard Schölkopf · Jia-Jie Zhu 🔗 |
-
|
Unbiased Efficient Feature Counts for Inverse RL
(
Poster
)
>
|
Gerard Donahue · Brendan Crowe · Marek Petrik · Daniel Brown 🔗 |
-
|
Parametric-Control Barrier Function-based Adaptive Safe Merging Control for Heterogeneous Vehicles
(
Poster
)
>
|
Yiwei Lyu · John Dolan 🔗 |
-
|
Bayesian Inverse Constrained Reinforcement Learning
(
Poster
)
>
|
Dimitris Papadimitriou · Daniel Brown · Usman Anwar 🔗 |
-
|
ProBF: Probabilistic Safety Certificates with Barrier Functions
(
Poster
)
>
|
Sulin Liu · Athindran Ramesh Kumar · Jaime Fisac · Ryan Adams · Peter J Ramadge 🔗 |
-
|
Behavior Policy Search for Risk Estimators in Reinforcement Learning
(
Poster
)
>
|
Elita Lobo · Marek Petrik · Dharmashankar Subramanian 🔗 |
-
|
Safe Online Exploration with Nonlinear Constraints
(
Poster
)
>
|
Eleanor Quint · Garrett Wirka · Stephen Scott 🔗 |
-
|
Avoiding Negative Side Effects by Considering Others
(
Poster
)
>
|
Parand Alizadeh Alamdari · Toryn Klassen · Rodrigo Toro Icarte · Sheila McIlraith 🔗 |
-
|
Robust Reinforcement Learning for Shifting Dynamics During Deployment
(
Poster
)
>
|
Samuel Stanton · Rasool Fakoor · Jonas Mueller · Andrew Gordon Wilson · Alexander Smola 🔗 |
-
|
Uncertainty-based Safety-Critical Control using Bayesian Methods
(
Poster
)
>
|
Carlos Montenegro · Santiago Jimenez Leudo · Carlos Rodríguez 🔗 |
-
|
Who Is the Strongest Enemy? Towards Optimal and Efficient Evasion Attacks in Deep RL
(
Poster
)
>
SlidesLive Video |
Yanchao Sun · Ruijie Zheng · Yongyuan Liang · Furong Huang 🔗 |
-
|
What Would the Expert do()?: Causal Imitation Learning
(
Poster
)
>
SlidesLive Video |
Gokul Swamy · Sanjiban Choudhury · James Bagnell · Steven Wu 🔗 |
-
|
Reinforcement Learning with Feedback from Multiple Humans with Diverse Skills
(
Poster
)
>
SlidesLive Video |
Taku Yamagata · Ryan McConville · Raul Santos-Rodriguez 🔗 |
-
|
Efficiently Improving the Robustness of RL Agents against Strongest Adversaries
(
Poster
)
>
SlidesLive Video |
Yongyuan Liang · Yanchao Sun · Ruijie Zheng · Furong Huang 🔗 |
-
|
Learning Contraction Policies from Offline Data
(
Poster
)
>
SlidesLive Video |
Navid Rezazadeh · Negar Mehr 🔗 |
-
|
Safety-guaranteed trajectory planning and control based on GP estimation for unmanned surface vessels
(
Poster
)
>
SlidesLive Video |
Shuhao Zhang · Seth Siriya 🔗 |