Workshop
Deployable Decision Making in Embodied Systems (DDM)
Angela Schoellig · Animesh Garg · Somil Bansal · SiQi Zhou · Melissa Greeff · Lukas Brunke
Tue 14 Dec, 7 a.m. PST
Embodied systems are playing an increasingly important role in our lives. Examples include, but are not limited to, autonomous driving, drone delivery, and service robots. In real-world deployments, the systems are required to safely learn and operate under the various sources of uncertainties. As noted in the “Roadmap for US Robotics (2020)”, safe learning and adaptation is a key aspect of next-generation robotics. Learning is ingrained in all components of the robotics software stack including perception, planning, and control. While the safety and robustness of these components have been identified as critical aspects for real-world deployments, open issues and challenges are often discussed separately in the respective communities. In this workshop, we aim to bring together researchers from machine learning, computer vision, robotics, and control to facilitate interdisciplinary discussions on the topic of deployable decision making in embodied systems. Our workshop will focus on two discussion themes: (i) safe learning and decision making in uncertain and unstructured environments and (ii) efficient transfer learning for deployable embodied systems. To facilitate discussions and solicit participation from a broad audience, we plan to have a set of interactive lecture-style presentations, focused discussion panels, and a poster session with contributed paper presentations. By bringing researchers and industry professionals together in our workshop and having detailed pre- and post-workshop plans, we envision this workshop to be an effort towards a long-term, interdisciplinary exchange on this topic.
Schedule
Tue 7:00 a.m. - 7:10 a.m.
|
Opening Remarks & Introduction
(
Live Introduction
)
>
SlidesLive Video |
Angela Schoellig · Somil Bansal 🔗 |
Tue 7:10 a.m. - 7:30 a.m.
|
Reinforcement Learning in Real-World Control Systems
(
Invited Talk
)
>
SlidesLive Video |
Martin Riedmiller 🔗 |
Tue 7:30 a.m. - 7:50 a.m.
|
Deployable Robot Learning with Self-supervised Spatial Action Maps
(
Invited Talk
)
>
SlidesLive Video |
Shuran Song 🔗 |
Tue 7:50 a.m. - 8:10 a.m.
|
Learning Abstractions for Robust and Tractable Planning
(
Invited Talk
)
>
SlidesLive Video |
Nick Roy 🔗 |
Tue 8:10 a.m. - 8:30 a.m.
|
Learning Closed-form Control Law for Adaptive and Fast Decision
(
Invited Talk
)
>
SlidesLive Video |
Aude G Billard 🔗 |
Tue 8:30 a.m. - 8:35 a.m.
|
Coffee Break
|
🔗 |
Tue 8:35 a.m. - 9:35 a.m.
|
Panel A: Deployable Learning Algorithms for Embodied Systems
(
Panel Discussion
)
>
SlidesLive Video |
Shuran Song · Martin Riedmiller · Nick Roy · Aude G Billard · Angela Schoellig · SiQi Zhou 🔗 |
Tue 9:35 a.m. - 9:40 a.m.
|
Spotlight Talk Introduction
(
Spotlight
)
>
|
Somil Bansal · Lukas Brunke 🔗 |
Tue 9:40 a.m. - 10:08 a.m.
|
Spotlights
(
Spotlight
)
>
SlidesLive Video |
Hager Radi · Krishan Rana · Yunzhu Li · Shuang Li · Gal Leibovich · Guy Jacob · Ruihan Yang 🔗 |
Tue 10:08 a.m. - 10:15 a.m.
|
Evaluation as a Process for Engineering Responsibility in AI
(
Invited Spotlight
)
>
SlidesLive Video |
Deborah Raji 🔗 |
Tue 10:15 a.m. - 11:00 a.m.
|
Poster Session ( Poster Session ) > link | 🔗 |
Tue 11:00 a.m. - 11:10 a.m.
|
Theme B Introduction
(
Introduction
)
>
SlidesLive Video |
Animesh Garg 🔗 |
Tue 11:10 a.m. - 11:30 a.m.
|
Robust Embedded Learned Models
(
Invited Talk
)
>
SlidesLive Video |
Dragos Margineantu 🔗 |
Tue 11:30 a.m. - 11:50 a.m.
|
Human-in-the-loop Bayesian Deep Learning
(
Invited Talk
)
>
SlidesLive Video |
Yarin Gal 🔗 |
Tue 11:50 a.m. - 12:10 p.m.
|
Learning for Agile Control in the Real World: Challenges and Opportunities
(
Invited Talk
)
>
SlidesLive Video |
Yisong Yue · Ivan Dario D Jimenez Rodriguez 🔗 |
Tue 12:10 p.m. - 12:30 p.m.
|
Enforcing Robustness for Neural Network Policies
(
Invited Talk
)
>
SlidesLive Video |
J. Zico Kolter 🔗 |
Tue 12:30 p.m. - 12:45 p.m.
|
Coffee Break
|
🔗 |
Tue 12:45 p.m. - 1:45 p.m.
|
Panel B: Safe Learning and Decision Making in Uncertain and Unstructured Environments
(
Panel Discussion
)
>
SlidesLive Video |
Yisong Yue · J. Zico Kolter · Ivan Dario D Jimenez Rodriguez · Dragos Margineantu · Animesh Garg · Melissa Greeff 🔗 |
Tue 1:45 p.m. - 2:00 p.m.
|
Concluding Remarks
(
Conclusion
)
>
SlidesLive Video |
Angela Schoellig · Lukas Brunke 🔗 |
Tue 2:00 p.m. - 3:00 p.m.
|
Post-Workshop Social Event ( Social Event ) > link | 🔗 |
-
|
Tutorial: Safe Learning for Decision Making ( Tutorial ) > link | Angela Schoellig · SiQi Zhou · Lukas Brunke · Animesh Garg · Melissa Greeff · Somil Bansal 🔗 |
-
|
Zero-Shot Uncertainty-Aware Deployment of Simulation Trained Policies on Real-World Robots
(
Poster
)
>
|
Krishan Rana · Vibhavari Dasagi · Michael Milford · Niko Suenderhauf 🔗 |
-
|
Zero-Shot Uncertainty-Aware Deployment of Simulation Trained Policies on Real-World Robots
(
Spotlight
)
>
|
Krishan Rana · Vibhavari Dasagi · Michael Milford · Niko Suenderhauf 🔗 |
-
|
Validate on Sim, Detect on Real - Model Selection for Domain Randomization
(
Poster
)
>
|
Guy Jacob · Gal Leibovich · Shadi Endrawis · Gal Novik · Aviv Tamar 🔗 |
-
|
Validate on Sim, Detect on Real - Model Selection for Domain Randomization
(
Spotlight
)
>
|
Guy Jacob · Gal Leibovich · Shadi Endrawis · Gal Novik · Aviv Tamar 🔗 |
-
|
Learning Vision-Guided Quadrupedal Locomotion End-to-End with Cross-Modal Transformers
(
Poster
)
>
|
Ruihan Yang · Minghao Zhang · Nicklas Hansen · Huazhe Xu · Xiaolong Wang 🔗 |
-
|
Learning Vision-Guided Quadrupedal Locomotion End-to-End with Cross-Modal Transformers
(
Spotlight
)
>
|
Ruihan Yang · Minghao Zhang · Nicklas Hansen · Huazhe Xu · Xiaolong Wang 🔗 |
-
|
3D Neural Scene Representations for Visuomotor Control
(
Poster
)
>
|
Yunzhu Li · Shuang Li · Vincent Sitzmann · Pulkit Agrawal · Antonio Torralba 🔗 |
-
|
3D Neural Scene Representations for Visuomotor Control
(
Spotlight
)
>
|
Yunzhu Li · Shuang Li · Vincent Sitzmann · Pulkit Agrawal · Antonio Torralba 🔗 |
-
|
Safe Evaluation For Offline Learning: \\Are We Ready To Deploy?
(
Poster
)
>
|
Hager Radi · Josiah Hanna · Peter Stone · Matthew Taylor 🔗 |
-
|
Safe Evaluation For Offline Learning: \\Are We Ready To Deploy?
(
Spotlight
)
>
|
Hager Radi · Josiah Hanna · Peter Stone · Matthew Taylor 🔗 |
-
|
ilpyt: Imitation Learning Research Code Base in PyTorch
(
Poster
)
>
|
Amanda Vu 🔗 |
-
|
Equidistant Hyperspherical Prototypes Improve Uncertainty Quantification
(
Poster
)
>
|
Gertjan Burghouts · Pascal Mettes 🔗 |
-
|
What Would the Expert $do(\cdot)$?: Causal Imitation Learning
(
Poster
)
>
|
Gokul Swamy · Sanjiban Choudhury · James Bagnell · Steven Wu 🔗 |
-
|
Conservative and Adaptive Penalty for Model-Based Safe Reinforcement Learning
(
Poster
)
>
|
Jason Yecheng Ma · Andrew Shen · Osbert Bastani · Dinesh Jayaraman 🔗 |
-
|
Vision-Guided Quadrupedal Locomotion in the Wild with Multi-Modal Delay Randomization
(
Poster
)
>
|
Chieko Imai · Minghao Zhang · Ruihan Yang · Yuzhe Qin · Xiaolong Wang 🔗 |
-
|
Towards Safe Global Optimality in Robot Learning with GoSafe
(
Poster
)
>
|
Bhavya Sukhija · Matteo Turchetta · Andreas Krause · Sebastian Trimpe · Dominik Baumann 🔗 |
-
|
Learning Impedance Actions for Safe Reinforcement Learning in Contact-Rich Tasks
(
Poster
)
>
|
Quantao Yang · Elin Topp · Todor Stoyanov · Johannes A. Stork 🔗 |
-
|
Extraneousness-Aware Imitation Learning
(
Poster
)
>
|
Ray Zheng · Kaizhe Hu · Boyuan Chen · Huazhe Xu 🔗 |
-
|
Reward-Based Environment States for Robot Manipulation Policy Learning
(
Poster
)
>
|
Isabelle Ferrane · Heriberto Cuayahuitl 🔗 |
-
|
Look Closer: Bridging Egocentric and Third-Person Views with Transformers for Robotic Manipulation
(
Poster
)
>
|
Rishabh Jangir · Nicklas Hansen · Mohit Jain · Xiaolong Wang 🔗 |
-
|
Deep Reinforcement Learning Policies for Underactuated Satellite Attitude Control
(
Poster
)
>
|
Matteo El Hariry 🔗 |
-
|
GRILC: Gradient-based Reprogrammable Iterative Learning Control for Autonomous Systems
(
Poster
)
>
|
Kuan-Yu Tseng · Jeff Shamma · Geir Dullerud 🔗 |
-
|
A Unified Approach to Obstacle Avoidance and Motion Learning
(
Poster
)
>
|
Lukas Huber · Aude G Billard · Jean-Jacques Slotine 🔗 |