Skip to yearly menu bar Skip to main content


Poster

Simulated Humanoid Grasping on Diverse Objects

Zhengyi Luo · Jinkun Cao · Sammy Christen · Alexander Winkler · Kris Kitani · Weipeng Xu

[ ]
Fri 13 Dec 11 a.m. PST — 2 p.m. PST

Abstract:

We present a method for controlling a simulated humanoid to grasp an object and move it to follow an object trajectory. Due to the challenges in controlling a humanoid with dexterous hands, prior methods often use a disembodied hand and only consider vertical lifts or short trajectories. This limited scope hampers their applicability for object manipulation required for animation and simulation. To close this gap, we learn a controller that can pick up a large number (>1200) of objects and carry them to follow randomly generated trajectories. Our key insight is to leverage a humanoid motion representation that provides human-like motor skills and significantly speeds up training. Using only simplistic reward, state, and object representations, our method shows favorable scalability on diverse object and trajectories. At test time, we only require the object mesh and desired trajectories for grasping and transporting. To demonstrate the capabilities of our method, we show state-of-the-art success rates (94.5%) in completing object trajectories and generalizing to unseen objects.

Live content is unavailable. Log in and register to view live content