Hierarchical visuomotor control of humanoids
Abstract
We aim to build complex humanoid agents that integrate perception, motor control, and memory. In this work, we partly factor this problem into low-level motor control from proprioception and high-level coordination of the low-level skills informed by vision. We develop an architecture capable of surprisingly flexible, task-directed motor control of a relatively high-DoF humanoid body by combining pre-training of low-level motor controllers with a high-level, task-focused controller that switches among low-level sub-policies. The resulting system is able to control a physically-simulated humanoid body to solve tasks that require coupling visual perception from an unstabilized egocentric RGB camera during locomotion in the environment. For a supplementary video link, see https://youtu.be/7GISvfbykLE .
- Publication:
-
arXiv e-prints
- Pub Date:
- November 2018
- DOI:
- 10.48550/arXiv.1811.09656
- arXiv:
- arXiv:1811.09656
- Bibcode:
- 2018arXiv181109656M
- Keywords:
-
- Computer Science - Artificial Intelligence;
- Computer Science - Robotics
- E-Print:
- Accepted as a conference paper at ICLR 2019