Journal article icon

Journal article

RLOC: terrain-aware legged locomotion using reinforcement learning and optimal control

Abstract:
We present a unified model-based and data-driven approach for quadrupedal planning and control to achieve dynamic locomotion over uneven terrain. We utilize on-board proprioceptive and exteroceptive feedback to map sensory information and desired base velocity commands into footstep plans using a reinforcement learning (RL) policy. This RL policy is trained in simulation over a wide range of procedurally generated terrains. When run online, the system tracks the generated footstep plans using a model-based motion controller. We evaluate the robustness of our method over a wide variety of complex terrains. It exhibits behaviors that prioritize stability over aggressive locomotion. Additionally, we introduce two ancillary RL policies for corrective whole-body motion tracking and recovery control. These policies account for changes in physical parameters and external perturbations. We train and evaluate our framework on a complex quadrupedal system, ANYmal version B, and demonstrate transferability to a larger and heavier robot, ANYmal C, without requiring retraining.
Publication status:
Published
Peer review status:
Peer reviewed

Actions

Access Document

Files:
Publisher copy:
10.1109/TRO.2022.3172469

Authors

More by this author
Institution:
University of Oxford
Division:
MPLS
Department:
Engineering Science
Role:
Author
ORCID:
0000-0003-2940-0879


Publisher:
IEEE
Journal:
IEEE Transactions on Robotics More from this journal
Volume:
38
Issue:
5
Pages:
2908 - 2927
Publication date:
2022-05-20
Acceptance date:
2022-01-27
DOI:
EISSN:
1941-0468
ISSN:
1552-3098


Language:
English
Keywords:
Pubs id:
1242861
Local pid:
pubs:1242861
Deposit date:
2022-03-09
ARK identifier:

Terms of use


Views and Downloads

Views and downloads will return soon






If you are the owner of this record, you can report an update to it here: Report update to this record

TO TOP