Journal article
RLOC: terrain-aware legged locomotion using reinforcement learning and optimal control
- Abstract:
- We present a unified model-based and data-driven approach for quadrupedal planning and control to achieve dynamic locomotion over uneven terrain. We utilize on-board proprioceptive and exteroceptive feedback to map sensory information and desired base velocity commands into footstep plans using a reinforcement learning (RL) policy. This RL policy is trained in simulation over a wide range of procedurally generated terrains. When run online, the system tracks the generated footstep plans using a model-based motion controller. We evaluate the robustness of our method over a wide variety of complex terrains. It exhibits behaviors that prioritize stability over aggressive locomotion. Additionally, we introduce two ancillary RL policies for corrective whole-body motion tracking and recovery control. These policies account for changes in physical parameters and external perturbations. We train and evaluate our framework on a complex quadrupedal system, ANYmal version B, and demonstrate transferability to a larger and heavier robot, ANYmal C, without requiring retraining.
- Publication status:
- Published
- Peer review status:
- Peer reviewed
Actions
Access Document
- Files:
-
-
(Preview, Accepted manuscript, pdf, 12.7MB, Terms of use)
-
- Publisher copy:
- 10.1109/TRO.2022.3172469
Authors
- Publisher:
- IEEE
- Journal:
- IEEE Transactions on Robotics More from this journal
- Volume:
- 38
- Issue:
- 5
- Pages:
- 2908 - 2927
- Publication date:
- 2022-05-20
- Acceptance date:
- 2022-01-27
- DOI:
- EISSN:
-
1941-0468
- ISSN:
-
1552-3098
- Language:
-
English
- Keywords:
- Pubs id:
-
1242861
- Local pid:
-
pubs:1242861
- Deposit date:
-
2022-03-09
- ARK identifier:
Terms of use
- Copyright holder:
- IEEE
- Copyright date:
- 2022
- Rights statement:
- © 2022 IEEE.
- Notes:
- This is the accepted manuscript version of the article. The final version is available online from IEEE at: https://doi.org/10.1109/TRO.2022.3172469
If you are the owner of this record, you can report an update to it here: Report update to this record