Probabilistic planning with formal performance guarantees for mobile service robots

Journal article

We present a framework for mobile service robot task planning and execution, based on the use of probabilistic verification techniques for the generation of optimal policies with attached formal performance guarantees. Our approach is based on a Markov decision process model of the robot in its environment, encompassing a topological map where nodes represent relevant locations in the environment, and a range of tasks that can be executed in different locations. The navigation in the topological map is modeled stochastically for a specific time of day. This is done by using spatio-temporal models that provide, for a given time of day, the probability of successfully navigating between two topological nodes, and the expected time to do so. We then present a methodology to generate cost optimal policies for tasks specified in co-safe linear temporal logic. Our key contribution is to address scenarios in which the task may not be achievable with probability one. We introduce a task progression function and present an approach to generate policies that are formally guaranteed to, in decreasing order of priority: maximize the probability of finishing the task; maximize progress towards completion, if this is not possible; and minimize the expected time or cost required. We illustrate and evaluate our approach with a scalability evaluation in a simulated scenario, and report on its implementation in a robot performing service tasks in an office environment for long periods of time.

Authors: Lacerda, B; Faruq, F; Parker, D; Hawes, N

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: SAGE Publications
• Journal: International Journal of Robotics Research
• Volume: 38
• Issue: 9
• Pages: 1098–1123
• Publication date: 2019-06-16
• DOI: 10.1177/0278364919856695
• EISSN: 1741-3176
• ISSN: 0278-3649
• Language: English
• Keywords: Markov decision processes; FFR; mobile service robots; linear temporal logic; planning under uncertainty