Trust-aware motion planning for human-robot collaboration under distribution temporal logic specifications

Conference item

Recent work has considered trust-aware decision making for human-robot collaboration (HRC) with a focus on model learning. In this paper, we are interested in enabling the HRC system to complete complex tasks specified using temporal logic formulas that involve human trust. Since accurately observing human trust in robots is challenging, we adopt the widely used partially observable Markov decision process (POMDP) framework for modelling the interactions between humans and robots. To specify the desired behaviour, we propose to use syntactically co-safe linear distribution temporal logic (scLDTL), a logic that is defined over predicates of states as well as belief states of partially observable systems. The incorporation of belief predicates in scLDTL enhances its expressiveness while simultaneously introducing added complexity. This also presents a new challenge as the belief predicates must be evaluated over the continuous (infinite) belief space. To address this challenge, we present an algorithm for solving the optimal policy synthesis problem. First, we enhance the belief MDP (derived by reformulating the POMDP) with a probabilistic labelling function. Then a product belief MDP is constructed between the probabilistically labelled belief MDP and the automaton translation of the scLDTL formula. Finally, we show that the optimal policy can be obtained by leveraging existing point-based value iteration algorithms with essential modifications. Human subject experiments with 21 participants on a driving simulator demonstrate the effectiveness of the proposed approach.

Authors: Yu, P; Dong, S; Sheng, S; Feng, L; Kwiatkowska, M

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: IEEE
• Host title: 2024 IEEE International Conference on Robotics and Automation (ICRA)
• Pages: 12949-12955
• Publication date: 2024-08-08
• Acceptance date: 2024-01-29
• Event title: 2024 IEEE International Conference on Robotics and Automation (ICRA 2024)
• Event location: Yokohama, Japan
• Event website: https://2024.ieee-icra.org/
• Event start date: 2024-05-13
• Event end date: 2024-05-17
• DOI: 10.1109/ICRA57147.2024.10610874
• EISBN: 9798350384574
• ISBN: 9798350384581
• Language: English
• Keywords: Markov decision processes; heuristic algorithms; probabilistic logic; automata; collaboration; planning; decision making