PLAYING STOCHASTIC GAMES PRECISELY

Report

We study stochastic two-player games where the goal of one player is to achieve precisely a given expected value of the objective function, while the goal of the opponent is the opposite. Potential applications for such games include controller synthesis problems where the optimisation objective is to maximise or minimise a given payo function while respecting a strict upper or lower bound, respectively. We consider a number of objective functions including reachability, !-regular, discounted reward, and total reward. We show that precise value games are not determined, and compare the memory requirements for winning strategies. For stopping games we establish necessary and sucient conditions for the existence of a winning strategy of the controller for a large class of functions, as well as provide the constructions of compact strategies for the studied objectives.

Authors: Chen, T; Forejt, V; Kwiatkowska, M; Simaitis, A; Trivedi, A

• Publication date: 2012-01-01