Do humans produce the speed-accuracy trade-off that maximizes reward rate?

Journal article

In this paper we investigate trade-offs between speed and accuracy that are produced by humans when confronted with a sequence of choices between two alternatives. We assume that the choice process is described by the drift diffusion model, in which the speed-accuracy trade-off is primarily controlled by the value of the decision threshold. We test the hypothesis that participants choose the decision threshold that maximizes reward rate, defined as an average number of rewards per unit of time. In particular, we test four predictions derived on the basis of this hypothesis in two behavioural experiments. The data from all participants of our experiments provide support only for some of the predictions, and on average the participants are slower and more accurate than predicted by reward rate maximization. However, when we limit our analysis to subgroups of 30-50% of participants who earned the highest overall rewards, all the predictions are satisfied by the data. This suggests that a substantial subset of participants do select decision thresholds that maximize reward rate. We also discuss possible reasons why the remaining participants select thresholds higher than optimal, including the possibility that participants optimize a combination of reward rate and accuracy or that they compensate for the influence of timing uncertainty, or both.

Authors: Bogacz, R; Hu, P; Holmes, P; Cohen, J

• Publication status: Published
• Journal: Quarterly journal of experimental psychology (2006)
• Volume: 63
• Issue: 5
• Pages: 863-891
• Publication date: 2010-05-01
• DOI: 10.1080/17470210903091643
• EISSN: 1747-0226
• ISSN: 1747-0218
• Language: English
• Keywords: Probability; Reinforcement Schedule; Choice Behavior; Psychomotor Performance; Humans; Young Adult; Motion Perception; Predictive Value of Tests; Reward; Photic Stimulation; Models, Psychological; Female; Decision Making; Male; Reaction Time