Multitasking capability versus learning efficiency in neural network architectures

Conference item

One of the most salient and well-recognized features of human goal-directed behavior is our limited ability to conduct multiple demanding tasks at once. Previous work has identified overlap between task processing pathways as a limiting factor for multitasking performance in neural architectures. This raises an important question: insofar as shared representation between tasks introduces the risk of cross-talk and thereby limitations in multitasking, why would the brain prefer shared task representations over separate representations across tasks? We seek to answer this question by introducing formal considerations and neural network simulations in which we contrast the multitasking limitations that shared task representations incur with their benefits for task learning. Our results suggest that neural network architectures face a fundamental tradeoff between learning efficiency and multitasking performance in environments with shared structure between tasks.

Authors: Musslick, S; Saxe, A; Özcimder, K; Dey, B; Henselman, G

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: Cognitive Science Society
• Host title: Proceedings of the 39th Annual Meeting of the Cognitive Science Society
• Pages: 829-834
• Publication date: 2017-01-01
• Event title: Annual Meeting of the Cognitive Science Society 2017 (CogSci 2017)
• Event location: London, UK
• Event website: https://cognitivesciencesociety.org/past-conferences/
• Event start date: 2017-07-26
• Event end date: 2017-07-29
• ISSN: 1069-7977
• ISBN: 978-0-9911967-6-0
• Language: English
• Keywords: cognitive control; multitasking; neural networks; capacity constraint; learning