Should we control? The interplay between cognitive control and information integration in the resolution of the exploration-exploitation dilemma
- Author
- Irene Cogliati Dezza (UGent) , Axel Cleeremans and William Alexander (UGent)
- Organization
- Abstract
- In their daily decisions, humans and animals are often confronted with the conflicting choice of opting either for a rewarding familiar option (i.e., exploitation) or for a novel, uncertain option that may, however, yield a better reward in the near future (i.e., exploration). Despite extensive research, the cognitive mechanisms that subtend the manner in which humans solve this exploration-exploitation dilemma are still poorly understood. In this study, we challenge the popular assumption that exploitation is a global default strategy that must be suppressed by means of cognitive control mechanisms so as to enable exploratory strategies. To do so, we asked participants to engage in a challenging working memory task while performing repeated choices in a gambling task. Results showed that manipulating cognitive control resources exclusively hindered participants' ability to explore the environment in a directed, intentional manner. Moreover, under certain scenarios, adopting exploitative strategies was also dependent on the availability of cognitive control resources. Additional analyses using a recent computational model of information integration suggests that increasing cognitive load specifically interferes with the ability to combine reward and information in order to inform choices. Our results shed light on the cognitive mechanisms that underpin the resolution of the dilemma and provide a formal foundation through which to explore pathologies of goal-directed behavior.
- Keywords
- Developmental Neuroscience, General Psychology, Experimental and Cognitive Psychology, exploration-exploitation dilemma, informative value, reinforcement learning, cognitive control, adaptive behaviors, PREFRONTAL CORTEX, WORKING-MEMORY, INDIVIDUAL-DIFFERENCES, TRADE-OFF, UNCERTAINTY, LOCUS
Downloads
-
(...).pdf
- full text (Published version)
- |
- UGent only
- |
- |
- 1.29 MB
Citation
Please use this url to cite or link to this publication: http://hdl.handle.net/1854/LU-8746077
- MLA
- Cogliati Dezza, Irene, et al. “Should We Control? The Interplay between Cognitive Control and Information Integration in the Resolution of the Exploration-Exploitation Dilemma.” JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, vol. 148, no. 6, 2019, pp. 977–93, doi:10.1037/xge0000546.
- APA
- Cogliati Dezza, I., Cleeremans, A., & Alexander, W. (2019). Should we control? The interplay between cognitive control and information integration in the resolution of the exploration-exploitation dilemma. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 148(6), 977–993. https://doi.org/10.1037/xge0000546
- Chicago author-date
- Cogliati Dezza, Irene, Axel Cleeremans, and William Alexander. 2019. “Should We Control? The Interplay between Cognitive Control and Information Integration in the Resolution of the Exploration-Exploitation Dilemma.” JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL 148 (6): 977–93. https://doi.org/10.1037/xge0000546.
- Chicago author-date (all authors)
- Cogliati Dezza, Irene, Axel Cleeremans, and William Alexander. 2019. “Should We Control? The Interplay between Cognitive Control and Information Integration in the Resolution of the Exploration-Exploitation Dilemma.” JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL 148 (6): 977–993. doi:10.1037/xge0000546.
- Vancouver
- 1.Cogliati Dezza I, Cleeremans A, Alexander W. Should we control? The interplay between cognitive control and information integration in the resolution of the exploration-exploitation dilemma. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL. 2019;148(6):977–93.
- IEEE
- [1]I. Cogliati Dezza, A. Cleeremans, and W. Alexander, “Should we control? The interplay between cognitive control and information integration in the resolution of the exploration-exploitation dilemma,” JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, vol. 148, no. 6, pp. 977–993, 2019.
@article{8746077, abstract = {{In their daily decisions, humans and animals are often confronted with the conflicting choice of opting either for a rewarding familiar option (i.e., exploitation) or for a novel, uncertain option that may, however, yield a better reward in the near future (i.e., exploration). Despite extensive research, the cognitive mechanisms that subtend the manner in which humans solve this exploration-exploitation dilemma are still poorly understood. In this study, we challenge the popular assumption that exploitation is a global default strategy that must be suppressed by means of cognitive control mechanisms so as to enable exploratory strategies. To do so, we asked participants to engage in a challenging working memory task while performing repeated choices in a gambling task. Results showed that manipulating cognitive control resources exclusively hindered participants' ability to explore the environment in a directed, intentional manner. Moreover, under certain scenarios, adopting exploitative strategies was also dependent on the availability of cognitive control resources. Additional analyses using a recent computational model of information integration suggests that increasing cognitive load specifically interferes with the ability to combine reward and information in order to inform choices. Our results shed light on the cognitive mechanisms that underpin the resolution of the dilemma and provide a formal foundation through which to explore pathologies of goal-directed behavior.}}, author = {{Cogliati Dezza, Irene and Cleeremans, Axel and Alexander, William}}, issn = {{0096-3445}}, journal = {{JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL}}, keywords = {{Developmental Neuroscience,General Psychology,Experimental and Cognitive Psychology,exploration-exploitation dilemma,informative value,reinforcement learning,cognitive control,adaptive behaviors,PREFRONTAL CORTEX,WORKING-MEMORY,INDIVIDUAL-DIFFERENCES,TRADE-OFF,UNCERTAINTY,LOCUS}}, language = {{eng}}, number = {{6}}, pages = {{977--993}}, title = {{Should we control? The interplay between cognitive control and information integration in the resolution of the exploration-exploitation dilemma}}, url = {{http://doi.org/10.1037/xge0000546}}, volume = {{148}}, year = {{2019}}, }
- Altmetric
- View in Altmetric
- Web of Science
- Times cited: