Advanced search
1 file | 1.29 MB Add to list

Should we control? The interplay between cognitive control and information integration in the resolution of the exploration-exploitation dilemma

Author
Organization
Abstract
In their daily decisions, humans and animals are often confronted with the conflicting choice of opting either for a rewarding familiar option (i.e., exploitation) or for a novel, uncertain option that may, however, yield a better reward in the near future (i.e., exploration). Despite extensive research, the cognitive mechanisms that subtend the manner in which humans solve this exploration-exploitation dilemma are still poorly understood. In this study, we challenge the popular assumption that exploitation is a global default strategy that must be suppressed by means of cognitive control mechanisms so as to enable exploratory strategies. To do so, we asked participants to engage in a challenging working memory task while performing repeated choices in a gambling task. Results showed that manipulating cognitive control resources exclusively hindered participants' ability to explore the environment in a directed, intentional manner. Moreover, under certain scenarios, adopting exploitative strategies was also dependent on the availability of cognitive control resources. Additional analyses using a recent computational model of information integration suggests that increasing cognitive load specifically interferes with the ability to combine reward and information in order to inform choices. Our results shed light on the cognitive mechanisms that underpin the resolution of the dilemma and provide a formal foundation through which to explore pathologies of goal-directed behavior.
Keywords
Developmental Neuroscience, General Psychology, Experimental and Cognitive Psychology, exploration-exploitation dilemma, informative value, reinforcement learning, cognitive control, adaptive behaviors, PREFRONTAL CORTEX, WORKING-MEMORY, INDIVIDUAL-DIFFERENCES, TRADE-OFF, UNCERTAINTY, LOCUS

Downloads

  • (...).pdf
    • full text (Published version)
    • |
    • UGent only
    • |
    • PDF
    • |
    • 1.29 MB

Citation

Please use this url to cite or link to this publication:

MLA
Cogliati Dezza, Irene, et al. “Should We Control? The Interplay between Cognitive Control and Information Integration in the Resolution of the Exploration-Exploitation Dilemma.” JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, vol. 148, no. 6, 2019, pp. 977–93, doi:10.1037/xge0000546.
APA
Cogliati Dezza, I., Cleeremans, A., & Alexander, W. (2019). Should we control? The interplay between cognitive control and information integration in the resolution of the exploration-exploitation dilemma. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, 148(6), 977–993. https://doi.org/10.1037/xge0000546
Chicago author-date
Cogliati Dezza, Irene, Axel Cleeremans, and William Alexander. 2019. “Should We Control? The Interplay between Cognitive Control and Information Integration in the Resolution of the Exploration-Exploitation Dilemma.” JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL 148 (6): 977–93. https://doi.org/10.1037/xge0000546.
Chicago author-date (all authors)
Cogliati Dezza, Irene, Axel Cleeremans, and William Alexander. 2019. “Should We Control? The Interplay between Cognitive Control and Information Integration in the Resolution of the Exploration-Exploitation Dilemma.” JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL 148 (6): 977–993. doi:10.1037/xge0000546.
Vancouver
1.
Cogliati Dezza I, Cleeremans A, Alexander W. Should we control? The interplay between cognitive control and information integration in the resolution of the exploration-exploitation dilemma. JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL. 2019;148(6):977–93.
IEEE
[1]
I. Cogliati Dezza, A. Cleeremans, and W. Alexander, “Should we control? The interplay between cognitive control and information integration in the resolution of the exploration-exploitation dilemma,” JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL, vol. 148, no. 6, pp. 977–993, 2019.
@article{8746077,
  abstract     = {{In their daily decisions, humans and animals are often confronted with the conflicting choice of opting either for a rewarding familiar option (i.e., exploitation) or for a novel, uncertain option that may, however, yield a better reward in the near future (i.e., exploration). Despite extensive research, the cognitive mechanisms that subtend the manner in which humans solve this exploration-exploitation dilemma are still poorly understood. In this study, we challenge the popular assumption that exploitation is a global default strategy that must be suppressed by means of cognitive control mechanisms so as to enable exploratory strategies. To do so, we asked participants to engage in a challenging working memory task while performing repeated choices in a gambling task. Results showed that manipulating cognitive control resources exclusively hindered participants' ability to explore the environment in a directed, intentional manner. Moreover, under certain scenarios, adopting exploitative strategies was also dependent on the availability of cognitive control resources. Additional analyses using a recent computational model of information integration suggests that increasing cognitive load specifically interferes with the ability to combine reward and information in order to inform choices. Our results shed light on the cognitive mechanisms that underpin the resolution of the dilemma and provide a formal foundation through which to explore pathologies of goal-directed behavior.}},
  author       = {{Cogliati Dezza, Irene and Cleeremans, Axel and Alexander, William}},
  issn         = {{0096-3445}},
  journal      = {{JOURNAL OF EXPERIMENTAL PSYCHOLOGY-GENERAL}},
  keywords     = {{Developmental Neuroscience,General Psychology,Experimental and Cognitive Psychology,exploration-exploitation dilemma,informative value,reinforcement learning,cognitive control,adaptive behaviors,PREFRONTAL CORTEX,WORKING-MEMORY,INDIVIDUAL-DIFFERENCES,TRADE-OFF,UNCERTAINTY,LOCUS}},
  language     = {{eng}},
  number       = {{6}},
  pages        = {{977--993}},
  title        = {{Should we control? The interplay between cognitive control and information integration in the resolution of the exploration-exploitation dilemma}},
  url          = {{http://doi.org/10.1037/xge0000546}},
  volume       = {{148}},
  year         = {{2019}},
}

Altmetric
View in Altmetric
Web of Science
Times cited: