English
 
Help Privacy Policy Disclaimer
  Advanced SearchBrowse

Item

ITEM ACTIONSEXPORT

Released

Journal Article

Metabolic cost as an organizing principle for cooperative learning

MPS-Authors
/persons/resource/persons84121

Ortega,  PA
Max Planck Institute for Intelligent Systems, Max Planck Society;

/persons/resource/persons75278

Besserve,  M
Max Planck Institute for Intelligent Systems, Max Planck Society;

Fulltext (restricted access)
There are currently no full texts shared for your IP range.
Fulltext (public)
There are no public fulltexts stored in PuRe
Supplementary Material (public)
There is no public supplementary material available
Citation

Balduzzi, D., Ortega, P., & Besserve, M. (2013). Metabolic cost as an organizing principle for cooperative learning. Advances in Complex Systems, 16(02n03): 1350012, pp. 1-18. doi:10.1142/S0219525913500124.


Cite as: https://hdl.handle.net/11858/00-001M-0000-0013-B83C-2
Abstract
This paper investigates how a population of neuron-like agents can use metabolic cost to communicate the importance of their actions. Although decision-making by individual agents has been extensively studied, questions regarding how agents should behave to cooperate effectively remain largely unaddressed. Under assumptions that capture a few basic features of cortical neurons, we show that constraining reward maximization by metabolic cost aligns the information content of actions with their expected reward. Thus, metabolic cost provides a mechanism whereby agents encode expected reward into their outputs. Further, aside from reducing energy expenditures, imposing a tight metabolic constraint also increases the accuracy of empirical estimates of rewards, increasing the robustness of distributed learning. Finally, we present two implementations of metabolically constrained learning that confirm our theoretical finding. These results suggest that metabolic cost may be an organizing principle underlying the neural code, and may also provide a useful guide to the design and analysis of other cooperating populations.