Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
Review
. 2023 Jan:144:104977.
doi: 10.1016/j.neubiorev.2022.104977. Epub 2022 Nov 24.

Emotions as computations

Affiliations
Review

Emotions as computations

Aviv Emanuel et al. Neurosci Biobehav Rev. 2023 Jan.

Abstract

Emotions ubiquitously impact action, learning, and perception, yet their essence and role remain widely debated. Computational accounts of emotion aspire to answer these questions with greater conceptual precision informed by normative principles and neurobiological data. We examine recent progress in this regard and find that emotions may implement three classes of computations, which serve to evaluate states, actions, and uncertain prospects. For each of these, we use the formalism of reinforcement learning to offer a new formulation that better accounts for existing evidence. We then consider how these distinct computations may map onto distinct emotions and moods. Integrating extensive research on the causes and consequences of different emotions suggests a parsimonious one-to-one mapping, according to which emotions are integral to how we evaluate outcomes (pleasure & pain), learn to predict them (happiness & sadness), use them to inform our (frustration & content) and others' (anger & gratitude) actions, and plan in order to realize (desire & hope) or avoid (fear & anxiety) uncertain outcomes.

Keywords: Computational modeling; Emotion; Mood; Reinforcement learning; Reward.

PubMed Disclaimer

Conflict of interest statement

Conflict of interest None.

Figures

Figure 1.
Figure 1.. Determinants of positive and negative prospective emotions.
A. If the distribution of possible outcomes is wider, there are more probable prospects with high deviation from the expected value, and thus both positive and negative emotions are stronger. The estimated distribution can be wider either because outcomes are random (irreducible uncertainty) or due to lack of information (estimation uncertainty). B. If the skewness of the distribution is negative, then there are more probable prospects with a high negative deviation from the expected value, and thus negative emotions predominate. Conversely, if skewness is positive, then there are more prospects with a high positive deviation, and thus positive emotions predominate.
Figure 2.
Figure 2.
Summary of computations we propose are represented by emotional states.
Figure 3.
Figure 3.. Action-evaluation emotions.
Different emotion labels are used for different combinations of culpable agent (‘poor outcome due to’) and the agent suffering as a result (‘poor outcome suffered by’). These labels are paralleled by corresponding labels in the domain of positive outcomes (e.g., ‘anger’ correspond to ‘gratitude’, ‘frustration corresponds to ‘content’)
Figure 4.
Figure 4.. Proposed impact of reward within the emotion circumplex.
The impact differs for changes in expected reward that have already happened (retrospective) and those that may happen in the future (prospective). Note that ‘reward’ in our account refers to a reward function that sums across both rewarding (positive) and punishing (negative) attributes of states and actions.

Similar articles

Cited by

  • The Human Affectome.
    Schiller D, Yu ANC, Alia-Klein N, Becker S, Cromwell HC, Dolcos F, Eslinger PJ, Frewen P, Kemp AH, Pace-Schott EF, Raber J, Silton RL, Stefanova E, Williams JHG, Abe N, Aghajani M, Albrecht F, Alexander R, Anders S, Aragón OR, Arias JA, Arzy S, Aue T, Baez S, Balconi M, Ballarini T, Bannister S, Banta MC, Barrett KC, Belzung C, Bensafi M, Booij L, Bookwala J, Boulanger-Bertolus J, Boutros SW, Bräscher AK, Bruno A, Busatto G, Bylsma LM, Caldwell-Harris C, Chan RCK, Cherbuin N, Chiarella J, Cipresso P, Critchley H, Croote DE, Demaree HA, Denson TF, Depue B, Derntl B, Dickson JM, Dolcos S, Drach-Zahavy A, Dubljević O, Eerola T, Ellingsen DM, Fairfield B, Ferdenzi C, Friedman BH, Fu CHY, Gatt JM, de Gelder B, Gendolla GHE, Gilam G, Goldblatt H, Gooding AEK, Gosseries O, Hamm AO, Hanson JL, Hendler T, Herbert C, Hofmann SG, Ibanez A, Joffily M, Jovanovic T, Kahrilas IJ, Kangas M, Katsumi Y, Kensinger E, Kirby LAJ, Koncz R, Koster EHW, Kozlowska K, Krach S, Kret ME, Krippl M, Kusi-Mensah K, Ladouceur CD, Laureys S, Lawrence A, Li CR, Liddell BJ, Lidhar NK, Lowry CA, Magee K, Marin MF, Mariotti V, Martin LJ, Marusak HA, Mayer AV, Merner AR, Minnier J, Moll J, Morrison RG, Moore M, Mouly … See abstract for full author list ➔ Schiller D, et al. Neurosci Biobehav Rev. 2024 Mar;158:105450. doi: 10.1016/j.neubiorev.2023.105450. Epub 2023 Nov 3. Neurosci Biobehav Rev. 2024. PMID: 37925091 Free PMC article. Review.
  • Mood fluctuations shift cost-benefit tradeoffs in economic decisions.
    Heerema R, Carrillo P, Daunizeau J, Vinckier F, Pessiglione M. Heerema R, et al. Sci Rep. 2023 Oct 24;13(1):18173. doi: 10.1038/s41598-023-45217-w. Sci Rep. 2023. PMID: 37875525 Free PMC article.
  • Emotion prediction as computation over a generative theory of mind.
    Houlihan SD, Kleiman-Weiner M, Hewitt LB, Tenenbaum JB, Saxe R. Houlihan SD, et al. Philos Trans A Math Phys Eng Sci. 2023 Jul 24;381(2251):20220047. doi: 10.1098/rsta.2022.0047. Epub 2023 Jun 5. Philos Trans A Math Phys Eng Sci. 2023. PMID: 37271174 Free PMC article.
  • The computational psychopathology of emotion.
    Erdman A, Eldar E. Erdman A, et al. Psychopharmacology (Berl). 2023 Nov;240(11):2231-2238. doi: 10.1007/s00213-023-06335-5. Epub 2023 Feb 22. Psychopharmacology (Berl). 2023. PMID: 36811651 Review.
  • Computational models of subjective feelings in psychiatry.
    Kao CH, Feng GW, Hur JK, Jarvis H, Rutledge RB. Kao CH, et al. Neurosci Biobehav Rev. 2023 Feb;145:105008. doi: 10.1016/j.neubiorev.2022.105008. Epub 2022 Dec 19. Neurosci Biobehav Rev. 2023. PMID: 36549378 Free PMC article. Review.

References

    1. Abend R, Gold AL, Britton JC, Michalska KJ, Shechner T, Sachs JF, Winkler AM, Leibenluft E, Averbeck BB, & Pine DS (2020). Anticipatory threat responding: associations with anxiety, development, and brain structure. Biological Psychiatry, 87(10), 916–925. - PMC - PubMed
    1. Adolphs R (2002). Neural systems for recognizing emotion. Current Opinion in Neurobiology, 12(2), 169–177. - PubMed
    1. Adolphs R, Mlodinow L, & Barrett LF (2019). What is an emotion? Current Biology, 29(20), R1060–R1064. - PMC - PubMed
    1. Akiskal HS, Akiskal KK, Haykal RF, Manning JS, & Connor PD (2005). TEMPSA: progress towards validation of a self-rated clinical version of the Temperament Evaluation of the Memphis, Pisa, Paris, and San Diego Autoquestionnaire. Journal of Affective Disorders, 85(1–2), 3–16. - PubMed
    1. Anderson DJ, & Adolphs R (2014). A framework for studying emotions across species. Cell, 157(1), 187–200. - PMC - PubMed

Publication types