REWARD PROCESSING IN MOTIVATIONAL AND AFFECTIVE DISORDERS EDITED BY : Frank Ryan and Nikolina Skandali PUBLISHED IN : Frontiers in Psychology 1 October 2016 | Reward Processing in M otivational and Affective Disorders Frontiers in Psychology Frontiers Copyright Statement © Copyright 2007-2016 Frontiers Media SA. All rights reserved. All content included on this site, such as text, graphics, logos, button icons, images, video/audio clips, downloads, data compilations and software, is the property of or is licensed to Frontiers Media SA (“Frontiers”) or its licensees and/or subcontractors. The copyright in the text of individual articles is the property of their respective authors, subject to a license granted to Frontiers. The compilation of articles constituting this e-book, wherever published, as well as the compilation of all other content on this site, is the exclusive property of Frontiers. For the conditions for downloading and copying of e-books from Frontiers’ website, please see the Terms for Website Use. If purchasing Frontiers e-books from other websites or sources, the conditions of the website concerned apply. Images and graphics not forming part of user-contributed materials may not be downloaded or copied without permission. Individual articles may be downloaded and reproduced in accordance with the principles of the CC-BY licence subject to any copyright or other notices. They may not be re-sold as an e-book. As author or other contributor you grant a CC-BY licence to others to reproduce your articles, including any graphics and third-party materials supplied by you, in accordance with the Conditions for Website Use and subject to any copyright notices which you include in connection with your articles and materials. All copyright, and all rights therein, are protected by national and international copyright laws. The above represents a summary only. For the full conditions see the Conditions for Authors and the Conditions for Website Use. ISSN 1664-8714 ISBN 978-2-88919-986-0 DOI 10.3389/978-2-88919-986-0 About Frontiers Frontiers is more than just an open-access publisher of scholarly articles: it is a pioneering approach to the world of academia, radically improving the way scholarly research is managed. The grand vision of Frontiers is a world where all people have an equal opportunity to seek, share and generate knowledge. Frontiers provides immediate and permanent online open access to all its publications, but this alone is not enough to realize our grand goals. Frontiers Journal Series The Frontiers Journal Series is a multi-tier and interdisciplinary set of open-access, online journals, promising a paradigm shift from the current review, selection and dissemination processes in academic publishing. All Frontiers journals are driven by researchers for researchers; therefore, they constitute a service to the scholarly community. At the same time, the Frontiers Journal Series operates on a revolutionary invention, the tiered publishing system, initially addressing specific communities of scholars, and gradually climbing up to broader public understanding, thus serving the interests of the lay society, too. Dedication to Quality Each Frontiers article is a landmark of the highest quality, thanks to genuinely collaborative interactions between authors and review editors, who include some of the world’s best academicians. Research must be certified by peers before entering a stream of knowledge that may eventually reach the public - and shape society; therefore, Frontiers only applies the most rigorous and unbiased reviews. Frontiers revolutionizes research publishing by freely delivering the most outstanding research, evaluated with no bias from both the academic and social point of view. By applying the most advanced information technologies, Frontiers is catapulting scholarly publishing into a new generation. What are Frontiers Research Topics? Frontiers Research Topics are very popular trademarks of the Frontiers Journals Series: they are collections of at least ten articles, all centered on a particular subject. With their unique mix of varied contributions from Original Research to Review Articles, Frontiers Research Topics unify the most influential researchers, the latest key findings and historical advances in a hot research area! Find out more on how to host your own Frontiers Research Topic or contribute to one as an author by contacting the Frontiers Editorial Office: researchtopics@frontiersin.org 2 October 2016 | Reward Processing in M otivational and Affective Disorders Frontiers in Psychology REWARD PROCESSING IN MOTIVATIONAL AND AFFECTIVE DISORDERS SUMA surface mapping of brain image Image: National Institute of Mental Health, National Institutes of Health, Department of Health and Human Services Topic Editors: Frank Ryan, Imperial College, UK Nikolina Skandali, University of Cambridge, UK Preferential reward processing is the hall- mark of addiction, where salient cues become overvalued and trigger compul- sion. In depression, rewards appear to lose their incentive properties or become devalued. In the context of schizophrenia, aberrations in neural reward signalling are thought to contribute to the overvaluation of irrelevant stimuli on the one hand and the onset of negative symptoms on the other. Accordingly, reward processing has emerged as a key variable in contemporary, evidence based, diagnostic frameworks, such as the Research Domain Criteria launched by the United States National Institute of Mental Health. Delineation of the underlying mechanisms of aberrant or blunted reward processing can be of trans-diagnostic importance across several neuropsychiat- ric disorders. Reward processing can become automatic thus raising the question of cognitive control, a core theme of this Topic, which aims at justifying the necessity of reward processing as a potential therapeutic target in clinical settings. Empirical and theoretical contributions on the following themes were expected to: * Explore new avenues of research by investigating the processing of rewards at the cognitive, behavioural, motivational, neural systems and individual difference levels. A developmental focus is promising in this regard, probing the core processes that shape reward processing and thus subsequent liability to motivational and affective disorders. * Develop and refine conceptual models of reward processing from computational neuroscience. * Promote greater understanding and development of emergent therapeutic approaches such as cognitive bias modification and behavioural approach or avoidance training. A key ques- tion is the feasibility of reversing or modifying maladaptive patterns of reward processing to therapeutic ends. 3 October 2016 | Reward Processing in M otivational and Affective Disorders Frontiers in Psychology * Refine and augment the evidential database for tried and tested therapies such as Contingency Management and Behavioural Activation by focusing on core cognitive processes mediating rewards. * Provide a potential dimensional approach for reward processing deficits that can be of trans-di- agnostic importance in clinically relevant disorders, including depression and addiction * Investigate the subjective experience of pleasure- the hedonic aspect of reward seeking and consumption – and how this can be distinguished from the motivational, sometimes compul- sive, component of reward pursuit. This promises more nuanced and effective interventions. Depression, for instance, could be seen as the restricted pursuit of pleasure rather than blunted pleasure experience; addiction can be viewed as accentuated drug seeking despite diminished consummatory pleasure. This aims to place motivation centre stage in both scenarios, empha- sising the transdiagnostic theme of the Topic. * Temporal discounting of future rewards, whereby smaller, more immediate rewards are chosen even when significantly more valuable deferred rewards are available, is another trans-diag- nostic phenomenon of interest in the in the present context. Factors that influence this, such as discounting of future reward are thought to reflect compulsion in the addictive context and hopelessness on the part of people experiencing depression. The executive cognitive processes that regulate this decision making are of both scientific and clinical significance. Empirical findings, theoretical contributions or commentaries bearing on cognitive or executive control were therefore welcome. Citation: Ryan, F., Skandali, N., eds. (2016). Reward Processing in Motivational and Affective Disorders. Lausanne: Frontiers Media. doi: 10.3389/978-2-88919-986-0 4 October 2016 | Reward Processing in M otivational and Affective Disorders Frontiers in Psychology Table of Contents 05 Editorial: Reward Processing in Motivational and Affective Disorders Frank Ryan and Nikolina Skandali 07 Measuring anhedonia: impaired ability to pursue, experience, and learn about reward Kristine Rømer Thomsen 18 Unifying treatments for depression: an application of the Free Energy Principle Adam M. Chekroud 26 The neuroscience of positive memory deficits in depression Daniel G. Dillon 38 Reduction in ventral striatal activity when anticipating a reward in depression and schizophrenia: a replicated cross-diagnostic finding Gonzalo Arrondo, Nuria Segarra, Antonio Metastasio, Hisham Ziauddeen, Jennifer Spencer, Niels R. Reinders, Robert B. Dudas, Trevor W. Robbins, Paul C. Fletcher and Graham K. Murray 50 The impact of threat of shock on the framing effect and temporal discounting: executive functions unperturbed by acute stress? Oliver J. Robinson, Rebecca L. Bond and Jonathan P . Roiser 59 Assessment of Tobacco-Related Approach and Attentional Biases in Smokers, Cravers, Ex-Smokers, and Non-Smokers Marcella L. Woud, Joyce Maas, Reinout W. Wiers, Eni S. Becker and Mike Rinck 70 Priming of conflicting motivational orientations in heavy drinkers: robust effects on self-report but not implicit measures Lisa C. G. Di Lemma, Joanne M. Dickson, Pawel Jedras, Anne Roefs and Matt Field 86 Embracing comorbidity: a way toward understanding the role of motivational and control processes in cannabis use disorders Janna Cousijn 91 The computational psychiatry of reward: broken brains or misguided minds? M. Moutoussis, G. W. Story and R. J. Dolan 100 A Computational Analysis of Aberrant Delay Discounting in Psychiatric Disorders Giles W. Story, Michael Moutoussis and Raymond J. Dolan EDITORIAL published: 30 August 2016 doi: 10.3389/fpsyg.2016.01288 Frontiers in Psychology | www.frontiersin.org August 2016 | Volume 7 | Article 1288 Edited and reviewed by: Gianluca Castelnuovo, Catholic University of the Sacred Heart, Italy *Correspondence: Frank Ryan f.ryan@imperial.ac.uk Specialty section: This article was submitted to Psychology for Clinical Settings, a section of the journal Frontiers in Psychology Received: 18 March 2016 Accepted: 12 August 2016 Published: 30 August 2016 Citation: Ryan F and Skandali N (2016) Editorial: Reward Processing in Motivational and Affective Disorders. Front. Psychol. 7:1288. doi: 10.3389/fpsyg.2016.01288 Editorial: Reward Processing in Motivational and Affective Disorders Frank Ryan 1 * and Nikolina Skandali 2 1 Centre for Mental Health, Division of Brain Sciences, Imperial College London, London, UK, 2 Department of Psychiatry, Behavioural and Clinical Neuroscience Institute, University of Cambridge, Cambridge, UK Keywords: reward, anhedonia, depression, schizophrenia, addiction, computational neuroscience, Bayesian models The Editorial on the Research Topic Reward Processing in Motivational and Affective Disorders Reward prediction and valuation are central to decision making (Schultz et al., 1997; O’Doherty, 2004), and thus motivate and guide human action. Faulty reward processing can be pragmatically viewed as compromised decision-making, reflected in making suboptimal choices. A primary aim of this Research Topic is to provide a dimensional approach for reward processing. In accordance with the Research Domain Criteria, a newly proposed research classification of mental health disorders based on behavioral dimensions and neurobiological findings (Insel et al., 2010), reward processing deficits can be of transdiagnostic importance. This prominence has been largely influenced by the evolution of novel neuroimaging techniques, experimental cognitive psychology findings, and the application of computational modeling in simulating human behavior. This body of work has increased knowledge of the neural mechanisms underlying aberrant reward processing. We maintain that construing patterns or expressions of reward processing as potential biomarkers, or indices of psychological vulnerability, can facilitate early detection and intervention in the clinical arena. Additionally, therapeutic approaches originating in the psychology laboratory aimed at modifying or reversing cognitive biases or behavioral approach biases linked to aberrant reward processes are showing promise in preventing relapse in the context of addiction (see Gladwin et al., 2016). It is this twin promise of enhanced prediction of vulnerability or risk and ultimately improved clinical outcomes, combined with a deeper understanding of brain functions, that motivated us to gather together this unique series of articles linked by the common thread of reward processing. The Topic includes four original articles exploring reward processing in schizophrenia, depression, addiction and in the context of stress or anxiety. These empirical contributions are complemented by three review articles, two theoretical contributions and an opinion piece. In tandem with laboratory findings, these more conceptual articles put emphasis on the role of the integrity of neuromodulatory systems implicated in reward processing as well as the remarkable insights that can be derived from the implementation of computational modeling. Rømer Thomsen, set the scene by outlining the subcomponents of reward processing: wanting, liking and learning. This parsing of reward processing enables a critical analysis of the concept of anhedonia, suggesting that deficits in reward processing are not restricted to “liking” (the subjective, pleasurable, experience of being rewarded). Other components, “wanting” and mechanisms underlying learning about rewards, can also be disrupted and contribute to the development and maintenance of disorders such as addiction and depression. 5 | Ryan and Skandali Reward Processing, Motivation, and Affect Arrondo et al. demonstrated blunted reward anticipation in people with a diagnosis of schizophrenia and depression. This attenuated striatal response to the prospect of monetary reward correlated with depressive symptoms in the schizophrenia group, but did not cohere with clinical symptoms of depression in the depressed cohort. Di Lemma et al. and colleagues found that, contrary to predictions, approach and avoidance tendencies following positive and negatively themed videos did change in parallel challenging the expectation that these are independent processes. Woud et al. investigated broadly similar processes investigating cohorts of current or former tobacco smokers. The researchers reported no attentional or behavioral approach biases in either current smokers, nicotine deprived smokers and ex- smokers, thus challenging incentive theories of addiction. These three innovative studies raise important questions for further research, and refine experimental methods in the process. Robinson et al. applied a stress manipulation paradigm in order to study the effect of acute stress on two well- established biases in decision-making, temporal discounting and the framing effect. The researchers observed mood alterations in response to experimentally induced stress, but no effects on decision-making processes. Acute stress impacted on low level “bottom–up” perceptual biases, but higher level executive processes were unperturbed. The findings support the application of psychotherapeutic approaches aiming to enhance cognitive control as an apparently resilient component of therapeutic intervention for affective disorders. Chekroud discussed the distortions in reward sensitivity and/or reward learning that contribute to the development of depression. He described the implementation of the free-energy principle, which views the brain as a “predictive machine,” aimed at reducing surprise (i.e., free energy) by constructing congruent cognitive models and optimizing actions. One potential clinical application is that changing cognitive representations using pharmacological agents or psychotherapy will be a necessarily gradual rather than immediate process. Also on the topic of depression, Dillon assigned a pivotal role to reward processing in the formation of long term memories. He concluded that impaired reward processing reflected distorted mesolimbic dopaminergic transmission, thus impeding the transfer of short-term memories into long-term episodic memory storage. Consequentially, in order to recover from depression, not only will somebody who is depressed need to overcome a memory bias for the recall of negative events, they will also struggle to recall positive events. Cousijn highlighted the role of fronto-parietal and limbic brain networks that are implicated in vulnerability to cannabis use disorders, other substance misuse disorders and increased risk of anxiety and depression. When these cognitive control systems are compromised individuals are more likely to reach out for immediately available rewards whether they are linked to substance use or the powerful negative reinforcement that occurs when emotional distress is alleviated by avoidance, thus increasing the possibility of anhedonia and depression. Moutoussis et al. differentiated between optimal decisions delivering the best possible rewards and a conceptualization of psychiatric disorder based on suboptimal reward processing. In this context, rewards are milestones or surrogates to strategic goals such as health, wellbeing and social affiliation. The researchers emphasized the importance of considering the patient’s autonomy by pointing out the need for the clinician to engage in a dialog to elicit the patient’s values and goals. Story et al. identified two factors involved in delayed reward discounting in psychiatric disorders: the opportunity cost that waiting for a delayed reward entails and the associated uncertainty of reward delivery. The theoretical insights and experimental findings presented in this topic justify further exploration of the mechanisms underlying the anticipation, valuation and pursuit of rewards. In tandem with this, adapting and applying these findings in clinical settings could, we believe, provide additional therapeutic benefit. AUTHOR CONTRIBUTIONS All authors listed, have made substantial, direct and intellectual contribution to the work, and approved it for publication. FUNDING Dr. NS is supported by a UK Medical Research Council Doctoral grant studentship. Dr. FR wishes to acknowledge the support and encouragement he received from his employer Camden & Islington NHS Foundation Mental Health Trust and the Centre for Mental Health, Imperial College. REFERENCES Gladwin, T. E., Wiers, C. E., and Wiers, R. W. (2016). Cognitive neuroscience of cognitive retraining for addiction medicine: from mediating mechanisms to questions of efficacy. Prog. Brain Res. 224, 323–344. doi: 10.1016/bs.pbr.2015.07.021 Insel, T., Cuthbert, B., Garvey, M., Heinssen, R., Pine, D. S., Quinn, K., et al. (2010). Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. Am. J. Psychiatry 167, 748–751. doi: 10.1176/appi.ajp.2010.09091379 O’Doherty, J. P. (2004). Reward representations and reward-related learning in the human brain: insights from neuroimaging. Curr. Opin. Neurobiol. 14, 769–776. doi: 10.1016/j.conb.2004.10.016 Schultz, W., Dayan, P., and Montague, P. R. (1997). A neural substrate of prediction and reward. Science 275, 1593–1599. Conflict of Interest Statement: The authors declare that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. Copyright © 2016 Ryan and Skandali. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. Frontiers in Psychology | www.frontiersin.org August 2016 | Volume 7 | Article 1288 6 | REVIEW published: 17 September 2015 doi: 10.3389/fpsyg.2015.01409 Edited by: Frank Ryan, Imperial College, UK Reviewed by: Richard J. Tunney, University of Nottingham, UK Mike J. F. Robinson, Wesleyan University, USA *Correspondence: Kristine Rømer Thomsen, Centre for Alcohol and Drug Research, Department of Psychology and Behavioural Sciences, Aarhus University, Bartholins Allé 10, 8000 Aarhus C, Denmark krt.crf@psy.au.dk Specialty section: This article was submitted to Psychology for Clinical Settings, a section of the journal Frontiers in Psychology Received: 29 May 2015 Accepted: 03 September 2015 Published: 17 September 2015 Citation: Rømer Thomsen K (2015) Measuring anhedonia: impaired ability to pursue, experience, and learn about reward. Front. Psychol. 6:1409. doi: 10.3389/fpsyg.2015.01409 Measuring anhedonia: impaired ability to pursue, experience, and learn about reward Kristine Rømer Thomsen* Centre for Alcohol and Drug Research, Department of Psychology and Behavioural Sciences, Aarhus University, Aarhus C, Denmark Ribot’s (1896) long standing definition of anhedonia as “the inability to experience pleasure” has been challenged recently following progress in affective neuroscience. In particular, accumulating evidence suggests that reward consists of multiple subcomponents of wanting, liking and learning, as initially outlined by Berridge and Robinson (2003), and these processes have been proposed to relate to appetitive, consummatory and satiety phases of a pleasure cycle. Building on this work, we recently proposed to reconceptualize anhedonia as “impairments in the ability to pursue, experience, and/or learn about pleasure, which is often, but not always accessible to conscious awareness.” (Rømer Thomsen et al., 2015). This framework is in line with Treadway and Zald’s (2011) proposal to differentiate between motivational and consummatory types of anhedonia, and stresses the need to combine traditional self- report measures with behavioral measures or procedures. In time, this approach may lead to improved clinical assessment and treatment. In line with our reconceptualization, increasing evidence suggests that reward processing deficits are not restricted to impaired hedonic impact in major psychiatric disorders. Successful translations of animal models have led to strong evidence of impairments in the ability to pursue and learn about reward in psychiatric disorders such as major depressive disorder, schizophrenia, and addiction. It is of high importance that we continue to systematically target impairments in all phases of reward processing across disorders using behavioral testing in combination with neuroimaging techniques. This in turn has implications for diagnosis and treatment, and is essential for the purposes of identifying the underlying neurobiological mechanisms. Here I review recent progress in the development and application of behavioral procedures that measure subcomponents of anhedonia across relevant patient groups, and discuss methodological caveats as well as implications for assessment and treatment. Keywords: anhedonia, reward, pleasure, motivation, learning, depression, schizophrenia, addiction Introduction The generally accepted understanding of the term anhedonia has remained almost unaltered since Ribot (1896) first defined it as the “inability to experience pleasure” over a century ago. However, during the last 5 years the term has been subject to debate and some progress has been made in terms of elucidating the underlying neurobiological mechanisms. A number of recent reviews (Treadway and Zald, 2011; Der-Avakian and Markou, 2012; Whitton et al., 2015), summarize Frontiers in Psychology | www.frontiersin.org September 2015 | Volume 6 | Article 1409 7 | Rømer Thomsen Measuring anhedonia this progress and offer improved understanding of the underlying neurobiology. However, their conceptual understanding of anhedonia diverge. Treadway and Zald (2011) made a convincing case to differentiate between motivational and consummatory types of anhedonia and introduced the term decisional anhedonia to emphasize the influence of anhedonic symptoms on decision- making. In contrast, Der-Avakian and Markou (2012) recently argued that deficits in motivational and decision-making processes (albeit disturbed, e.g., in depressed patients) should not be labeled under the umbrella of anhedonia. Overall, findings from affective neuroscience have challenged Ribot’s (1896) definition, which is restricted to subjectively experienced pleasure. Accumulating evidence suggests that reward consists of multiple subcomponents and processes of wanting, liking and learning (Robinson and Berridge, 2003; Berridge and Kringelbach, 2008) and these processes have been proposed to relate to appetitive, consummatory and satiety phases of a pleasure cycle (Kringelbach et al., 2012). Building on this work, we recently proposed to reconceptualize anhedonia as “impaired ability to pursue, experience and/or learn about pleasure, which is often, but not always accessible to conscious awareness” (Rømer Thomsen et al., 2015, p. 2). The parsing of reward into wanting, liking and learning components was originally introduced by Robinson and Berridge (1993) in their influential incentive sensitization theory of drug addiction. The theory has received support in animal and human studies of drug addiction (Vezina and Leyton, 2009; Leyton and Vezina, 2013) and recently also in terms of behavioral addiction like Gambling Disorder (Leyton and Vezina, 2012; Rømer Thomsen et al., 2014). In Robinson and Berridge’s taxonomy they differentiate between core reactions that are not necessarily conscious (“wanting,” “liking,” and “learning”) and their conscious counterparts (wanting, liking, and learning, i.e., denoted without quotation marks; Berridge and Robinson, 2003; Berridge and Kringelbach, 2008). In other words, reward can be parsed into three main components—motivation, hedonic impact and learning—and each of these components consist of both conscious and unconscious subcomponents (see Figure 1A ). For example, motivation consists of “(1) core incentive salience “wanting” processes that are not necessarily conscious (e.g., cue- triggered “wanting” for food or drugs) and (2) conscious desires for incentives or cognitive goals” (Berridge and Kringelbach, 2008, p. 2). Hedonic impact consists of “(1) core “liking” reactions that need not necessarily be conscious and (2) conscious experiences of pleasure, in the ordinary sense of the word, which may be elaborated out of core “liking” reactions by brain mechanisms of awareness” (Berridge and Kringelbach, 2008, p. 2). Similarly, learning (or learned predictions) include “(1) implicit knowledge as well as associative conditioning, such as basic pavlovian and instrumental associations and (2) explicit and cognitive predictions” (Berridge and Kringelbach, 2008, p. 2). The subcomponents of reward constantly interact through the appetitive, consummatory and satiety phases of a pleasure cycle, but can be teased apart using systematic scientific analysis. Self- report measures can help identify the conscious components (wanting, liking, and learning) and provide valuable information on this level of processing. However, self-report measures are of course limited in their ability to capture unconscious processes, as well as in their ability to parse out contributions that may have been made by any of the unconscious processes, considering that these processes interact strongly together. In contrast, behavioral procedures from animal studies provide useful markers of the core “wanting,” “liking,” and “learning” reactions ( Figure 1B ). For example, “liking” reactions have been studied in rodents by measuring the affective orofacial expressions that are elicited in response to sweet tastes (Pfaffmann et al., 1977; Grill and Norgren, 1978a,b), and a number of procedures have been developed to study “wanting” in rodents, e.g., by measuring the effort exerted to obtain rewards (Salamone et al., 2007) or the ability of reward- related cues to act as motivational magnets (Wyvell and Berridge, 2000). In recent years, some of these animal models have been successfully translated to human studies and provide valuable behavioral measures of subcomponents of reward, which can complement traditional self-report measures ( Figure 1C ). Overall, findings from animal and human studies applying these types of measures support the view that reward is a complex process consisting of several psychological components that correspond to partly dissociable neurobiological mechanisms (Berridge and Robinson, 2003; Berridge and Kringelbach, 2008, 2015). For example, there is strong evidence that dopamine plays an important role in “wanting,” but not in “liking” reactions. In animal and human studies where “wanting” and “liking” reactions have been systematically teased apart, specific manipulation of dopamine signaling has failed to shift “liking” reactions to rewards (Berridge and Valenstein, 1991; Peciña et al., 2003; Ward et al., 2012). In contrast, there is accumulating evidence that dopamine plays an important role in “wanting” processes. For example, elevation of dopamine has been shown to increase willingness to work for a food reward in rodents (Bardgett et al., 2009), while dopamine attenuation or blockade has the opposite effect (Cousins and Salamone, 1994; Salamone et al., 2007). Similarly, evidence from human studies suggests that amphetamine/L- Dopa-induced elevated dopamine increases subjective ratings of drug wanting, but not subjective ratings of drug liking during consumption (Leyton et al., 2002, 2007; Liggins et al., 2012). Recently, Wardle et al. (2011) provided evidence that elevated levels of dopamine increase willingness to work for reward in humans using a behavioral measure. Building on the framework set forward by Berridge and Robinson (2003) suggesting that reward consists of multiple subcomponents of wanting, liking, and learning and recent proposals relating these processes to the appetitive, consummatory and satiety phases of a pleasure cycle (Kringelbach et al., 2012), we recently proposed to reconceptualize anhedonia as “impairments in the ability to pursue, experience and/or learn about pleasure” (Rømer Thomsen et al., 2015, p. 2). In this conceptualization of anhedonia, impairments in each of the subcomponents can lead to a malfunctioning pleasure system. Normally, wanting, liking, and learning processes are balanced over time, however this balance can be compromised by impairments in each of the components. Depending on which of the subcomponents are most affected, and how the components are affected, this can lead to distinct subtypes of anhedonia, that are associated with distinct imbalances of the pleasure system Frontiers in Psychology | www.frontiersin.org September 2015 | Volume 6 | Article 1409 8 | Rømer Thomsen Measuring anhedonia FIGURE 1 | Measuring anhedonia. (A) Anhedonia is linked to problems with the complex and multifaceted psychological processes involved in reward processing. These include explicit processes of wanting, liking, and learning that are consciously perceived, and their implicit counterparts (denoted with quotation marks in the text) that are potentially unconscious, i.e., they can operate at a level not always accessible to conscious awareness. These components constantly interact and require careful scientific analysis to tease apart. Animal studies have provided measurements or behavioral procedures that are especially sensitive markers of each of the potentially unconscious processes (“wanting,” “liking,” and “learning”). Recently, some of these procedures have been successfully translated to human studies, thereby providing more objective behavioral measures to aid subjective self-report measures. In particular, recent developments of behavioral measures of “wanting” and “learning” are promising, while bias-free measures of “liking” reactions in humans have proven more difficult. (B,C) Examples of how a measure of “wanting” has been successfully translated from animal to human studies. (B) In animal studies, “wanting” can be measured by looking at how willing the animal is to exert effort in exchange for more palatable food rewards, for example by using a choice paradigm devised to look at effort-based decision-making (Salamone et al., 1994). (C) In human studies, “wanting” can be measured similarly, by looking at how much a participant is willing to work for a reward, for example by combining salient stimuli with key-press/force-grip procedures. The first study of this kind used key-presses to operationalize “wanting” as the effort participants exerted to increase or decrease viewing time of images of salient faces on a screen (Aharon et al., 2001). OFC, orbitofrontal cortex; ACC, anterior cingulate cortex; vmPFC, ventromedial prefrontal cortex; NAc, nucleus accumbens; PAG, periaqueductal gray; VP, ventral pallidum; VTA, ventral tegmental area; ACh, Acetylcholine; PIT, pavlovian instrumental transfer; EEfRT, effort expenditure for rewards task. Figure and figure legend modified and reprinted with permission from Frontiers in Behavioral Neuroscience (Rømer Thomsen et al., 2015). (Rømer Thomsen et al., 2015). For example, patients suffering from major depressive disorder often describe a diminished ability to pursue and experience pleasure, i.e., a progressive decrease in some (or all) of the reward components. In contrast, drug addiction can be characterized by excessive wanting for the drug of choice, which grows over time independently of drug liking. While anhedonia has traditionally been conceived as diminished responses (typically, diminished subjectively experienced pleasure), “our proposed framework acknowledges that both too much and too little activity in specific parts of the pleasure system can lead to pathological changes. This is for example illustrated in the excessive wanting for drugs in drug addiction or in disorders with hypersexuality” (Rømer Thomsen et al., 2015, p. 15). It is important to note, that in this terminology (Rømer Thomsen et al., 2015) pleasure and pleasure system is not restricted Frontiers in Psychology | www.frontiersin.org September 2015 | Volume 6 | Article 1409 9 | Rømer Thomsen Measuring anhedonia to hedonic impact, but is instead used to encompass all of the phases of reward processing. This is in contrast to the dominating terminology, where pleasure is restricted to the hedonic impact of a reward, while reward is used to encompass all of the reward- related processes (see, e.g., Berridge and Kringelbach, 2008). In an attempt to avoid misunderstandings, I have changed the wording of our definition in the present paper to reflect the dominating terminology. Hence, anhedonia is defined here as “impairments in the ability to pursue, experience, and/or learn about reward .” In line with our proposed reconceptualization of anhedonia, there has been a growing bulk of evidence suggesting that reward processing deficits are not restricted to impaired hedonic impact in psychiatric disorders typically associated with anhedonia. Findings from the past 5 years suggest that motivational and learning processes are impaired, e.g., in patients suffering from major depressive disorder (subsequently referred to as depression) and schizophrenia (Treadway and Zald, 2011; Fervaha et al., 2013b; Rømer Thomsen et al., 2015; Whitton et al., 2015). Part of this work is based on successful translations of animal models, thereby paving the way for validated behavioral paradigms that can supplement traditional self-report measures. These efforts are exciting and hold promise in terms of elucidating the role of subcomponents of anhedonia and the underlying neurobiological mechanisms across major psychiatric disorders. Here I review recent progress in the development and application of behavioral procedures that measure subcomponents of anhedonia in relevant patient groups (including patients suffering from depression, schizophrenia and addiction) and discuss implications for clinical assessment and treatment. Measuring Subcomponents of Anhedonia In line with the generally accepted understanding of anhedonia as “decreased subjective experience of pleasure” [as per Ribot’s (1896) definition], the most popular way of measuring anhedonia has been self-report scales or questionnaires like The Fawcett–Clark Pleasure Scale (FCPS; Fawcett et al., 1983) or The Snaith–Hamilton Pleasure Scale (SHAPS; Snaith et al., 1995). The majority of these instruments are restricted to measuring subjective experiences of hedonic impact (i.e., liking), but some of the more recently developed questionnaires also include aspects of reward motivation (i.e., wanting). For example, The Temporal Experience of Pleasure Scale (TEPS; Gard et al., 2006) differentiates between anticipatory and consummatory experiences of pleasure, and The Sensitivity To Reinforcement of Addictive and other Primary Rewards (STRAP-R; Goldstein et al., 2010) measures liking and wanting of drug and non-drug rewards under various situations (e.g., current and hypothetical). Building on Robinson and Berridge’s incentive sensitization theory (Robinson and Berridge, 1993; Robinson et al., 2013), Lende (2005) developed a short Incentive Salience Scale that measures key aspects of drug wanting and has been used to predict addiction status. While these instruments provide useful information about the conscious components of anhedonia, they are of course limited in their ability to capture unconscious components. Similar to research on reward (Berridge and Robinson, 2003; Berridge and Kringelbach, 2008), it is crucial to differentiate between conscious and unconscious components of anhedonia (Rømer Thomsen et al., 2015). Accumulating evidence suggests that we do not always know what motivates our behavior or brings us pleasure (Aharon et al., 2001; Winkielman et al., 2005; Moeller et al., 2009; Parsons et al., 2011), and there is convincing evidence that reward (also) affects our behavior on an unconscious level (Winkielman et al., 2005; Pessiglione et al., 2007, 2008; Aarts et al., 2008). During the last 5 years a number of validated and useful behavioral procedures have been developed that can be used to measure impairments in the described subcomponents of reward ( Figure 1 ). Of particular relevance are recent developments in behavioral procedures that can be used to measure impairments in the ability to pursue and learn about reward. Impaired Ability to Pursue Reward A large number of animal models have been developed to study motivational processes by looking at behavior related to obtainment of rewards such as food. Of particular relevance here are models of the effort exerted to obtain rewards [e.g., by measuring how eagerly the animal runs for rewards in a runway (Berridge and Valenstein, 1991; Peciña et al., 2003) or its willingness to exert effort in exchange for more palatable food rewa