AvoidAnce: From BAsic science to PsychoPAthology edited by : Richard J. Servatius, Kevin C. H. Pang, Gregory J. Quirk and Catherine e. Myers PubliSHed in : Frontiers in behavioral neuroscience 1 May 2016 | Avoidance: From basic Science to Psychopathology Frontiers in behavioral neuroscience Frontiers Copyright Statement © Copyright 2007-2016 Frontiers Media SA. All rights reserved. All content included on this site, such as text, graphics, logos, button icons, images, video/audio clips, downloads, data compilations and software, is the property of or is licensed to Frontiers Media SA (“Frontiers”) or its licensees and/or subcontractors. The copyright in the text of individual articles is the property of their respective authors, subject to a license granted to Frontiers. The compilation of articles constituting this e-book, wherever published, as well as the compilation of all other content on this site, is the exclusive property of Frontiers. For the conditions for downloading and copying of e-books from Frontiers’ website, please see the Terms for Website Use. If purchasing Frontiers e-books from other websites or sources, the conditions of the website concerned apply. Images and graphics not forming part of user-contributed materials may not be downloaded or copied without permission. Individual articles may be downloaded and reproduced in accordance with the principles of the CC-BY licence subject to any copyright or other notices. They may not be re-sold as an e-book. As author or other contributor you grant a CC-BY licence to others to reproduce your articles, including any graphics and third-party materials supplied by you, in accordance with the Conditions for Website Use and subject to any copyright notices which you include in connection with your articles and materials. All copyright, and all rights therein, are protected by national and international copyright laws. The above represents a summary only. For the full conditions see the Conditions for Authors and the Conditions for Website Use. iSSn 1664-8714 iSbn 978-2-88919-828-3 dOi 10.3389/978-2-88919-828-3 About Frontiers Frontiers is more than just an open-access publisher of scholarly articles: it is a pioneering approach to the world of academia, radically improving the way scholarly research is managed. The grand vision of Frontiers is a world where all people have an equal opportunity to seek, share and generate knowledge. Frontiers provides immediate and permanent online open access to all its publications, but this alone is not enough to realize our grand goals. Frontiers Journal Series The Frontiers Journal Series is a multi-tier and interdisciplinary set of open-access, online journals, promising a paradigm shift from the current review, selection and dissemination processes in academic publishing. All Frontiers journals are driven by researchers for researchers; therefore, they constitute a service to the scholarly community. At the same time, the Frontiers Journal Series operates on a revolutionary invention, the tiered publishing system, initially addressing specific communities of scholars, and gradually climbing up to broader public understanding, thus serving the interests of the lay society, too. dedication to Quality Each Frontiers article is a landmark of the highest quality, thanks to genuinely collaborative interactions between authors and review editors, who include some of the world’s best academicians. Research must be certified by peers before entering a stream of knowledge that may eventually reach the public - and shape society; therefore, Frontiers only applies the most rigorous and unbiased reviews. Frontiers revolutionizes research publishing by freely delivering the most outstanding research, evaluated with no bias from both the academic and social point of view. By applying the most advanced information technologies, Frontiers is catapulting scholarly publishing into a new generation. What are Frontiers Research topics? Frontiers Research Topics are very popular trademarks of the Frontiers Journals Series: they are collections of at least ten articles, all centered on a particular subject. With their unique mix of varied contributions from Original Research to Review Articles, Frontiers Research Topics unify the most influential researchers, the latest key findings and historical advances in a hot research area! Find out more on how to host your own Frontiers Research Topic or contribute to one as an author by contacting the Frontiers Editorial Office: researchtopics@frontiersin.org 2 May 2016 | Avoidance: From basic Science to Psychopathology Frontiers in behavioral neuroscience Coping has a myriad of facets: knowledge concerning the circumstances of threats to emotional and physical well being, the ability to meet immediate needs to mitigate, the potential for recurrence, the ability to apply efforts and resources to manage recurrence, and the complex assessment of competing motivations and changing circumstances. Successful coping is measured in the efficiency of efforts in balance with the degree of threat and likelihood of future occurrence. As one means of coping, avoidance encompass thoughts and efforts toward prevention of future aversive experiences and events. Anxiety disorders exemplify an extreme bias toward avoidance. A diathesis learning model focuses research efforts on individual vulnerabilities to acquire and express avoidance, the neurobiology of avoidance learning and its attendant circuitry. A fundamental understanding of avoidance through a diathesis learning model offers will facilitate the development of effective treatment protocols in alleviating anxiety disorders. Citation: Servatius, R. J., Pang, K. C. H., Quirk, G. J., Myers, C. E., eds. (2016). Avoidance: From Basic Science to Psychopathology. Lausanne: Frontiers Media. doi: 10.3389/978-2-88919-828-3 AvoidAnce: From BAsic science to PsychoPAthology Topic Editors: Richard J. Servatius, Syracuse VA Medical Center, Syracuse and Rutgers University-Rutgers Biomedical Health Sciences, USA Kevin C. H. Pang, New Jersey Health Care System and Rutgers University-Rutgers Biomedical Health Sciences, USA Gregory J. Quirk, University of Puerto Rico School of Medicine, USA Catherine E. Myers, New Jersey Health Care System and Rutgers University-Rutgers Biomedical Health Sciences, USA 3 May 2016 | Avoidance: From basic Science to Psychopathology Frontiers in behavioral neuroscience Table of Contents 05 Editorial: Avoidance: From Basic Science to Psychopathology Richard J. Servatius 09 Avoidance learning: a review of theoretical models and recent developments Angelos-Miltiadis Krypotos, Marieke Effting, Merel Kindt and Tom Beckers 25 Avoidance as expectancy in rats: sex and strain differences in acquisition Pelin Avcu, Xilu Jiao, Catherine E. Myers, Kevin D. Beck, Kevin C. H. Pang and Richard J. Servatius 33 Avoidance expression in rats as a function of signal-shock interval: strain and sex differences Richard J. Servatius, Pelin Avcu, Nora Ko, Xilu Jiao, Kevin D. Beck, Thomas R. Minor and Kevin C. H. Pang 43 Contribution of emotional and motivational neurocircuitry to cue-signaled active avoidance learning Anton Ilango, Jason Shumake, Wolfram Wetzel and Frank W. Ohl 48 Persistent active avoidance correlates with activity in prelimbic cortex and ventral striatum Christian Bravo-Rivera, Ciorana Roman-Ortiz, Marlian Montesinos-Cartagena and Gregory J. Quirk 56 Altered activity of the medial prefrontal cortex and amygdala during acquisition and extinction of an active avoidance task Xilu Jiao, Kevin D. Beck, Catherine E. Myers, Richard J. Servatius and Kevin C. H. Pang 66 The role of the hippocampus in avoidance learning and anxiety vulnerability Tara P. Cominski, Xilu Jiao, Jennifer E. Catuzzi, Amanda L. Stewart and Kevin C. H. Pang 76 Effects of psychotropic agents on extinction of lever-press avoidance in a rat model of anxiety vulnerability Xilu Jiao, Kevin D. Beck, Amanda L. Stewart, Ian M. Smith, Catherine E. Myers, Richard J. Servatius and Kevin C. H. Pang 88 ITI-signals and prelimbic cortex facilitate avoidance acquisition and reduce avoidance latencies, respectively, in male WKY rats Kevin D. Beck, Xilu Jiao, Ian M. Smith, Catherine E. Myers, Kevin C. H. Pang and Richard J. Servatius 104 Absence of “warm-up” during active avoidance learning in a rat model of anxiety vulnerability: insights from computational modeling Catherine E. Myers, Ian M. Smith, Richard J. Servatius and Kevin D. Beck 4 May 2016 | Avoidance: From basic Science to Psychopathology Frontiers in behavioral neuroscience 119 Not so bad: avoidance and aversive discounting modulate threat appraisal in anterior cingulate and medial prefrontal cortex Michael W. Schlund, Adam T. Brewer, David M. Richman, Sandy K. Magee and Simon Dymond 133 Avoidance prone individuals self reporting behavioral inhibition exhibit facilitated acquisition and altered extinction of conditioned eyeblinks with partial reinforcement schedules Michael Todd Allen, Catherine E. Myers and Richard J. Servatius 142 Generalization of socially transmitted and instructed avoidance Gemma Cameron, Michael W. Schlund and Simon Dymond 157 Acquisition and extinction of human avoidance behavior: attenuating effect of safety signals and associations with anxiety vulnerabilities Jony Sheynin, Kevin D. Beck, Richard J. Servatius and Catherine E. Myers 168 The influence of trial order on learning from reward vs. punishment in a probabilistic categorization task: experimental and computational analyses Ahmed A. Moustafa, Mark A. Gluck, Mohammad M. Herzallah and Catherine E. Myers 183 Medial amygdala lesions selectively block aversive Pavlovian–instrumental transfer in rats Margaret G. McCue, Joseph E. LeDoux and Christopher K. Cain 197 Enhanced discriminative fear learning of phobia-irrelevant stimuli in spider- fearful individuals Carina Mosig, Christian J. Merz, Cornelia Mohr, Dirk Adolph, Oliver T. Wolf, Silvia Schneider, Jürgen Margraf and Armin Zlomuzica 208 Neonatal handling decreases unconditioned anxiety, conditioned fear, and improves two-way avoidance acquisition: a study with the inbred Roman high (RHA-I)- and low-avoidance (RLA-I) rats of both sexes Cristóbal Río- ̇ Alamos, Ignasi Oliveras, Toni Cañete, Gloria Blázquez, Esther Martínez-Membrives, Adolf Tobeña and Alberto Fernández-Teruel 221 Pyrazine analogs are active components of wolf urine that induce avoidance and fear-related behaviors in deer Kazumi Osada, Sadaharu Miyazono and Makoto Kashiwayanagi EDITORIAL published: 12 February 2016 doi: 10.3389/fnbeh.2016.00015 Frontiers in Behavioral Neuroscience | www.frontiersin.org February 2016 | Volume 10 | Article 15 | Edited and reviewed by: Nuno Sousa, University of Minho, Portugal *Correspondence: Richard J. Servatius richard.servatius@va.gov Received: 08 January 2016 Accepted: 28 January 2016 Published: 12 February 2016 Citation: Servatius RJ (2016) Editorial: Avoidance: From Basic Science to Psychopathology. Front. Behav. Neurosci. 10:15. doi: 10.3389/fnbeh.2016.00015 Editorial: Avoidance: From Basic Science to Psychopathology Richard J. Servatius * Neuroscience, Syracuse DVA Medical Center, Stress and Motivated Behavior Institute, Rutgers Biomedical Health Sciences, Newark, NJ, USA Keywords: avoidance learning, anxiety disorders, depressive disorder, research domain criteria, expectancy, animal models of mental disorders, association learning, escape The Editorial on the Research Topic Avoidance: From Basic Science to Psychopathology As a means of coping, avoidance encompasses thoughts and efforts toward prevention of future aversive experiences and events. Avoidance has been and remains controversial. Avoidance is accepted as a construct in many areas of research, but is roundly disdained in others. Why is such a critical feature of coping both acknowledged as such, but almost reluctantly studied? For one, avoidance is often conflated with fear. Fear is an emotion. Threat conditions which engender fear also engender a host of physiological and behavioral responses (Ledoux, 2013). In animals, exposure to aversive stimuli or cues associated with aversive stimuli induce freezing, fleeing, or aggressive displays depending on the context of exposure—all behavioral manifestations of threat (Osada et al.). Responses to threat are relatively simple, engendered and refined through a circumscribed neural circuitry (Ledoux and Muller, 1997; Delgado et al., 2008). Fear and defensive responses to threat are readily and almost universally acquired. Those under threat (Shors and Servatius, 1997), stress (Servatius and Shors, 1994), and fearful (Mosig et al.) have a generalized facilitation of associative learning making threat and fear more pervasive. The engendering of fear and its expression is a highly researched concept; advancements in fear and the neurobiology subsuming fear is among the most notable and exhaustive neurobiological achievements in the past half century. By comparison, avoidance is a fairly sophisticated construct. Avoidance is the situational evaluation of likelihoods, efficacy of responses, and costs. Avoidance is often weighed against alternatives; alternatives with differing or competing motivations (Beck et al., 2011; Fernando et al., 2014; Ilango et al.; Sheynin et al.). For many applications and circumstances fear and avoidance seem to be inseparable, so the terms become conflated. In the vernacular, fear is an immediate response to stressors and fear motivates avoidance. Therefore, in many circumstances those avoiding are expected to be experiencing fear. However, the empirical literature provides ample evidence that the processes are distinct (Bolles, 1968; Seligman and Johnston, 1973; Rio-Alamos et al.) and while the neurocircuitry, such as the lateral habenula (Shumake et al., 2010; Ilango et al., 2013) and cerebellum (Steinmetz et al., 1993) overlaps (Freeman et al., 1996, 1997; Bravo-Rivera et al., 2014; Campese et al.; McCue et al.; Jiao et al.), their influences on these processes potentially do not. Further distinguishing fear and threat from avoidance, septal (Thomas and Van Atta, 1972; Hedges et al., 1975) and hippocampal lesions (Cominski et al.) are known to facilitate avoidance acquisition, whereas these brain regions are critically involved in fear conditioning when intact (Kim et al., 1993; Desmedt et al., 1998; Knight et al., 2004). As a research topic, avoidance all but disappeared through the 1990’s, a phenomenon that has been noted in a number of recent reviews (Dymond and Roche, 2009; Krypotos et al.). Reduction in the study of avoidance stemmed from theoretical and practical considerations. In humans, the rise of institutional review boards and the reluctance of institutions and investigators to study reactions to aversive, painful stimulation or uncomfortable situations stymied progress. Added to 5 Servatius Avoidance: From Basic Science to Psychopathology these concerns, there were growing controversies regarding the role of awareness and instructional sets in human associative learning. Explicit information stemming from the consent form and instructions complicated experimental designs and interpretations of acquisition. Now there are but a few laboratories across the world with a vested interest in studying avoidance acquisition and extinction in humans, the TOPIC highlights several (Myers et al., 2013; Schlund et al., 2013; Sheynin et al., 2015; Cameron et al.; Moustafa et al.). Otherwise, avoidance and coping are primarily studied through self-report survey instruments which document coping strategies (Snell et al., 2011; Ayers et al., 2014). In animals, the meteoric rise of electrophysiological and molecular techniques made reductionistic procedures ever more popular. This was in the face of Bolles formulation of species specific defense reactions (SSDRs) (Bolles, 1970). A reading of Bolles strongly suggests that the most popular applications of avoidance learning in animals were reducible to reflexes. Avoidance that relied on SSDRs would be difficult to distinguish from fear responses or their modification and would be better studied in clearer procedures. Bolles did not negate avoidance learning, but argued that avoidance was obscured by SSDRs and arbitrary avoidances provided clear evidence of avoidance, which would be slowly and incrementally acquired. The Bolles position muddled already difficult discussions concerning reinforcement in avoidance acquisition (Bersh, 2001; Dinsmoor, 2001; Hineline, 2001). The many criticisms of avoidance learning and its proper interpretation became more and more inaccessible to the average reader and more esoteric in argument. The zeitgeist is avoidance responses either a SSDR or require the suppression of SSDRs. SSDRs reflect fear and fear is more clearly examined in freezing (Fanselow and Poulos, 2005) or by examining its exaggeration of acoustic startle responses (Davis, 2006) under conditions in which control procedures are established to reveal associativity. Although arbitrary responses provide clear evidence of avoidance (Avcu et al.; Bravo-Rivera et al., 2014; Servatius et al.), these procedures became more and more unpopular. An increase in demand for throughput (self-contained, relatively short, and easily scored procedures) is at odds with the seemingly slow development of avoidance. In an unfortunate happenchance, “passive avoidance” remains in the parlance of behavioral neuroscience, but the high-throughput tasks and protocols to study “passive avoidance” are essentially assessing punishment. Modern theorists of avoidance have moved away from response dynamics to cognitive processes driving response dynamics. Humans and mammals form expectancies. Avoidance expression reflects propositional knowledge but also the context in which knowledge is to be expressed (Seligman and Johnston, 1973; Lovibond et al., 2008, 2009; Dymond and Roche, 2009). Knowledge is subject to error and error correction (Myers et al.; Sheynin et al.). The difficulties encountered in learning arbitrary responses may not rest in how unnatural such responses are to humans and animals (Dinsmoor, 2001), but in the pressures of time/distance (Fanselow and Lester, 1988) and a cost/benefit analysis. There is a need for conceptual bridges between propositional knowledge central to expectancy models of avoidance and animal research in which processes are resolvable to response dynamics (response selectivity, strength of responding, and probability of responding; Krypotos et al.). Recently, the National Institute of Mental Health (NIMH) in the United States embarked on research domain criteria (RDoC) to facilitate integration across levels of analysis and between diagnostic boundaries. The Negative Valence System encompasses acute responses to threat (fear) and inferred threat (anxiety), with escape/avoidance learning and expression emerging with sustained threat. In the NIMH working group discussion, ambivalence was expressed concerning whether sustained threat is distinct from acute threat, except for the time dimension. An undercurrent is that the sustained threat dimension, and by implication avoidance and escape, is not distinctive of acute conditions. The bounding conditions of avoidance are not only the duration of threat (acute/sustained), but the perceived intensity of threat, its perceived proximity, and the utility of responses or efforts. For perceived proximity of time, parametric manipulations of signal-shock intervals illustrate this point. Shuttling as the requisite response (a modified SSDR) is efficiently acquired with CS-US intervals of 10–20 s (Black, 1963). In lever press (not an SSDR) avoidance, escape behaviors predominate when signal-shock intervals are less than 20-s (Berger and Brush, 1975), with very few avoidance responses expressed after days of training (Servatius et al.). However, knowledge about avoidance is acquired; avoidance is not expressed (Servatius et al.). Using a crossover design those trained with a 10-s warning signal and exhibiting nominal avoidance rates displayed greater than 60% avoidance when switched to 60-s warning signal—nearly asymptotic performance of those trained initially with a 60-s warning signal. As to stressor intensity, shuttle box avoidance is efficiently acquired with foot shocks of moderately low intensity (0.2–0.5 mA) (Levine, 1966) with decrements apparent with shock intensity greater than 1.0 mA (Moyer and Korn, 1964). In contrast, lever press avoidance is efficiently acquired with shock intensities of 1.0– 2.0 mA (Berger and Brush, 1975; Servatius et al., 2008; Avcu et al.). These features illustrate that avoidance acquired with arbitrary responses differ in a number of parameters from those modifying reflexive responses or “natural” responses, which are in turn distinct from fear responses. On the other hand, recent work also shows fear is more nuanced as fear contributes to sustained processes such as foraging (Kim et al., 2014). In subsequent position papers concerning RDoCs, fear and threat processes feature prominently, whereas avoidance and coping do not (Cuthbert et al., 2003; Insel et al., 2010; Cuthbert, 2015). This is indeed unfortunate. An opportunity to intensify efforts in avoidance research is being missed. The mental health implications are extensive. Psychologically healthy coping strikes a balance between avoidance (responding in anticipation of aversive stimulation) and escape (responding in the presence of the stimulation) and competing motivations of approach (Ilango et al.; Ilango et al.). Deviant forms of avoidance are evident in autism (Richer, 1976), anxiety (Ly and Roelofs, 2009); (Kashdan et al., 2014), phobias, posttraumatic stress disorder (PTSD; North et al., 2004; Kashdan et al., 2009), major depression (Ottenbreit et al., 2014) and suicide (Dixon et al., 1991). Frontiers in Behavioral Neuroscience | www.frontiersin.org February 2016 | Volume 10 | Article 15 | 6 Servatius Avoidance: From Basic Science to Psychopathology Over-expression of avoidance, as in anxiety disorders and PTSD, insulates one from aversive thoughts or experiences at the expense of self-limiting interpersonal and environmental interactions. Under-expression of avoidance, as in depression or suicidality, unduly exposes one to aversive thoughts and experiences that would be otherwise controllable, severely depleting resources and progressing down a demoralizing spiral. Diathesis models of mental illness capture avoidance biases as dynamic interactions of vulnerabilities (genes, epigenetics, personality, and developmental phases) with risk factors (psychological stressors, physical injuries) ultimately expressed as psychopathology. For example, behaviorally inhibited temperament, withdrawal in the face of social and nonsocial challenges, is a vulnerability factor for anxiety disorders (Moffitt et al., 2007). Humans expressing behavioral inhibition (BI) display enhanced avoidance expression (Sheynin et al.), and enhanced new motor learning (Caulfield et al.; Holloway et al., 2014), especially under degraded contingencies (Holloway et al., 2014; Allen et al.). Facilitated avoidance acquisition (Avcu et al.; Beck et al.; Jiao et al.; Servatius et al.) and new motor learning (Ricart et al., 2011a,b) are also apparent in Wistar-Kyoto rats, an animal model of BI temperament. Further, avoidance extinction is typically more difficult to obtain than extinction of fear. This is likely amplified by individual differences (Avcu et al.; Cominski et al.). Uncovering of neurobiological processes biasing avoidance expression and extinction has the promise of providing targets for individualized therapeutics and treatments for a number of psychopathological disorders. Hence, there continues to be a need for an integration of human and animal research focused on coping and in particular avoidance coping. Model systems of avoidance that allow for bidirectional modifications of acquisition, expression, and extinction—protocols that allow for increased as well as decreased expression—are useful in translating basic science to psychopathology. By extension, RDoC constructs should be sensitive to individual differences, both accentuating and diminishing in the appearance of avoidance. An open discussion of what features constitute fear, threat, anxiety, and avoidance would not only benefit basic science and psychopathology, but areas of research that are otherwise ignoring the infighting and are making substantial progress in improving health (e.g., fear-avoidance model of pain Vlaeyen et al., 1995; Crombez et al., 2012). Approach Avoidance: Have no fear! AUTHOR CONTRIBUTIONS The author confirms being the sole contributor of this work and approved it for publication. FUNDING Supported by the Stress and Motivated Behavior Institute through funding from the Department of Defense, Armaments Research Development Engineering Center. REFERENCES Ayers, C. R., Castriotta, N., Dozier, M. E., Espejo, E. P., and Porter, B. (2014). Behavioral and experiential avoidance in patients with hoarding disorder. J. Behav. Ther. Exp. Psychiatry 45, 408–414. doi: 10.1016/j.jbtep.2014. 04.005 Beck, K. D., Jiao, X., Ricart, T. M., Myers, C. E., Minor, T. R., Pang, K. C., et al. (2011). Vulnerability factors in anxiety: strain and sex differences in the use of signals associated with non-threat during the acquisition and extinction of active-avoidance behavior. Prog. Neuropsychopharmacol. Biol. Psychiatry 35, 1659–1670. doi: 10.1016/j.pnpbp.2011.05.002 Berger, D. F., and Brush, F. R. (1975). Rapid acquisition of discrete-trial lever-press avoidance: effects of signal-shock interval. J. Exp. Anal. Behav. 24, 227–239. doi: 10.1901/jeab.1975.24-227 Bersh, P. J. (2001). The molarity of molecular theory and the molecularity of molar theory. J. Exp. Anal. Behav. 75, 348–350; discussion: 367–378. doi: 10.1901/jeab.2001.75-348 Black, A. H. (1963). The effects of CS-US interval on avoidance conditioning in the rat. Can. J. Psychol. 17, 174–182. Bolles, R. C. (1968). Autonomic indices of fear: the collapse of an idea. Psychol. Rep. 23, 1249–1250. doi: 10.2466/pr0.1968.23.3f.1249 Bolles, R. C. (1970). Species-specific defense reactions and avoidance learning. Psychol. Rev. 77, 32. doi: 10.1037/h0028589 Bravo-Rivera, C., Roman-Ortiz, C., Brignoni-Perez, E., Sotres-Bayon, F., and Quirk, G. J. (2014). Neural structures mediating expression and extinction of platform-mediated avoidance. J. Neurosci. 34, 9736–9742. doi: 10.1523/JNEUROSCI.0191-14.2014 Crombez, G., Eccleston, C., Van Damme, S., Vlaeyen, J. W., and Karoly, P. (2012). Fear-avoidance model of chronic pain: the next generation. Clin. J. Pain 28, 475–483. doi: 10.1097/AJP.0b013e3182385392 Cuthbert, B. N. (2015). Research Domain Criteria: toward future psychiatric nosologies. Dialogues Clin. Neurosci. 17, 89–97. Cuthbert, B. N., Lang, P. J., Strauss, C., Drobes, D., Patrick, C. J., and Bradley, M. M. (2003). The psychophysiology of anxiety disorder: fear memory imagery. Psychophysiology 40, 407–422. doi: 10.1111/1469-8986.00043 Davis, M. (2006). Neural systems involved in fear and anxiety measured with fear- potentiated startle. Am. Psychol. 61, 741–756. doi: 10.1037/0003-066X.61.8.741 Delgado, M. R., Nearing, K. I., Ledoux, J. E., and Phelps, E. A. (2008). Neural circuitry underlying the regulation of conditioned fear and its relation to extinction. Neuron 59, 829–838. doi: 10.1016/j.neuron.2008.06.029 Desmedt, A., Garcia, R., and Jaffard, R. (1998). Differential modulation of changes in hippocampal-septal synaptic excitability by the amygdala as a function of either elemental or contextual fear conditioning in mice. J. Neurosci. 18, 480–487. Dinsmoor, J. A. (2001). Stimuli inevitably generated by behavior that avoids electric shock are inherently reinforcing. J. Exp. Anal. Behav. 75, 311. doi: 10.1901/jeab.2001.75-311 Dixon, W. A., Heppner, P. P., and Anderson, W. P. (1991). Problem-solving appraisal, stress, hopelessness, and suicide ideation in a college population. J. Couns. Psychol. 38, 51. doi: 10.1037/0022-0167.38.1.51 Dymond, S., and Roche, B. (2009). A contemporary behavior analysis of anxiety and avoidance. Behav. Anal. 32, 7–27. Fanselow, M. S., and Lester, L. S. (1988). “A functional behavioristic approach to aversively motivated behavior: predatory imminence as a determinant of the topography of defensive behavior,” in Evolution and Learning , eds R. C. Bolles and M. D. Beecher (Hillsdale, NJ: Erlbaum), 185–211. Fanselow, M. S., and Poulos, A. M. (2005). The neuroscience of mammalian associative learning. Annu. Rev. Psychol. 56, 207–234. doi: 10.1146/annurev.psych.56.091103.070213 Fernando, A. B., Urcelay, G. P., Mar, A. C., Dickinson, A., and Robbins, T. W. (2014). Safety signals as instrumental reinforcers during free-operant avoidance. Learn. Mem. 21, 488–497. doi: 10.1101/lm.034603.114 Freeman, J. H. Jr., Cuppernell, C., Flannery, K., and Gabriel, M. (1996). Context- specific multi-site cingulate cortical, limbic thalamic, and hippocampal Frontiers in Behavioral Neuroscience | www.frontiersin.org February 2016 | Volume 10 | Article 15 | 7 Servatius Avoidance: From Basic Science to Psychopathology neuronal activity during concurrent discriminative approach and avoidance training in rabbits. J. Neurosci. 16, 1538–1549. Freeman, J. H. Jr., Weible, A., Rossi, J., and Gabriel, M. (1997). Lesions of the entorhinal cortex disrupt behavioral and neuronal responses to context change during extinction of discriminative avoidance behavior. Exp. Brain Res. 115, 445–457. doi: 10.1007/PL00005714 Hedges, A. S., Van Atta, L., and Thomas, J. B. (1975). Septal lesions facilitate the shift from conditioned escape to conditioned avoidance behavior in the rat. Physiol. Behav. 14, 25–30. doi: 10.1016/0031-9384(75)90136-5 Hineline, P. N. (2001). Beyond the molar-molecular distinction: we need multiscaled analyses. J. Exp. Anal. Behav. 75, 342–347; discussion: 367–378. doi: 10.1901/jeab.2001.75-342 Holloway, J. L., Allen, M. T., Myers, C. E., and Servatius, R. J. (2014). Behaviorally inhibited individuals demonstrate significantly enhanced conditioned response acquisition under non-optimal learning conditions. Behav. Brain Res. 261, 49–55. doi: 10.1016/j.bbr.2013.10.041 Ilango, A., Shumake, J., Wetzel, W., Scheich, H., and Ohl, F. W. (2013). Electrical stimulation of lateral habenula during learning: frequency-dependent effects on acquisition but not retrieval of a two-way active avoidance response. PLoS ONE 8:e65684. doi: 10.1371/journal.pone.0065684 Insel, T., Cuthbert, B., Garvey, M., Heinssen, R., Pine, D. S., Quinn, K., et al. (2010). Research domain criteria (RDoC): toward a new classification framework for research on mental disorders. Am. J. Psychiatry 167, 748–751. doi: 10.1176/appi.ajp.2010.09091379 Kashdan, T. B., Goodman, F. R., Machell, K. A., Kleiman, E. M., Monfort, S. S., Ciarrochi, J., et al. (2014). A contextual approach to experiential avoidance and social anxiety: evidence from an experimental interaction and daily interactions of people with social anxiety disorder. Emotion 14, 769–781. doi: 10.1037/a0035935 Kashdan, T. B., Morina, N., and Priebe, S. (2009). Post-traumatic stress disorder, social anxiety disorder, and depression in survivors of the Kosovo War: experiential avoidance as a contributor to distress and quality of life. J. Anxiety Disord. 23, 185–196. doi: 10.1016/j.janxdis.2008.06.006 Kim, E., Kim, E. J., Yeh, R., Shin, M., Bobman, J., Krasne, F. B., et al. (2014). Amygdaloid and non-amygdaloid fear both influence avoidance of risky foraging in hungry rats. Proc. Biol. Sci. 281:20133357. doi: 10.1098/rspb.2013.3357 Kim, J. J., Rison, R. A., and Fanselow, M. S. (1993). Effects of amygdala, hippocampus, and periaqueductal gray lesions on short- and long-term contextual fear. Behav. Neurosci. 107, 1093–1098. doi: 10.1037/0735- 7044.107.6.1093 Knight, D. C., Cheng, D. T., Smith, C. N., Stein, E. A., and Helmstetter, F. J. (2004). Neural substrates mediating human delay and trace fear conditioning. J. Neurosci. 24, 218–228. doi: 10.1523/JNEUROSCI.0433-03.2004 Ledoux, J. E. (2013). The slippery slope of fear. Trends Cogn. Sci. 17, 155–156. doi: 10.1016/j.tics.2013.02.004 Ledoux, J. E., and Muller, J. (1997). Emotional memory and psychopathology. Philos. Trans. R. Soc. Lond. B Biol. Sci. 352, 1719–1726. doi: 10.1098/rstb.1997.0154 Levine, S. (1966). UCS intensity and avoidance learning. J. Exp. Psychol. 71, 163–164. doi: 10.1037/h0022690 Lovibond, P. F., Mitchell, C. J., Minard, E., Brady, A., and Menzies, R. G. (2009). Safety behaviours preserve threat beliefs: protection from extinction of human fear conditioning by an avoidance response. Behav. Res. Ther. 47, 716–720. doi: 10.1016/j.brat.2009.04.013 Lovibond, P. F., Saunders, J. C., Weidemann, G., and Mitchell, C. J. (2008). Evidence for expectancy as a mediator of avoidance and anxiety in a laboratory model of human avoidance learning. Q. J. Exp. Psychol. 61, 1199–1216. doi: 10.1080/17470210701503229 Ly, V., and Roelofs, K. (2009). Social anxiety and cognitive expectancy of aversive outcome in avoidance conditioning. Behav. Res. Ther. 47, 840–847. doi: 10.1016/j.brat.2009.06.015 Moffitt, T. E., Caspi, A., Harrington, H., Milne, B. J., Melchior, M., Goldberg, D., et al. (2007). Generalized anxiety disorder and depression: childhood risk factors in a birth cohort followed to age 32. Psychol. Med. 37, 441–452. doi: 10.1017/S0033291706009640 Moyer, K. E., and Korn, J. H. (1964). Effect of ucs intensity on the acquisition and extinction of an avoidance response. J. Exp. Psychol. 67, 352–359. doi: 10.1037/h0039933 Myers, C. E., Moustafa, A. A., Sheynin, J., Vanmeenen, K. M., Gilbertson, M. W., Orr, S. P., et al. (2013). Learning to obtain reward, but not avoid punishment, is affected by presence of PTSD symptoms in male veterans: empirical data and computational model. PLoS ONE 8:e72508. doi: 10.1371/journal.pone.00 72508 North, C. S., Pfefferbaum, B., Tivis, L., Kawasaki, A., Reddy, C., and Spitznagel, E. L. (2004). The course of posttraumatic stress disorder in a follow-up study of survivors of the Oklahoma City bombing. Ann. Clin. Psychiatry 16, 209–215. doi: 10.1080/10401230490522034 Ottenbreit, N. D., Dobson, K. S., and Quigley, L. (2014). An examination of avoidance in major depression in comparison to social anxiety disorder. Behav. Res. Ther. 56, 82–90. doi: 10.1016/j.brat.2014.03.005 Ricart, T. M., De Niear, M. A., Jiao, X., Pang, K. C., Beck, K. D., and Servatius, R. J. (2011a). Deficient proactive interference of eyeblink conditioning in Wistar-Kyoto rats. Behav. Brain Res. 216, 59–65. doi: 10.1016/j.bbr.2010.07.005 Ricart, T. M., Jiao, X., Pang, K. C., Beck, K. D., and Servatius, R. J. (2011b). Classical and instrumental conditioning of eyeblink responses in Wistar- Kyoto and Sprague-Dawley rats. Behav. Brain Res. 216, 414–418. doi: 10.1016/j.bbr.2010.08.029 Richer, J. (1976). The social-avoidance behaviour of autistic children. Anim. Behav. 24, 898–906. doi: 10.1016/S0003-3472(76)80020-6 Schlund, M. W., Hudgins, C. D., Magee, S., and Dymond, S. (2013). Neuroimaging the temporal dynamics of human avoidance to sustained threat. Behav. Brain Res. 257, 148–155. doi: 10.1016/j.bbr.2013.09.042 Seligman, M. E. P., and Johnston, J. C. (1973). “A cognitive theory of avoidance learning,” in Contemporary Approaches to Conditioning and Learning , eds F. J. McGuigan and D. B. Lumsden (Washington, DC: Winston and Sons), 69–110. Servatius, R. J., Jiao, X., Beck, K. D., Pang, K. C., and Minor, T. R. (2008). Rapid avoidance acquisition in Wistar-Kyoto rats. Behav. Brain Res. 192, 191–197. doi: 10.1016/j.bbr.2008.04.006 Servatius, R. J., and Shors, T. J. (1994). Exposure to inescapable stress persistently facilitates associative and nonassociative learning in rats. Behav. Neurosci. 108, 1101–1106. doi: 10.1037/0735-7044.108.6.1101 Sheynin, J., Moustafa, A. A., Beck, K. D., Servatius, R. J., and Myers, C. E. (2015). Testing the role of reward and punishment sensitivity in avoidance behavior: a computational modeling approach. Behav. Brain Res. 283, 121–138. doi: 10.1016/j.bbr.2015.01.033 Shors, T. J., and Servatius, R. J. (1997). The contribution of stressor intensity, duration, and context to the stress-induced facilitation of associative learning. Neurobiol. Learn. Mem. 68, 92–96. doi: 10.1006/nlme.1997.3763 Shumake, J., Ilango, A., Scheich, H., Wetzel, W., and Ohl, F. W. (2010). Differential neuromodulation of acquisition and retrieval of avoidance learning by the lateral habenula and ventral tegmental area. J. Neurosci. 30, 5876–5883. doi: 10.1523/JNEUROSCI.3604-09.2010 Snell, D. L., Siegert, R. J., Hay-Smith, E. J., and Surgenor, L. J. (2011). Associations between illness perceptions, coping styles and outcome after mild traumatic brain injury: preliminary results from a cohort study. Brain Inj. 25, 1126–1138. doi: 10.3109/02699052.2011.607786 Steinmetz, J. E., Logue, S. F., and Miller, D. P. (1993). Using signaled barpressing tasks to study the neural substrates of appetitive and aversive learning in rats: behavioral manipulations and cerebellar lesions. Behav. Neurosci. 107, 941–954. doi: 10.1037/0735-7044.107.6.941 Thomas, J. B., and Van Atta, L. (1972). Hyperirritability, lever-press avoidance, and septal lesions in the albino rat. Physiol. Behav. 8, 225–232. doi: 10.1016/0031- 9384(72)90365-4 Vlaeyen, J. W., Kole-Snijders, A. M., Boeren, R. G., and Van Eek, H. (1995). Fear of movement/(re)injury in chronic low back pain and its relation to behavioral performance. Pain 62, 363–372. doi: 10.1016/0304-3959(94)00279-N Conflict of Interest Statement: The author declares that the research was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest. Copyright © 2016 Servatius. This is an open-access article distributed under the terms of the Creative Commons Attribution License (CC BY). The use, distribution or reproduction in other forums is permitted, provided the original author(s) or licensor are credited and that the original publication in this journal is cited, in accordance with accepted academic practice. No use, distribution or reproduction is permitted which does not comply with these terms. Frontiers in Behavioral Neuroscience | www.frontiersin.org February 2016 | Volume 10 | Article 15 | 8 REVIEW published: 21 July 2015 doi: 10.3389/fnbeh.2015.00189 Frontiers in Behavioral Neuroscience | www.frontiersin.org July 2015 | Volume 9 | Article 189 | Edited by: Richard J. Servatius, Syracuse DVA Medical Center, USA Reviewed by: Christine A. Rabinak, Wayne State University, USA Hadley C. Bergstrom, National Institutes of Health, USA *Correspondence: Tom Beckers, Department of Clinical Psychology, University of Amsterdam, Weesperplein 4, 1018 XA Amsterdam, Netherlands T.R.J.Beckers@uva.nl Received: 20 May 2015 Accepted: 06 July 2015 Published: 21 July 2015 Citation: Krypotos A-M, Effting M, Kindt M and Beckers T (2015) Avoidance learning: a review of theoretical models and recent developments. Front. Behav. Neurosci. 9:189. doi: 10.3389/fnbeh.2015.00189 Avoidance learning: a review of theoretical models and recent developments Angelos-Miltiadis Krypotos 1, 2 , Marieke Effting 1, 2 , Merel Kindt 1, 2 and Tom Beckers 1, 2, 3 * 1 Department of Clinical Psychology, University of Amsterdam, Amsterdam, Netherlands, 2 Amsterdam Brain and Cognition, University of Amsterdam, Amsterdam, Netherlands, 3 Department of Psychology, KU Leuven, Leuven, Belgium Avoidance is a key characteristic of adaptive and maladaptive fear. Here, we review past and contemporary theories of avoidance learning. Based on the theories, experimental findings and clinical observations reviewed, we distill key principles of how adaptive and maladaptive avoidance behavior is acquired and maintained. We highli