Abstract
Although the last 50 years of clinical and preclinical research have demonstrated that addiction is a brain disease, we still have no neural circuit–based treatments for substance dependence or cue reactivity at large. Now, for the first time, it appears that a noninvasive brain stimulation technique known as transcranial magnetic stimulation (TMS), which is Food and Drug Administration approved to treat depression, may be the first tool available to fill this critical void in addiction treatment development. The goals of this review are to 1) introduce TMS as a tool to induce causal change in behavior, cortical excitability, and frontal–striatal activity; 2) describe repetitive TMS (rTMS) as an interventional tool; 3) provide an overview of the studies that have evaluated rTMS as a therapeutic tool for alcohol and drug use disorders; and 4) outline a conceptual framework for target selection when designing future rTMS clinical trials in substance use disorders. The manuscript concludes with some suggestions for methodological innovation, specifically with regard to combining rTMS with pharmacotherapy as well as cognitive behavioral training paradigms. We have attempted to create a comprehensive manuscript that provides the reader with a basic set of knowledge and an introduction to the primary experimental questions that will likely drive the field of TMS treatment development forward for the next several years.
I. Introduction
Substance dependence is an intransigent, worldwide health problem that affects over 1 billion individuals. Approximately 1.1 billion people smoke cigarettes on a regular basis; 6 million deaths every year are attributable to smoking (World Health Organization, 2012); and at least 76 million individuals meet criteria for alcohol use disorder, which is associated with 1.8 million deaths per year (World Health Organization, 2004). Although addiction affects populations that vary in age from adolescents to senior citizens, from low to high socioeconomic status, and includes substances that are naturally grown and synthetically processed, all of these substance-dependent populations are united by two common features—elevated reactivity to environmental cues and disrupted activity in frontal–striatal circuits.
The basic recovery process for any substance use disorder includes management of acute withdrawal (detoxification), abstinence initiation, and relapse prevention. Whereas the majority of medical attention is spent on management of acute withdrawal and short-term detoxification programs, there is very little evidence to suggest these short-term interventions improve long-term abstinence rates.
The earliest long-term treatments for addiction sought to address the underlying maladaptive behaviors. In 1935, Bill Wilson and Robert Smith developed the Alcoholics Anonymous group, which has been expanded into the 12-step facilitation program for other drugs of abuse. The 12-step facilitation program is based on the application of spiritual and moral principles. Other behavioral therapies include cognitive behavioral therapy, motivational interviewing, and contingency management. These therapies all seek to increase the patient’s cognitive engagement in treatment and develop behavioral strategies to reduce the likelihood of relapse. Although these behavioral therapies play a very important role in addiction treatment and relapse prevention, the efficacy of behavioral therapy alone varies from low to moderate based on the primary substance of abuse (Dutra et al., 2008).
As knowledge grew about the biologic mechanisms for addiction, pharmacotherapies were explored based on the implicated receptor systems. Although the biologic target of these interventions differs by class of substance use disorder, the majority of these drugs rely upon full or partial agonist or antagonist effects on a specific neurotransmitter system. There are several Food and Drug Administration (FDA)–approved medications for alcohol use disorder (e.g., naltrexone, acamprosate), nicotine use disorder (e.g., varenicline, nicotine replacement), as well as opiate use disorder (e.g., naloxone, buprenorphine, methadone). To date, there are no FDA-approved pharmacologic treatments for either cocaine or methamphetamine. With technological advances in drug development, it is now possible to design pharmacotherapeutics for substance use disorders that can specifically target receptor subtypes believed to be involved in various portions of the addiction process (i.e., drug-cued reinstatement) and precisely manipulate the pharmacokinetic properties of these compounds (i.e., long-acting formulations). Although these neurochemically targeted pharmacotherapeutics are often very elegant and effective at modulating a specific neurotransmitter system, it is still difficult to limit their site of action to a specific neural region or circuit in the brain. This is particularly true for pharmacotherapeutic agents that rely on glutamatergic and GABAergic mechanisms, given the broad distribution of these neurotransmitter systems throughout the brain.
Recently, there has been an emerging emphasis in designing neural circuit–specific treatment options for patients with substance use disorders. This neural circuit–based emphasis in the substance use research community has been hastened by advances in neuroimaging technology and preclinical studies in the 1990s and 2000s. Preclinical studies have revealed that there is a causal relationship between activity in the frontal–striatal circuits and drug use behavior, whereas clinical studies have demonstrated that activity in these frontal–striatal circuits are also biomarkers for predicting vulnerability to relapse across multiple substance use disorders.
During this same period of time, the depression research community was in the process of developing a noninvasive neural circuit–based treatment of major depression disorder. This treatment, known as repetitive transcranial magnetic stimulation (rTMS), was approved as a therapy for major depressive disorder by the FDA in 2005 and is now widely covered by Medicare. Repetitive transcranial magnetic stimulation (TMS) (section Transcranial Magnetic Stimulation: An Interventional Tool) was an extension of single-pulse TMS (section Single Pulse Transcranial Magnetic Stimulation: A Biomarker and Probe), which had been invented by Dr. Anthony Barker in 1984 in Sheffield, England. A group of investigators at the National Institute of Neurologic Disease and Stroke was the first to demonstrate that repeated pulses of TMS (rTMS) at 1 Hz over the motor cortex decreased cortical excitability. These decreases in cortical excitability associated with 1 Hz rTMS are referred to as long-term depression (LTD)–like effects of rTMS—a reference to the preclinical concept of LTD. Likewise, rTMS at 10 Hz (and 20 Hz) increases cortical excitability. These are referred to as long-term potentiation (LTP)–like effects of rTMS—a reference to the preclinical concept of LTP. These foundational studies over the motor cortex were based on parameters that had been evaluated in preclinical electrophysiology models of neural plasticity. These studies paved the way for psychiatry researchers at the National Institute of Mental Health (and several other universities) who were interested in evaluating the therapeutic potential that rTMS might have for their patients—many of whom had elevated or depressed activity in the prefrontal cortex. Twenty years after Dr. Barker’s initial manuscript was published (1985), TMS has become an FDA-approved treatment tool for depression (2005). As of 2018 there are four FDA-approved devices to deliver rTMS as a treatment tool for depression, and there are many other clinical indications for which rTMS has a lot of potential promise—one of which is substance use disorders.
In the next sections, we will introduce TMS as a novel neuromodulation tool being applied to various substance-dependent populations and describe its utility as a probe for cortical excitability (section Single-Pulse Transcranial Magnetic Stimulation: A Biomarker and Probe), its effects on pharmacology (section Single-Pulse Transcranial Magnetic Stimulation: A Biomarker and Probe), as an intervention (section Repetitive Transcranial Magnetic Stimulation: An Interventional Tool), and how it is currently being evaluated as a novel treatment tool for alcohol, nicotine, and cocaine use disorders (section Repetitive Transcranial Magnetic Stimulation: An Interventional Tool).
II. Single-Pulse Transcranial Magnetic Stimulation: A Biomarker and Probe
A. Fundamentals
1. What Is Single-Pulse Transcranial Magnetic Stimulation?
Although a comprehensive review of the basic mechanisms of TMS is beyond the scope of this manuscript, prior behavioral, electrophysiological, and neuroimaging work in this area is well described and summarized in several review articles (see: Fitzgerald et al., 2006; Thickbroom, 2007; Hoogendam et al., 2010; Ziemann, 2011). In its most basic form, TMS is administered through a handheld circular coil that contains 100–200 windings of metal wire contained in a magnetically translucent casing (i.e., plastic). When electricity is passed through the wire, a magnetic field is created perpendicular to the plane of the wound coil. By applying pulses of electricity through the coil, the magnetic field will also have a pulsatile nature, and, consistent with Maxwell’s third law, will induce an electrical field perpendicular to the magnetic field.
When this field is induced in the vicinity of an electrically sensitive biologic system (such as muscle or neurons), an electrical current will be induced in the biologic medium. In practice, this is easily demonstrated by holding a TMS coil parallel to someone’s forearm. When pulses of electricity are allowed to run through the coil, a pulsatile magnetic field will be created, and in turn the muscles of the forearm that are in the spatial distribution of the induced electrical field will contract. The strength of the muscle contraction is proportional to the strength of the induced magnetic field, which is related to the current (Maxwell, 1861).
For transcranial magnetic stimulation, these same principles are applied to cortical neurons (rather than forearm muscles). In the first demonstration of TMS, Dr. Barker was able to show that when a circular TMS coil was positioned over the area of the left primary motor cortex somatotopically related to the right hand, he could induce a motor-evoked potential (MEP) in the right hand that was proportional to the strength of the TMS field. Since Dr. Barker’s discovery in 1984, there have been significant advancements in TMS coil designs, including figure-of-eight coils (which can induce a more focused field change) and H-coil designs (which allow a deeper penetration of the effects of TMS, enabling broader TMS target engagement).
2. The Spatial Topography of a Single Transcranial Magnetic Stimulation Pulse
One of the most common questions posed by clinical and preclinical researchers is the following: “How precise is a TMS pulse?” With a growing number of TMS coil designs, this is an increasingly complex question to answer. The focality of TMS is related to the shape of the coil. There is a substantial body of literature devoted to computational modeling of electric field distributions associated with different coil shapes. In one of the most comprehensive papers, Deng et al. (2013) investigated the focality and penetration depth of 50 existing TMS coils (Deng et al., 2013). Their computational models revealed that typical figure-of-eight coil affected approximately 10 cm2 of cortical surface, circular coils affected approximately 50 cm2, and H-coil designs affected approximately 100 cm2. Most flat coil designs had penetration depths from 1 to 2 cm2, whereas the H-coil designs had consistently higher depths of 2 to 3 cm. A single TMS pulse from a standard figure-of-eight coil stimulates a 12.5-cm2 area, which is approximately 1/125 (0.8%) of the cortical surface area. By comparison, deep brain stimulation is an order of magnitude more precise, with volumes ranging from 1 to 20 cm (Wei and Grill, 2005), whereas electroconvulsive therapy and magnetic seizure therapy affect approximately 94% and 21% of the brain, respectively (Lee et al., 2016).
With TMS it is also possible to modulate monosynaptic (and possibly polysynaptic) targets of these cortical areas. The indirect effects of cortical TMS on monosynaptic afferent targets can be demonstrated through a behavioral assessment of the recruitment curve. When TMS is applied to the hand area of the primary motor cortex, there is a dose-dependent change in the amplitude of the MEP on the hand contralateral to the TMS coil. This pathway from the motor cortex to the hand requires at least two neurons—the upper motor neuron, which originates in the motor cortex and terminates in the spinal cord, and the lower motor neuron, which originates in the spinal cord and terminates in the muscles that will contract to produce the MEP. The majority of upper motor neurons, however, terminate on interneurons, which then facilitate lower motor neuron activity—suggesting that TMS can have polysynaptic effects. This ability to stimulate monosynaptic and possibly polysynaptic neurons is important for substance abuse treatment development research because many areas of interest for stimulation in substance use treatment are located in subcortical areas. Whereas these areas (i.e., striatum, amygdala) are not directly reachable with most TMS coils, neuroimaging data and electrophysiology data have demonstrated that they can be modulated via the cortical source of their afferent input.
3. Single-Pulse Transcranial Magnetic Stimulation as a Measurement Tool
Single and paired pulses of TMS are often used as a method to probe cortical excitatory and inhibitory tone (review Chen, 2000). The majority of our knowledge regarding the basic electrophysiological effects of TMS on the brain is from studies in the motor system. As mentioned above, a single pulse of TMS over the motor cortex results in a MEP in the limb contralateral to the stimulation site. A summary of the TMS probes commonly used and their sensitivity as markers of neurochemistry is displayed in Table 1. The most commonly reported dependent measure in TMS literature is the resting motor threshold (MT). This parameter is defined as the minimum TMS intensity required to generate a detectable MEP on 50% of the observations. Nearly all clinical treatment studies of rTMS use the MT as their dosing metric. In the FDA-approved protocol for TMS in depression, for example, patients are given 10 Hz stimulation over the dorsolateral prefrontal cortex at 120% of their resting MT. This enables rTMS to be titrated to each individual patient—an important step toward precision medicine. Although MT is consistent within an individual, there is a significant between-individual variability— nearly 70% of which is accounted for by variability in scalp-to-cortex distance (Herbsman et al., 2009).
A brief summary of TMS measures of cortical excitability and their relationship to neurotransmitters
Beyond calculating the resting MT, single pulses of TMS at variable intensities (80%–120% of MT) can also be used to calculate a recruitment curve. This is expressed as a dose-response relationship wherein the amplitude of the TMS intensity is plotted against the amplitude of the average evoked MEP at that intensity. The shape of the recruitment curve is influenced by the balance of local inhibition and facilitation. Paired pulses of TMS can be used to investigate intracortical inhibition (ICI) and intracortical facilitation (ICF). In these paired-pulse procedures, a subthreshold conditioning stimulus (typically 80% motor threshold) is followed by suprathreshold test stimulus (typically 120% motor threshold) (Ziemann et al., 1996; Kujirai et al., 2006). Short interstimulus intervals (1–4 milliseconds) lead to inhibition, whereas longer interstimulus intervals (8–15 milliseconds) lead to facilitation.
B. Relationship between Pharmacology and Transcranial Magnetic Stimulation Measures
Beyond simply evaluating cortical facilitation and inhibition, however, these TMS measures can be used as a tool to evaluate the effects of pharmaceutical agents on cortical excitability in clinical populations. In fact, TMS and electroencephalography (EEG) are currently the only noninvasive electrophysiology tools available to assess the effects of a pharmacologic treatment on cortical excitability. The interaction between TMS and pharmacology has been an active area of research since the 1990s. Many of these studies have been elegantly summarized in several reviews (Ziemann, 2004; Ziemann et al., 2015). As stated above, TMS can be used as both a probe (single and paired pulses) and an interventional tool (rTMS). Consequently, studies that combine both pharmacology with TMS electrophysiology can be divided into two categories: 1) studies that investigated the effects of pharmaceutical agents on TMS measures of cortical excitability, and 2) studies that investigated the effects of various rTMS protocols on endogenous neurotransmitters (discussed in section Repetitive Transcranial Magnetic Stimulation: An Interventional Tool). As of 2015 there were 34 studies that took the first approach—evaluating the effect of various drugs on TMS electrophysiology parameters. These parameters include resting motor threshold, cortical silent period (CSP), paired pulse inhibition, and paired pulse facilitation. In a review of these studies, Ziemann et al. (2015) classified each study by the predominant neurotransmitter system that the drug targeted (voltage gated ion channels, antiglutamatergic, GABAergic, dopaminergic, noradrenergic) (Fig. 1). Of the drugs that were investigated, vigabatrin (GABA-ergic agonist) and lorazepam (GABA antagonist) had the largest effects on cortical silent period—a measure of cortical inhibitory tone, wherein vigabatrin caused a significant increase in inhibition (Pierantozzi et al., 2004), whereas lorazapam caused a significant decrease in inhibition (Kimiskidis et al., 2006). Of the dopaminergic and noradrenergic drugs, levodopa had a significant inhibitory effect (lengthening the cortical silent period) (Priori et al., 1994), whereas methylphenidate appears to have dose-dependent effect—increasing cortical facilitation at 12 mg (Moll et al., 2003) but increasing inhibition at 30 mg (Gilbert et al., 2006) and 40 mg (Ilic et al., 2003).
A summary of studies that have investigated the effects of various FDA-approved medications on cortical excitability using TMS. In a previous review, the extant literature in this field (n = 34 studies; Ziemann et al., 2015) grouped each drug into a class (based on its stated mechanism of action in that study) (top left). The average effect size (Cohen’s d) of the drugs in that class was then compiled for several TMS electrophysiology tests (e.g., cortical silent period). The data are reported as follows: average effect size (number of published studies with significant results, number of drugs investigated in that class). Effect sizes with an absolute value greater than 0.8 are strong, greater than 0.5 are moderate, and less than 0.5 are weak.
C. Using Transcranial Magnetic Stimulation To Study Cortical Excitability in Addiction
1. Cocaine
Single-pulse TMS protocols (such as paired pulse inhibition, facilitation, and cortical silent period) have been used to investigate disruptions in cortical excitability by multiple groups (Boutros et al., 2001, 2005; Sundaresan et al., 2007; Gjini et al., 2012; Bunse et al., 2014; Hanlon et al., 2015a). Our group, for example, demonstrated that the slope of the TMS dose-response curve was significantly steeper in current, chronic cocaine users than healthy controls. Additionally, the baseline motor threshold in cocaine users is higher than controls (Hanlon et al., 2015a). This difference means that it takes more energy to generate an initial MEP in cocaine users, but, once a threshold had been reached in cocaine users, the slope of the dose-response curve was very steep. These data suggest that the ratio of local excitatory to inhibitory processes in the motor cortex (e.g., likely glutamate or GABA mediated) is higher in cocaine users.
Several studies have demonstrated that abstinent cocaine users have lower motor cortex excitability than nondrug-using controls (Boutros et al., 2001, 2005; Sundaresan et al., 2007; Gjini et al., 2012). These lower MEPs in abstinent cocaine users are likely due to lower cortical (rather than peripheral nervous system) excitability (Ziemann et al., 1996; Di Lazzaro et al., 2008).
Furthermore, we have demonstrated that cocaine users had a lower ventral striatal blood-oxygen-level dependent (BOLD) response to single pulses of TMS stimulation to the medial prefrontal cortex (MPFC) than healthy controls (Hanlon et al., 2016). In this study, transcranial magnetic stimulation was applied to the left frontal pole (MPFC area of Brodmann area 10) and the left dorsolateral prefrontal cortex (DLPFC; lateral Brodmann 9) of 36 individuals—18 cocaine-dependent individuals with a history of failed quit attempts and 18 age-matched controls. Cocaine users had a lower ventral striatal BOLD response to MPFC stimulation. There was no between-group difference, however, in dorsal striatal response to DLPFC stimulation. Consistent with the competing neurobehavioral decision system (CNDS) theory, DLPFC stimulation led to a reciprocal decrease in MPFC activity (BA 10) in the controls. This reciprocal pattern did not exist, however, in the cocaine users.
2. Alcohol
In healthy controls, acute ethanol exposure leads to an increase in the duration of the cortical silent period (Ziemann et al., 1995; Conte et al., 2008). Despite this acute change, CSP is not altered in individuals who have consumed alcohol chronically (Conte et al., 2008; Nardone et al., 2010b; Naim-Feil et al., 2016), even during withdrawal states (Nardone et al., 2010b). Similarly, inhibition can be enhanced and facilitation reduced by acute alcohol consumption in healthy controls (Ziemann et al., 1995), but no difference in magnitude could be found among detoxified individuals with a history of chronic alcohol use (Nardone et al., 2010a,b; Naim-Feil et al., 2016), despite facilitation being increased in withdrawal states (Nardone et al., 2010b).
Some groups have used TMS to induce either LTD- or LTP-like plasticity. In healthy controls, acute alcohol exposure enhances LTD-like plasticity (Fuhl et al., 2015) but blocks LTP-like effects (Lucke et al., 2014; Loheswaran et al., 2016). In multiple studies, neither acute alcohol administration nor a history of chronic alcohol use had an effect on resting or active motor threshold (Ziemann et al., 1995; Conte et al., 2008; Nardone et al., 2010a,b; Kaarre et al., 2018), although one group did find a small difference between healthy controls and those with an alcohol use disorder when controlling for depression and intellectual function (Naim-Feil et al., 2016).
The primary findings, that of increased inhibition, reflect GABAergic properties. Similar intracortical inhibition can be seen after administration of a benzodiazepine such as lorazepam, a GABA-A agonist (Di Lazzaro et al., 2005a), and CSP elongation is observed following inhibition of GABA reuptake inhibition with tiagabine (Werhahn et al., 1999) or reduced GABA degradation with vigabatrin (Pierantozzi et al., 2004). Further work will be needed to explore the compensation methods that differentiate acute from chronic changes.
3. Nicotine
Chronic nicotine usage is related with a prolonged CSP duration, compared with healthy controls (Lang et al., 2008). Neither resting motor threshold (rMT) nor active motor threshold measured at the periphery appears to be sensitive to acute (Orth et al., 2005; Grundey et al., 2012a, 2013) or chronic (Orth et al., 2005; Lang et al., 2008; Grundey et al., 2012a; Strube et al., 2015) nicotine usage. rMT measured at the tongue, evaluating corticobulbar rather than corticospinal excitability, did find that chronic smokers had lower motor thresholds (Vicario et al., 2014). Evidence for changes in the recruitment curve is mixed, with chronic smokers showing greater MEPs at 150% of rMT (Grundey et al., 2013), but not 130% (Lang et al., 2008).
No effect of past nicotine usage was found for ICI (Lang et al., 2008; Grundey et al., 2013), although chronic smokers did show reduced ICF (Lang et al., 2008; Grundey et al., 2013). In deprived smokers, this loss of facilitation was restored to healthy control levels following the administration of nicotine (Grundey et al., 2013); however, acute nicotine did not alter ICF in healthy controls, but instead enhanced ICI (Grundey et al., 2013). Deprived chronic smokers showed enhanced short-interval afferent inhibition (SAI) at 20 milliseconds compared with controls, and this was not altered by a nicotine patch (Lang et al., 2008; Grundey et al., 2013). In contrast to this, SAI was enhanced in nonsmokers after a nicotine patch (Grundey et al., 2013).
Depending on the route of administration, nicotine was effective at blocking LTD-like plasticity in healthy controls (Thirugnanasambandam et al., 2011) as well as LTP-like effects (Grundey et al., 2012a). In deprived smokers, nicotine administration restored LTP-like plasticity with no effect on LTD-like plasticity (Grundey et al., 2012b). Further work is needed to determine what role these acute changes play in the addiction process and whether they can be used as an index of recovery or intervention effectiveness.
Together, these results highlight the complex interaction of the cholinergic system with both GABAergic and glutamatergic function. SAI is particularly relevant in studies of nicotine, as it is sensitive to cholinergic function and can be blocked by scopolamine, a muscarinic antagonist (Di Lazzaro et al., 2000b). This is a promising method for future work, as it appears to be sensitive to both acute and chronic nicotine effects.
D. Evaluating Cortical–Striatal Connectivity
In addition to investigating cortical excitability, it is also possible to evaluate cortical–striatal connectivity by combining single pulses of TMS with either functional magnetic resonance imaging (MRI) or EEG. As stated previously, the direct effects of TMS are spatially restricted to cortical areas directly exposed to the TMS-induced field (typically 2–4 cm from the center of the coil). When this depolarizing current is strong enough, however, it is possible to induce activity in monosynaptic targets of the neurons directly affected by the field. In this manner, cortical pulses of TMS can be used to investigate frontal–striatal connectivity. This has been documented using interleaved TMS/BOLD imaging wherein a single pulse of TMS induces an elevation in the BOLD signal in the vicinity of the TMS coil and in monosynaptic target regions (Bohning et al., 1998). For example, when TMS is applied to the motor cortex, the TMS-evoked BOLD signal in the motor system is similar to a task-evoked BOLD signal in the motor system (i.e., instructing the participant to squeeze his or her hand) (Denslow et al., 2005). In one of the first sham-controlled interleaved TMS/MRI studies, Dowdle et al. (2018) demonstrated that, relative to sham TMS, single pulses of real TMS to the DLPFC induce a significant increase in the BOLD signal in the left caudate and the anterior cingulate cortex—regions that both receive axonal projections from the left DLPFC (Fig. 2) (Dowdle et al., 2018). With interleaved TMS/MRI, it is also possible to differentially activate the frontal–striatal circuits involved in limbic versus executive control—neural circuits that are both involved in the substance use and recovery process. Specifically, TMS pulses to the left DLPFC induce an increase in dorsal striatal activity, whereas TMS pulses to the left ventral MPFC (frontal pole) induce an increase in ventral striatal activity (Hanlon et al., 2013b). This technique was originally used to investigate frontal–striatal integrity in healthy controls, and has now been applied to individuals with nicotine, cocaine, and alcohol use disorders. Although this interleaved TMS/MRI imaging technique can be a technological challenge due to physical constraints of having a TMS coil inside a MRI scanner, it provides researchers with a very unique opportunity to evaluate the functional connectivity of specific neural circuits in a causal manner.
TMS to the DLPFC induces a direct increase in brain activity (BOLD signal) in the caudate and anterior cingulate cortex. Healthy young adults received 40 single pulses to the left DLPFC at TMS intensities (Multiband T2*, TR = 1.0, TMS pulse fired in 100-ms gap, 10 pulses per dose, randomized order). Sham TMS was delivered by increasing the distance from the scalp via reticulated open-cell foam. Data were analyzed with an event-related design using the general linear model with weighted values for the dose covariate and a canonical hemodynamic response function (SPM 8, image threshold at P < 0.001). Relative to the sham/control condition, TMS to the left DLPFC induced a significant increase in activity in the caudate and the anterior cingulate cortex, but not in the putamen, right DLPFC, or auditory cortex (positive control region) (P < 0.05, corrected) (as described in Dowdle et al., 2018).
III. Repetitive Transcranial Magnetic Stimulation: An Interventional Tool
Whereas the period from 1999 to 2006 was a time of tremendous growth regarding the basic effects of various TMS protocols on motor cortex excitability, from 2006 to the present day, the momentum in rTMS research has shifted toward the clinical utility of rTMS as a tool to treat psychiatric disease. Section Single-Pulse Transcranial Magnetic Stimulation: A Biomarker and Probe focused on the use of TMS as a tool to probe cortical excitability—potentially a biomarker for future drug discovery trials. The remainder of this review will focus on TMS as an interventional tool. In rTMS, single TMS pulses are delivered at various frequencies (typically 1–20 Hz) in either a fixed or bursting pattern, for anywhere from 600 to 4000 pulses per session. These parameters can induce LTP of cortical excitability or LTD of cortical excitability depending on the frequency chosen (reviewed in Fitzgerald et al., 2006; Thickbroom, 2007). The FDA-approved protocol for depression is 10 Hz stimulation to the left DLPFC at 120% of the patient’s resting MT. In standard clinical practice, each session is typically 2000–4000 pulses and occurs 3–5 days per week for 6 weeks. There have been several multisite clinical trials evaluating the safety, efficacy, and durability of rTMS as a treatment of depression. Although the treatment outcomes and durability data are mixed, the effects of 4–6 weeks of treatment appear to last for at least 6 months and may be facilitated by intermittent shorter treatments of TMS. There are now TMS clinics on six of the seven continents—including all 50 states in the United States; nearly all countries in the European Union; established professional networks in Australia and South America; large high volume centers in China, South Korea, and Japan; and emerging clinics in Africa. Although the majority of the research in TMS is focused on optimizing treatment protocols for depression, there has been an exponential growth in the application of TMS to investigate and modulate these networks in populations with substance use disorders.
A. Fundamentals
There are a number of important factors that influence the efficacy of a given rTMS protocol (e.g., frequency, amplitude, location, coil shape, number of pulses, number of sessions). There is general agreement that low-frequency stimulation (e.g., 1 Hz) causes a decrease in cortical excitability, whereas higher-frequency stimulation (e.g., 10, 20 Hz) causes an increase in cortical excitability (review: Fitzgerald et al., 2006).One of the first studies in this field was by Pascual-Leone et al. (1994), who discovered that 20 pulses at 10 and 20 Hz stimulation over the motor cortex produced an increase in the amplitude of the motor-evoked potential, suggesting there are LTP-like effects on cortical excitability. Chen et al. (1997) then tested the hypothesis that 15 minutes of 0.9 Hz TMS stimulation (810 pulses) to the motor cortex would induce a LTD-like effect on motor cortex excitability. This hypothesis was built on preclinical studies that demonstrated that 15 minutes of 1 Hz stimulation induces LTD of activity in slice preparations of the motor cortex, visual cortex, and hippocampus. In a sample of 14 individuals, they demonstrated that 1 Hz TMS to the motor cortex for 15 minutes decreased the motor-evoked potential by 20% for at least 15 minutes after stimulation. Whereas these were some of the first studies, from 1995 to 2006 there were at least 46 other original research reports published evaluating the effects of various frequencies, amplitudes, and pulses on motor cortex excitability (review: Fitzgerald et al., 2006).
These excitatory and inhibitory effects for rTMS can also be achieved through θ burst stimulation (TBS). Built from a preclinical foundation (Bear and Malenka, 1994; Malenka and Bear, 2004), human TMS protocols apply rTMS in a continuous or intermittent bursting pattern (Di Lazzaro et al., 2005b; Huang et al., 2005). With continuous TBS (cTBS), three pulse bursts at 50 Hz are applied at a frequency of 5 Hz. In most protocols, this cycle continues until 600 pulses have been delivered (20 seconds). For intermittent TBS (iTBS), bursts are applied at the same rate (five groups of three pulse bursts per second) for 2 seconds, followed by an 8-second pause. In most protocols this 10-second cycle occurs until 600 pulses have been delivered (190 seconds). When performed over the primary motor cortex, 600 pulses of cTBS inhibit cortical excitability, whereas 600 pulses of iTBS amplify cortical excitability (Huang et al., 2005). The advantage of TBS protocols is that effect sizes comparable to fixed frequency protocols can be achieved significantly faster (1–2 minutes versus 20–30 minutes). These similar effect sizes have also been observed in clinical studies for depression, wherein there was no significant difference in response rates to TMS when the treatment was delivered at 10 Hz (30 minutes/session for 20–30 sessions) versus iTBS (6 minutes/session for 20–30 sessions).
B. Pharmacological Effects of Repetitive Transcranial Magnetic Stimulation
Although there have been many studies that have evaluated the effects of various rTMS protocols on behavior and cortical excitability (via EEG and functional MRI), very little is known about the effects of rTMS on neuropharmacology.
1. Dopamine
The most cited studies in this domain have been done using positron emission tomography (PET) imaging, wherein the radioligand [11C]raclopride, which is sensitive to D2 dopamine receptors, is used to detect changes in levels of extracellular dopamine after rTMS. In a series of unique and important studies in this field, Strafella et al. have demonstrated the following: 1) 10 Hz rTMS to the left primary motor cortex (which increases cortical excitability) increases dopamine release in the left putamen (Strafella et al., 2003); 2) 10 Hz rTMS to the left DLPFC increases dopamine release in the caudate (Strafella et al., 2001); and 3) cTBS to the left DLPFC (which decreases cortical excitability) decreases dopamine release in the left and right caudate and disrupted performance on a card-sorting task (Ko et al., 2008). Notably, cTBS to the right DLPFC did not change dopamine release nor affect task performance, suggesting a hemispheric asymmetry in rTMS effects. Additionally, when using the radioligand [11C]FLB457, which is a high-affinity D2 ligand sensitive to extrastriatal dopamine, 10 Hz rTMS to the left DLPFC increased dopamine release in the anterior cingulate and medial prefrontal cortex (Cho and Strafella, 2009). Again, 10 Hz TMS to the right DLPFC did not change dopamine release. This hemispheric asymmetry is consistent with clinical studies of rTMS for depression, which typically observe that whereas 10 Hz TMS to the left DLPFC (which increases cortical excitability) can be effective, 1 Hz TMS is typically used when targeting treatment to the right DLPFC (which decreases cortical excitability).
2. Glutamate and GABA
The rTMS-induced dopamine release is most likely due to direct effects of rTMS on glutamatergic pyramidal cells that originate at the site of stimulation and project to the striatum. One of the first studies to investigate the effects of single and multiple sessions of rTMS on neurochemistry was performed by Michael et al. in 2003 using proton magnetic resonance spectroscopy. A small group of healthy individuals was assigned to receive real (n = 7) or sham (n = 5) 20 Hz rTMS to the DLPFC. They demonstrated that both one and five sessions of rTMS increased glutamate/glutamine levels relative to sham rTMS. They also observed a rate-dependent effect of rTMS on glutamate/glutamine changes, wherein individuals with low baseline concentrations had highest levels of real TMS-associated increases in glutamate/glutamine (Michael et al., 2003). In addition to glutamate changes, several studies have also demonstrated that rTMS has direct effects on cortical GABA (Iwabuchi et al., 2017; Stagg et al., 2009; Vidal-Pineiro et al., 2015). Stagg et al. (2009), for example, demonstrated that the attenuating effects of cTBS on cortical excitability are related to an increase in GABA at the area of stimulation rather than a change in glutamate (Stagg et al., 2009). Iwabuchi et al. (2017) demonstrated that iTBS to the DLPFC (which typically increases cortical excitability) decreases the GABA/glutamate ratio in both the DLPFC and the insula (Iwabuchi et al., 2017).
3. Serotonin
Although the primary clinical indication for rTMS is major depressive disorder, a disease that is typically treated with selective serotonin reuptake inhibitors, very little is known about the effects of rTMS on serotonin. One of the few clinical studies done in this area used 123I-5-I-R91150 single-photon emission-computed tomography to evaluate the effect of 10 sessions of 10 Hz left DLPFC rTMS on postsynaptic 5-HT(2A) receptor binding (Baeken and De Raedt, 2011). Relative to controls (n = 21), at baseline the depressed patients had lower 5-HT(2A) receptor binding in the DLPFC bilaterally and higher binding in the hippocampus. Following 10 sessions of 10 Hz rTMS to the left DLPFC, there was a positive correlation between the improvement in depressive symptoms (measured by the Hamilton depression rating scale) and the change in 5-HT(2A) receptor binding in the DLPFC. This relationship between baseline 5-HT(2A) receptor binding and clinical response to rTMS is aligned with evidence that 5-HT(2A) receptor binding is also related to treatment response with selective serotonin uptake inhibitors (Zanardi et al., 2001).
IV. Developing Repetitive Transcranial Magnetic Stimulation as a Treatment Tool for Addiction
In the last 5 years, there has been an exponential growth in the number of published manuscripts and review articles evaluating rTMS as a tool to decrease craving (Feil and Zangen, 2010; Wing et al., 2013; Bellamoli et al., 2014; Gorelick et al., 2014; Hanlon et al., 2015b). Of these studies, the majority have applied high-frequency stimulation (10, 20 Hz, iTBS) to the left DLPFC, the same target used in depression. Although this may be valuable, as both diseases share common deficits in executive control (which is largely modulated by the DLPFC), scientifically, it is not obvious that the standard treatments for depression will be the optimal target sites for drug and alcohol use. In the following sections, we will review the body of literature that exists to date regarding the effects of TMS as a tool to change behavior in populations with alcohol use disorder, tobacco use disorder, and cocaine use disorder. We will then propose a conceptual model (section Moving Forward— Important Methodological Considerations) for TMS treatment development moving forward, and propose some novel biologic targets for future treatment development.
Many compounds have been evaluated as potential pharmacotherapies for substance use disorders. As of early 2018, however, there is only a handful of FDA-approved medications. Most pharmacotherapeutic strategies fall within three main categories: full agonists, partial agonists, and antagonists. Full agonists, such as methadone, directly stimulate receptor sites and are used as a replacement for the abused drug of choice. Full agonists are taken daily to avoid craving and withdrawal that can lead to relapse. Partial agonists, such as buprenorphine, are often used for detoxification and as a maintenance medication for those at risk of relapse into physical dependence. Antagonists, such as naltrexone, block some of the rewarding aspects of alcohol, making it easier to reduce consumption by blocking opioid receptors.
A. State of the Science in Alcohol
1. Approved Pharmacotherapy
The pharmacotherapy of alcohol dependence is broken into therapies for acute alcohol withdrawal syndrome and therapies for relapse prevention and harm reduction. For acute alcohol withdrawal syndrome, benzodiazepines are safe, effective, and the preferred treatment. Benzodiazepines are thought to increase brain GABA levels via GABA A binding that are systemically decreased with chronic alcohol exposure (Sachdeva et al., 2015). All subclasses of benzodiazepines have shown to be effective in treating alcohol withdrawal syndrome, with the most commonly used being the longer-acting chlordiazepoxide and diazepam or the shorter- to intermediate-acting lorazepam and oxazepam. There are three pharmacotherapies FDA approved for the treatment of alcohol dependence. Disulfram has been used for relapse prevention for over 50 years and works by inhibiting the enzyme acetaldehyde dehydrogenase, resulting in unpleasant effects (headache, nausea, vomiting, chest pain, etc.) when combined with even a small amount of alcohol. This extinguishing effect of drinking behavior is effective, although patients are often not compliant. The FDA-approved opiate antagonist, naltrexone, has shown promise in relapse prevention, stemming the endorphin-mediated reinforcing effects of drinking alcohol. There is strong evidence that naltrexone significantly reduces alcohol relapse to heavy drinking, the frequency and quantity of alcohol in those who do drink, and alcohol craving. Naltrexone also comes in long-acting, one-time-per-month injectable form to help with compliance. Acamprosate is the third medication to receive FDA approval for post withdrawal maintenance of alcohol abstinence. It is thought to reduce craving for alcohol by modulating GABA and glutamate systems that are disrupted by chronic alcohol use.
2. Brain Stimulation Research
At the time of writing, there have been nine studies published on the use of rTMS for alcohol addiction (Table 2). Six of these studies targeted the DLPFC, with five delivering stimulation to the right side and one targeting the left. Two recent studies chose the MPFC as an alternative target. High-frequency stimulation (10 or 20 Hz) was used for all studies that targeted the DLPFC, and for one of the studies targeting the MPFC. The remaining MPFC study used cTBS. Most of these studies (n = 6) evaluated outcomes after 10 or more sessions. The optimal parameters, such as the number of sessions or target, are currently unknown. One difficulty is the large number of factors that may modulate TMS efficacy. For example, a study in 2016 used 20 Hz right DLPFC stimulation and found that the change in cue reactivity depended on the cue reactivity as measured before TMS was delivered (Herremans et al., 2016). These rate-dependent effects may represent a biomarker that can guide treatment targets or inform the interpretation of results. Another such biomarker can be derived from functional imaging of cue induction, which consistently highlights the role of the MPFC in cue reactivity (Schacht et al., 2013). By targeting this region with a single session of cTBS, Hanlon et al. (2017) found reductions in evoked responses in orbitofrontal and insular cortex relative to sham stimulation. (More studies will be needed to determine how these factors contribute to the effectiveness of rTMS.)
Studies that have used repetitive TMS as a tool to change alcohol craving
Multiple sessions were given in a single day. This study performed 10 Hz TMS on the superior frontal gyrus and found an increase in craving but did not find a decrease in craving with 1 Hz to the superior frontal gyrus (L, left; R, right).
B. State of the Science in Cocaine
Despite many years of research into the development of an effective medication for cocaine dependence, there still is no medication that has emerged as consistently effective. Research has explored a variety of neurobiological targets, including dopamine, serotonin, GABA, norepinephrine, and glutamate.
1. Brain Stimulation Research
To date, there have been seven published reports on the effects of rTMS for cocaine use disorder (Table 3). The majority of these studies have targeted the left DLPFC (n = 4), with one targeting the prefrontal cortex bilaterally. Two have chosen the MPFC as a target. Early studies evaluated the effects of just one session, whereas more recent work has explored outcomes after 8–12 sessions. All studies that stimulated the DLPFC, whether right, left, or both, have used high-frequency TMS (10 or 15 Hz). For studies that chose the MPFC as a target, cTBS was used. Although the exact parameters have yet to be determined, there are promising findings. For example, Terraneo et al. (2016) reported that left DLPFC stimulation alone led to a significantly greater number of cocaine-free urine tests compared with a control group that used pharmacotherapies. As in alcohol research, the MPFC is being explored as an alternative to the conventional DLPFC target. Hanlon et al. (2015b) reported that a single session of cTBS led to reduction in the stimulus evoke BOLD signal in the orbitofrontal cortex and striatum. Together these findings suggest that rTMS may be an alternative treatment or adjunct to a yet-to-be-discovered pharmacotherapy.
Studies that have used repetitive TMS as a tool to cocaine or methamphetamine craving
This study performed 10 Hz TMS on the superior frontal gyrus and found an increase in craving but did not find a decrease in craving with 1 Hz to the superior frontal gyrus (L, left; R, right).
C. State of the Science in Nicotine
1. Approved Pharmacotherapy
There are three FDA-approved medications used for smoking cessation. Nicotine replacement therapies such as transdermal patches, gum, nasal spray, inhaler, and lozenges offer the patient a safer and therapeutically manageable form of nicotine to alleviate the symptoms of withdrawal and craving. One drawback with nicotine replacement therapies is the potential to become dependent on the replacement if the patient does not wean as directed. The antidepressant, bupropion, acts as a neuronal reuptake inhibitor of dopamine and noradrenalin and has been shown to be efficacious as a first-line treatment of nicotine dependence (Hurt et al., 1997). Varenicline is a partial agonist that has high and selective activity at α4-β2 receptor. It has been FDA approved due to its efficacy in reducing craving and withdrawal symptoms during abstinence and blocking the reinforcing effects of nicotine (Coe et al., 2005; Gonzales et al., 2006; Jorenby et al., 2006).
2. Brain Stimulation Research
Since 2003, there have been 10 studies on rTMS and cigarette smoking (Table 4). As with other drugs of abuse, the DLPFC is the primary target (six left, one right, one both). The insula and superior frontal gyrus have been targeted in one study each. Each left DLPFC study chose to use high-frequency stimulation (10–20 Hz). Half of these studies used more than one session. In the largest randomized controlled trial to date, Dinur-Klein et al. (2014) delivered 13 sessions of either high- or low-frequency rTMS bilaterally to the lateral prefrontal cortex and insulae, with and without cue exposure immediately before stimulation. High- but not low-frequency TMS was effective in reducing the number of cigarettes smoked. Individuals randomized to the high-frequency and cue-exposed condition showed the largest reduction in cigarettes smoked. These context-dependent effects may have large consequences on the efficacy of rTMS and should be considered as an additional parameter for optimization. Although cue induction is common in the addiction field, and can lead to reliable limbic system activation, there are a number of alternatives. One example is executive control circuitry, as engaging this before or during treatment may also be effective. Toward this end, Sheffer et al. (2018) delivered eight sessions of self-help therapy combined with active rTMS or sham TMS. Despite the use of therapy in both groups, active rTMS showed significantly greater abstinence groups relative to sham. These findings add to the number of parameters that must be explored when designing a TMS trial; however, they both suggest that there is an opportunity to improve TMS treatment outcomes.
Studies that have used repetitive TMS as a tool to change nicotine craving
Multiple sessions were given in a single day. This study performed 10 Hz TMS on the superior frontal gyrus (SFG) and found an increase in craving but did not find a decrease in craving with 1 Hz to the SFG (L, left; R, right).
D. State of the Science in Opiates
1. Approved Pharmacotherapy
There are two general pharmacotherapy paths for opioid dependence, opioid maintenance treatment, or detoxification. Agonist and partial agonist medications are used for both maintenance and detoxification: α-2-adrenergic agonists used to enhance detoxification outcomes; antagonist medications used to accelerate the detoxification process. Methadone is a μ-opioid receptor agonist that is typically used as a replacement therapy for opioid dependence. Its long half-life (24–36 hours) allows it to be used as either a detoxification agent or for maintenance therapy (Ward et al., 1996). Buprenorphine is a partial agonist of μ-opioid receptors that has a slow onset and long duration, allowing for alternate day dosing for opioid maintenance treatment. As a partial agonist, it has a more reduced risk of unintentional overdose than methadone, but this may also reduce buprenorphine’s potential efficacy. A number of studies have shown the efficacy of buprenorphine over placebo for opioid maintenance. Mattick et al. (2004) showed that both methadone and buprenorphine are effective at decreased illicit opiate use and increased retention rates when higher doses of methadone (>60 mg) and buprenorphine (>8 mg) are used. The third FDA-approved pharmacotherapy for opioid dependence is the opioid antagonist naltrexone used for opioid maintenance. Naltrexone is safe, well tolerated, and effective at blocking the reinforcing properties of opiates. Unfortunately, in an analysis of 10 studies, Minozzi et al. (2011) showed weak support for the efficacy of naltrexone.
2. Brain Stimulation Research
In contrast to the variety of pharmacological treatments available for opiate dependence, there is a paucity of published reports on the effectiveness of rTMS. To the best of our knowledge, the only report of rTMS in opiate dependence is a short correspondence on 20 male heroin users. In this, Shen et al. (2016) reported a reduction in cue-induced craving after a single, 10-minute session of high-frequency stimulation to the left DLPFC, with further effects after an additional four treatments. Although the literature is currently limited, it is likely that this will soon change as a number of clinical trials are currently ongoing. Although present findings specific to opiate addiction are limited, there is a large body of evidence that rTMS is effective for reducing pain (for a review, see Galhardoni et al., 2015). Although many of these studies have focused on using the motor cortex as a target for stimulation, there is evidence that the DLPFC is also an effective target for pain reduction (Borckardt et al., 2007, 2008; Brighina et al., 2011; Taylor et al., 2013). This overlap represents a clinically meaningful and treatable target for both pain disorders and substance abuse. This is particularly important, considering opiate use disorders, which can be initiated or maintained by the presence of pain (Passik et al., 2006; Back et al., 2011; Barth et al., 2013; Lusted et al., 2013).
V. Moving Forward—Important Methodological Considerations
A. Conceptual Model
Despite the variety of TMS parameters used across different substance use disorders, a few clear trends have emerged. The DLPFC, whether left or right, is the most common target, although early results support alternative targets such as the MPFC or insula. Additionally, there is a growing interest in the context of TMS delivery, which includes current craving levels, cue induction, or executive control engagement. To make significant progress in TMS treatment development is critical to start from a robust conceptual model, which addresses the role of both the limbic system and the executive control system in maintaining successful abstinence in treatment-seeking individuals. Previous studies have demonstrated that high rates of relapse may be due to dysfunction in at least two neural circuits: 1) elevated functional activity within limbic neural circuitry, in the presence of a salient cue (Moeller et al., 2001; Ersche et al., 2011) (including the MPFC and ventral striatum) or 2) depressed activity in executive control circuitry (Goldstein et al., 2004; Kubler et al., 2005; Moeller et al., 2010), which can counteract limbic drive (including the DLPFC and dorsal striatum) (Fig. 3). One model that addresses both of these aspects is the CNDS theory. The CNDS theory poses that, in a pathologic drug use state, there is elevated activity in frontal–striatal circuits involved in limbic reward and impulsive action, as well as relatively lower activity in executive control circuitry. Intervention efforts could therefore be directed at either decreasing impulsive reward circuit activity to cues or increasing the executive control circuit activity to cues. This model logically extends to at least two potential strategies for improving treatment outcomes in patients, as follows: strategy 1, increase executive control network, or strategy 2, decrease craving/cue-reactivity networks through ventromedial prefrontal cortex (vMPFC) or orbital frontal cortex (OFC) TMS. Whereas most of the studies to date have evaluated strategy 1, the importance of strategy 2 is underscored by the transdiagnostic relevance of cue reactivity as a predictive indicator of relapse.
Frontal–striatal circuits that contribute to vulnerability to cues and brain stimulation strategies to modulate these circuits.
Many studies investigating cue reactivity in either cocaine-, nicotine-, or alcohol-dependent populations have independently demonstrated that drug cues evoke elevated activity in the medial prefrontal cortex, anterior cingulate, and insula cortex. Most of these studies focus on one substance-using class, however, and therefore it is difficult to distinguish which aspects of cue reactivity are transdiagnostic biomarkers of the addiction process versus those that are specific to alcohol, cocaine, or nicotine dependence. Several retrospective meta-analyses have demonstrated that the medial prefrontal cortex and cingulate cortex are reliably activated to drug cues (Schacht et al., 2013). Other meta-analyses have demonstrated that activity in these brain regions may predict relapse across multiple substances (Killen and Fortmann, 1997; O’Connell et al., 2011; Courtney et al., 2016).
B. Choosing a Target
The DLPFC and vMPFC are only two of many potential treatment targets for TMS treatment development in addiction. The prefrontal cortex is often divided into six discrete areas (known as Brodmann areas 9, 10, 11, 12, 46, and 47), which were defined in 1909 by German scientist Korbinian Brodmann. For example, Brodmann areas 9 and 46, often referred to as the DLPFC, contribute to executive processing tasks, including planning future events, decision making, and the coordination of purposeful behavior (Miller and Cohen, 2001). Brodmann areas 10, 11, 12, and 47 are each involved in reward signaling, assigning value, arousal, and emotional processing (Goldstein and Volkow, 2002). Together, these prefrontal regions all play key roles in addiction disorders.
1. Dorsolateral Prefrontal Cortex
The importance of the DLPFC in conscious decision making, reasoning, working memory, inhibition, as well as outcome prediction (see Krawczyk, 2002), and its established reputation as a successful treatment target for TMS in patients with depression, all suggest that the DLPFC is most likely a very good candidate for TMS treatment development in substance use disorder. The DLPFC can be directly stimulated with traditional figure-of-eight TMS coils and circular TMS coils.
The majority of studies in TMS to date have focused on this brain region. The biggest trial to date was a cohort study of 115 treatment-seeking smokers randomized to receive 13 sessions of 10, 1 Hz, or sham TMS after viewing smoking cues. An H-coil (which induces a wider, deeper electromagnetic field in the brain than a figure-of-eight coil) focused on the left insula and lateral prefrontal cortex was used for this experiment. Ten hertz (LTP-like) rTMS decreased cigarette consumption and improved 6-month abstinence rates (Dinur-Klein et al., 2014). These data complement other evidence that the insula can be modulated by TMS (Gratton et al., 2013), and that functional connectivity (Moran-Santa Maria et al., 2015) and anatomic integrity (Naqvi et al., 2007) of the insula are critical for craving. A greater understanding of the neurobiological effects of these brain stimulation tools and protocols may allow us to more effectively translate preclinical knowledge into efficient, evidence-based treatments for patients.
2. Ventral Medial Prefrontal Cortex and Orbitofrontal Cortex
The MPFC extends throughout the medial section of the frontal cortex and into the OFC (BA 10). The ventral aspects of the MPFC typically are involved in mediating arousal, whereas the dorsal aspects of the MPFC play an important role in the cognitive decrements seen in individuals with substance use disorders (Bolla et al., 2003; Kaufman et al., 2003; Kubler et al., 2005). The OFC is located on the ventral section of the PFC and contributes to reinforcement of cocaine (e.g., with nucleus accumbens, thalamus, ventral striatum, and indirectly with amygdala, cingulate, hippocampus). Acute cocaine administration, for example, leads to elevated activity in the OFC, which may act as an information integrator, leading to reinforcement of drug taking (Volkow and Fowler, 2000). The OFC is involved in response inhibition and learning the association between a stimulus and outcome (Kringelbach and Rolls, 2004). Dysregulation of the OFC most likely perpetuates habitual drug use behavior as well as risky decision making, an inability to anticipate outcomes (see Krawczyk, 2002).
3. Relationship to Transcranial Magnetic Stimulation Treatment Development
The primary cortical inputs to the ventral striatum are the medial and orbital prefrontal cortices. Given that the ventral striatum is one of the primary brain regions involved in processing drug-associated reward, it seems that targeting the MPFC would be a more direct method to modulate ventral striatal activity than DLPFC stimulation. Specifically, a single pulse of TMS to the MPFC in healthy individuals leads to an increase in BOLD signal in the ventral striatum (Hanlon et al., 2013b). A recent study in cocaine users demonstrated that they have a hyperactive BOLD response in the dorsal and ventral striatum relative to controls (Hanlon et al., 2016). This elevated ventral striatal sensitivity following MPFC stimulation, a frontal–striatal circuit involved in the limbic aspects of craving, may be a prime circuit to attenuate to make these individuals less vulnerable to drug-related cues. Given that craving is associated with an increase in activity in the striatum (e.g., BOLD signal), LTD-like rTMS over the MPFC may attenuate activity in this neural circuit.
Our laboratory has spent the last 7 years systematically developing a TMS as an empirically derived treatment of cocaine use disorder and alcohol use disorder, wherein the ventral MPFC and OFC are the prime targets of interest. We have demonstrated that it is possible to differentially activate the vMPFC from the DLPFC using interleaved TMS/functional MRI (Hanlon et al., 2013b); shown that connectivity with the vMPFC was significantly different in the cocaine users relative to healthy controls and DLPFC connectivity was similar to controls (Hanlon et al., 2016); evaluated the feasibility of a vMPFC-focused treatment strategy for TMS (Hanlon et al., 2015b); and demonstrated that continuous TBS could dampen activity in the vMPFC, insula, and cingulate cortex (Hanlon et al., 2017). This attenuation was present in both the cocaine users (Fig. 4) and the alcohol users.
The effect of frontal pole cTBS on brain reactivity in cocaine users and alcohol users (adapted from Hanlon et al., 2015, 2017). Interleaved TMS/BOLD imaging was used to measure TMS-evoked BOLD signal immediately before and after cocaine users (B) and heavy alcohol users (C) were given a dose of cTBS to the left frontal pole (A). The TMS coil was placed over FP1 (EEG:10-20 system) for both the interleaved TMS/BOLD scan (left and right panel) and the cTBS session (center panel). The red area represents the region of interest to which the coil is targeted (AAL: left superior and middle orbital prefrontal cortex inferior to the anterior commissure). Real cTBS (LTD-like) led to a significant decrease in BOLD signal in the left orbital/medial prefrontal cortex and ventral striatum (SPM 8, P < 0.05 family wise error correction, negative Z-scores shown). The cTBS protocol was two trains of 1800 pulses, 110% rMT, 60-second intertrain interval, intensity ramped from 80% to 110% over first 30-second L = left hemisphere. These data reveal that 3600 pulses of real cTBS to the left frontal pole decrease stimulus-evoked activity in the MPFC, cingulate, and striatum of cocaine users and MPFC and insula of alcohol users significantly more than sham cTBS.
4. Anterior Cingulate Cortex
The anterior cingulate cortex (ACC) is part of the limbic system and is involved in attention, emotion regulation, error monitoring, inhibitory control, and motivation (Bush et al., 2000). Relative to nondrug-using controls, cocaine users have lower rates of glucose usage in the ACC and OFC as measured with fluorodeoxyglucose and PET (Volkow et al., 1991, 1992, 2005; Goldstein and Volkow, 2002; Goldstein et al., 2004). These depressed rates of functional activity have been reported to persist for up to 3 (Volkow et al., 1993) to 5 months (Hanlon et al., 2013a) of abstinence. The ACC has increased activity during cocaine craving following administration (Breiter et al., 1997; Garavan et al., 2000; Maas et al., 1998; Risinger et al., 2005), and its activity is negatively correlated with reports of cocaine high. There is, however, a positive correlation with rush (Breiter et al., 1997). Cocaine users have decreased activity relative to controls in the ACC when completing a task requiring cognitive inhibition (Kaufman et al., 2003; Hester and Garavan, 2004) and visual attention (Kubler et al., 2005). From a structural perspective, cocaine users have decreased gray matter density in the ACC compared with controls (Matochik et al., 2003), and this reduction has been found to be greater for those with a longer history of abuse (Franklin et al., 2002; Ersche et al., 2011).
Additionally, activity in the ACC has been consistently linked to an enhanced attentional bias to smoking cues (Janes et al., 2009), alcohol cues (Vollstadt-Klein et al., 2012), and cocaine cues (Goldstein et al., 2009). Attentional bias is one of the most studied cognitive processes in addiction, as it is often linked to drug craving and relapse (Field and Cox, 2008). Several studies have, in fact, demonstrated that higher levels of ACC activity during an attentional bias task predict higher relapse probability in smokers (Janes et al., 2010) and cocaine users (Marhe et al., 2013).
5. Insula
The insula is a cortical structure located deep in the brain between the frontal and the temporal lobes, which has four subregions that are defined based on their cytoarchitecture: posterior/dorsal insula (granular), intermediate insula (dysgranular), anterior/ventral insula (agranular), and the fronto–insular cortex (agranular), which is only present in humans and great apes. Anatomical, visual, and functional imaging studies have shown that the fronto-insular and anterior subregions of the insula are extensively connected with the orbitofrontal cortex, anterior cingulate cortex, and the dorsal lateral prefrontal cortex (Bauernfeind et al., 2013). From a functional perspective, there appears to be laterality within the insula wherein the right anterior insula is elevated by negative emotional valence and sympathetic activation, whereas the left anterior insula is associated with positive affect and parasympathetic activation (Craig et al., 2000; Critchley et al., 2004).The insula has dense structural connectivity with the amygdala, basal ganglia, thalamus, OFC, and PFC, placing it as an important structural and functional hub involved in drug and alcohol use and relapse (see Singer et al., 2009). The insula has elevated activity, for example, in paradigms exploring cocaine craving as well as acute cocaine high (Kilts et al., 2001; Bonson et al., 2002; Risinger et al., 2005). The volume of the insula is also smaller and correlated with length of cocaine user among cocaine users compared with sibling controls (Ersche et al., 2011). Small insula volume is also associated with decrements in attentional control (Ersche et al., 2011; Hanlon et al., 2011). A large study by McHugh et al. (2013) demonstrated that cocaine users (n = 45) had lower connectivity between the insula and putamen than healthy controls (n = 22). They also showed increased impulsivity in cocaine-addicted individuals that was mediated by reduced insula–putamen connectivity.
6. Relationship to Transcranial Magnetic Stimulation Treatment Development—Anterior Cingulate Cortex and Insula
The ACC and the insula are nodes in the Salience network, a functional connectivity network in the brain which is involved in attentional bias and task switching. Given the importance of these processes to addiction, there is a lot of interest in directly modulating this network with rTMS. Whereas traditional figure-of-eight coils cannot directly reach the insular cortex or the ACC due to the magnetic field decay. It is possible to indirectly modulate the insula and ACC by stimulating the DLPFC (Nahas et al., 2001) or the frontal pole (Hanlon et al., 2017). This indirect modulation via both the dorsal lateral and ventral medial aspects of the cortex is due to the very high anatomic connectivity that exists between the anterior insula and these prefrontal regions. It is likely also possible to directly target the ACC and the anterior or posterior insula through novel TMS coil designs such as the H-coil design series. These coils have a unique geometry that enables their direct penetration depth to be as deep as 3–5 cm, which is most likely sufficient to engage the ACC and anterior insula (Deng et al., 2015). Hence, H-coils are actively being evaluated to addiction treatment development (Dinur-Klein et al., 2014). Targeting the insula via cTBS treatment of the MPFC may reduce the activation when experiencing cocaine craving and high shown by Bonson et al. (2002) and Kilts et al. (2001).
C. Combining Pharmacology with Brain Stimulation
In section Single Pulse Transcranial Magnetic Stimulation: A Biomarker and Probe, we discussed ways in which TMS has been used as a tool to evaluate the effect of various pharmacotherapies on the brain. In section Repetitive Transcranial Magnetic Stimulation: An Interventional Tool, we discussed ways in which pharmacologically sensitive tools (e.g., PET and spectroscopy) have been used to evaluate the effect of rTMS on the brain. A third, very interesting concept to consider is how these two therapeutic approaches—brain stimulation and pharmacotherapy—might be combined in a synergistic manner. Although there are presently no studies in the drug or alcohol addiction literature that have directly evaluated the combined effects of rTMS and pharmacotherapy, there are several studies in healthy individuals that suggest that combining these two approaches may have supraordinal effects on neuroplasticity (for a review, see Ziemann et al., 2015). In this work, we highlight the possibilities that these combinations represent, but also draw attention to the variety of new challenges that are created.
Ideally a protocol could combine a safe pharmacological treatment with brain stimulation to enhance or stabilize the desired effects. Most of these studies have been done using paired associative stimulation (PAS) and transcranial direct current stimulation (TDCS). PAS and TDCS are unique noninvasive brain stimulation protocols that, like rTMS, can induce increases or decreases in cortical excitability. With PAS, peripheral stimulation is delivered to the median nerve, whereas TMS is delivered to the cortex. With a 10-ms delay between peripheral and cortical stimulation, MEPs are reduced (PAS-LTD) (Wolters et al., 2003); at 25 milliseconds, the resulting MEPs are larger (PAS-LTP) (Stefan et al., 2000). With TDCS, a pair or an array of electrodes is placed on the scalp. The electrodes are typically 2–20 cm apart. One electrode acts as the anode, leading to increased cortical excitability in the underlying cortex, and the other as the cathode, causing inhibition (Nitsche and Paulus, 2000). Several studies using these approaches have demonstrated that D-cycloserine (Nitsche et al., 2004b), amphetamine (Nitsche et al., 2004a), and nicotine (Thirugnanasambandam et al., 2011) may increase the LTP-like effects of brain stimulation. There have not been any studies to date that have evaluated these pharmacotherapies as potential adjuvants to rTMS treatment.
Although these studies show promising synergistic effects with brain stimulation, the majority of pharmacological interventions evaluated to date appear to block the facilitation or inhibition associated with brain stimulation. This includes medications such as dextromethorphan (Liebetanz et al., 2002; Nitsche et al., 2003) diazepam (Heidegger et al., 2010), baclofen (McDonnell et al., 2007), and propranolol (Nitsche et al., 2004a). Although, ideally, we would like to discover a combination of pharmacotherapy and brain stimulation that has additive effects, knowledge about pharmacotherapeutic agents that blunt the effects of rTMS is also very valuable to the field. For example, a treatment-seeking alcohol user who is using diazepam (a benzodiazepine) to treat coexisting anxiety may not receive the same therapeutic effect from rTMS as one of his/her peers who is not taking diazepam. It is unclear, of course, whether these blunting effects apply to all benzodiazepines. Additionally, whereas D-cycloserine appears to increase the effects of TDCS (Nitsche et al., 2004b), another study demonstrated that it reverses the effects of intermittent TBS, causing iTBS to inhibit cortical excitability, rather than facilitate it as would have been predicted (Teo et al., 2007).
Presently there are not enough data combining pharmacology with rTMS to make any definitive conclusions. Further work is also required to determine whether these early results extend beyond the scope of motor cortex stimulation. In the near future, we are optimistic that significantly more attention will be given to multimodal approaches to neurologic and psychiatric treatment—harnessing both pharmacotherapy and brain stimulation interventions. By combining these approaches with magnetically sensitive nanoparticle technology, it may even be possible to move toward a drug delivery platform that uses targeted brain stimulation focus pharmaceutical delivery to a specific neural circuit. There are, of course, still many wide gaps in our knowledge that need to be filled before this type of precision-medicine approach can be reached.
D. Combining Cognitive Training/Therapy with Brain Stimulation
This review has focused on potential neural targets for rTMS development and the pharmacological effects of rTMS. Another critical aspect of TMS treatment development for substance use disorder is if, and how, to combine it with existing behavioral therapies for substance use disorder. At the end of the day, all treatment development approaches for substance use need to focus on changing behavior. Whereas changing drug-taking behavior (e.g., cigarette abstinence, reduction in alcohol drinking) is the dependent measure currently deemed most important for FDA approval, there are a number of other critical, disabling behavioral hallmarks of the addiction recovery process that clinical treatment researchers are investigating. These include impulsivity, craving, cognitive set shifting, and assigning value to future rewards (e.g., delayed discounting). These behavioral domains are often described as transdiagnostic phenotypes of addiction and have been evaluated in both clinical and preclinical substance use research (Garavan and Hester, 2007; Beveridge et al., 2008; Stalnaker et al., 2009). Moving forward it will be important to identify which of these behavioral phenotypes are most responsive to various forms of pharmacotherapy, behavioral retraining therapy, and ultimately brain stimulation therapy. Through the integration of these components, we will be much more likely to generate individually tailored therapies for individuals that are at various stages of the continuum from drug use vulnerability, to dependence, relapse, and ultimate freedom from powerful, short-term reward of the drug.
1. Task-Dependent Amplification of Transcranial Magnetic Stimulation Effects
One of the most interesting areas of recent methods development in neuromodulation involves choosing a task for the participants to perform (or a thought pattern to engage in) before or during the intervention. Translating established principles of task-dependent plasticity in animals to human clinical experiments, Dinur-Klein et al. (2014) were the first to demonstrate that it is possible to amplify the effects of TMS on smoking cessation by having individuals engage in a smoking cue-reactivity task immediately before the TMS session. In this large, double-blind, sham-controlled study of 115 cigarette smokers, individuals were randomized to receive 10 or 1 real or sham TMS for 13 sessions. Half of these participants were presented with visual cues of smoking for 20 minutes before the TMS session (Brainsway H-ADD coil; 120% resting motor threshold, left insula, and lateral prefrontal cortex). The group receiving 10 Hz TMS (but not 1 Hz) had significantly lower cigarette consumption and nicotine dependence than sham TMS. There was a significantly better outcome in the individuals that had been exposed to the smoking cues as measured by their change in the Fagerstrom test for nicotine dependence score and their abstinence rates (44% at the end of the trial; 33% 6 months later).
These results are comparable to treatment with varenicline, which has a 44% abstinence rate at the end of treatment (12 weeks) and 29.5% 6 months later. TMS treatment in this study appears to be better than treatment with bupropion hydrochloride (Wellbutrin Sustained Release), which has a 29.5% abstinence rate at the end of treatment (12 weeks) and 20.7% 6 months later (Gonzales et al., 2006).
Task-dependent amplification of TMS effects also applies to treating post-traumatic stress disorder (PTSD) (Isserles et al., 2013). In this study, 30 PTSD patients were randomized to one of three groups: sham rTMS, real rTMS following exposure to a 30-second patient-tailored trauma script, or real rTMS following exposure to a 30-second patient-tailored neutral script. The participants received 12 sessions of real or sham rTMS (three sessions/week, 4 weeks, Brainsway H-coil). The only group with a significant improvement in the clinician-administered PTSD scale was the group that received exposure to 30-second trauma scripts before their rTMS treatment. Although the mechanism through which cue exposure enhances the behavioral effects of rTMS is not clear, one possibility is that cue exposure reactivates latent memory traces (frequently referred to as the engram) (Josselyn et al., 2015), enabling them to be manipulated and reconsolidated (Dudai and Eisenberg, 2004; Dudai, 2006). To our knowledge, this has not been directly evaluated in patients with either substance dependence or PTSD.
Based on these empirical results from clinical studies and a strong preclinical foundation for task-dependent plasticity, all experiments in our brain stimulation laboratory now use a standardized behavioral prime, which is given before and during the brain stimulation intervention. For our present investigations using the vMPFC as a target, this behavioral prime includes a standardized drug-cue exposure paradigm based on standardized exposure therapy treatment questions (Concurrent Treatment of PTSD and Substance Use Disorder Using Prolonged Exposure Handbook). Specifically, participants are prompted to describe their most recent (index) drug use event (e.g., day of the week, time of the day, people they were with, and the sensory aspects of the experience). For some of our studies, individuals are then prompted: “During the stimulation, it is important for you to try to focus on (insert their drug of choice: cocaine, crack, alcohol, liquor, beer, wine, cigarettes, painkillers). This tablet will be displaying various pictures of (insert: cocaine/crack, alcohol drinking, cigarettes, painkillers). We would also like you to keep your eyes open, look at the screen, and think about your most recent experience with (insert: cocaine/crack, alcohol drinking, cigarettes, painkillers).” For other protocols, especially those in which we are using the DLPFC as our target (based on a conceptual framework of increasing cognitive control), they are prompted with statements that they are taught in cognitive behavioral therapy as they view the drug cues. Although the cues are routinely tailored to the patient group, and will change based on conceptual strategy for a specific TMS protocol, one thing that remains stable is the existence of a behavioral prime. Full details of the standard operating protocol and a description of the questions used to create these participant-tailored drug use scripts are included in prior work (Hanlon et al., 2017). In the future we anticipate that cutting-edge brain stimulation laboratories and clinics will capitalize on the increasingly widespread availability of virtual reality gaming environments that could be customized and adapted to treatment-seeking drug users and drug use treatment.
E. Summary
TMS can be used as both a probe of cortical excitability and an interventional tool to change neural excitability. When applied to addiction treatment development, TMS may be an innovative way to examine the effects of single or combinations of various pharmacotherapeutic agents on cortical excitability. Given that the chemical composition of the cortex is dynamic and heterogenous, it may be useful to use TMS as a tool to quantify the effects of these novel therapies on excitatory or inhibitory tone in the cortex—an opportunity that is particularly appealing when the effects are combined with various neuroimaging approaches such as interleaving TMS and MRI or interleaving TMS with magnetic resonance spectroscopy.
As an interventional tool, we are most likely only in the very first chapter of our education on its utility as a treatment tool in various substance use disorders. Building on data from the depression field (for which TMS is currently FDA approved), we are now beginning to build a foundation of knowledge regarding its utility as a tool to change smoking, drinking, and cocaine use behavior. Although there are several concepts of rTMS treatment that are robust and replicable (e.g., regional specificity, depth of the magnetic field, dose-dependent amplification of behavior, polysynaptic engagement, frequency-dependent effects), there are still many key components of TMS treatment development that have not been widely explored (e.g., optimal number of sessions per day, optimal number of sessions total, effects of TMS on drug use behavior when it is applied to areas other than the DLPFC, the use of behavioral primes to amplify TMS treatment effects, the effects of applying TMS before versus after behavioral therapy, the use of TMS to amplify pharmacotherapy treatment). As the field of addiction moves forward with pursuing rTMS as a new tool to modulate craving and the frontal-striatal circuits that contribute to chronic use and relapse, it will be important to consider all of the important factors including but not limited to: optimal anatomical site, frequency of stimulation, and target patient population.
The data presented in this review demonstrate that whereas most of the efforts for rTMS in addiction have been focused on increasing activity in the DLPFC, decreasing activity in the MPFC and ventral striatum may also be a feasible and fruitful target to consider. It seems plausible that either increasing neural firing in the executive control circuit (perhaps via 10 Hz TMS in the DLPFC) or decreasing firing in the limbic circuit in the presence of cues (perhaps via cTBS TMS in the MPFC) may be valuable strategies for decreasing vulnerability to drug- related cues among our patients. Before moving forward with slow and expensive clinical trials, however, it is important to have a comprehensive understanding of limbic and executive circuit functioning in a diverse cross section of patients with drug use disorders. With this knowledge, we will be able to develop circuit-specific treatment strategies for these populations. It will be critical to determine which patients are likely to maximally benefit from TMS and whether strategy 1 or strategy 2 is ideal for a given patient based upon his or her neurobiological and behavioral phenotype.
We have attempted to introduce TMS as an innovative new tool that can modulate brain activity in a circuit-specific, frequency-dependent manner as well as to review the current knowledge regarding the pharmacologic effects of TMS. Although the development of TMS as a new treatment tool for addiction is still in its infancy, we hope we have planted several seeds in the reader’s mind regarding the need to develop a neural circuit–based treatment tool that is available to our patients and the need to increase our knowledge regarding the synergy between pharmacotherapeutics and brain stimulation interventions. Based on a large body of knowledge that suggests frontal–striatal circuit activity is a significant biomarker for predicting treatment outcome, through noninvasive brain stimulation techniques such as rTMS, it may be possible to develop a neural circuit–based treatment of our patients. It is important to note, however, that brain stimulation alone is likely not sufficient for inducing lasting behavioral change. Just as the plasticity potential of a primed neuron is higher than an unprimed neuron, TMS likely has higher efficacy when an individual is engaged in the cognitive process they wish to amplify or attenuate. Hence, TMS is likely to be most effective when combined with a pharmacotherapeutic agent that lowers the threshold for cortical excitability or with behavioral interventions such as cognitive behavioral therapy, exposure therapy, or contingency management. Unfortunately, whereas the aforementioned statements are based on preclinical literature and human learning theory, they have not yet been rigorously evaluated.
As the field continues to grow, we hope to see more interactions between clinical and preclinical neuroscience researchers from both an electrophysiology background and a pharmacology background. Rigorous preclinical TMS-dosing studies in various addiction models are needed to comprehensively evaluate the full parameter space of dosing variables (e.g., optimal stimulation frequency, optimal number of pulses per day, optimal number of days required for a durable effect, optimal stimulation site). With any luck, through the continued refinement of TMS as a tool to modulate neural circuits, we will soon be rigorously evaluating noninvasive brain stimulation as a tool to enhance and refine pharmacotherapeutic development for substance use disorders. Just as Perseus required the aid of Cadmus and Bellerophon to ultimately slay Medusa, and Jason required the band of Argonauts to obtain the quest for the Golden Fleece, the quest for a sustainable addiction treatment solution will undoubtedly require a complementary approach to modifying the pharmacology, neural circuitry, and ultimately the behavioral phenotypes present in our patients.
Acknowledgments
We thank Sarah Hamilton and Dr. Audrey Padula for their assistance and contributions to the editing and formatting of this manuscript.
Authorship Contributions
Participated in research design: Hanlon.
Performed data analysis: Hanlon, Dowdle, Henderson.
Wrote or contributed to the writing of the manuscript: Hanlon, Dowdle, Henderson.
Footnotes
This work was supported by National Institutes of Health National Institute of Drug Abuse [Grants R01DA03661, T32DA007288, and F31DA043330], National Institute of General Medical Science [Grant P20 GM109040-04], and National Institutes of Health [Grants R01DA03661, R21DA041610, P50AA010761, P20GM109040, T32DA007288, F31DA043330, and P20 GM109040].
Abbreviations
- ACC
- anterior cingulate cortex
- BOLD
- blood-oxygen-level dependent
- CNDS
- competing neurobehavioral decision system
- CSP
- cortical silent period
- cTBS
- continuous TBS
- DLPFC
- dorsolateral prefrontal cortex
- EEG
- electroencephalography
- FDA
- Food and Drug Administration
- ICF
- intracortical facilitation
- ICI
- intracortical inhibition
- iTBS
- intermittent TBS
- LTD
- long-term depression
- LTP
- long-term potentiation
- MEP
- motor-evoked potential
- MPFC
- medial prefrontal cortex
- MRI
- magnetic resonance imaging
- MT
- motor threshold
- OFC
- orbital frontal cortex
- PAS
- paired associative stimulation
- PET
- positron emission tomography
- PTSD
- post-traumatic stress disorder
- rMT
- resting motor threshold
- rTMS
- repetitive TMS
- SAI
- short-interval afferent inhibition
- TBS
- θ burst stimulation
- TDCS
- transcranial direct current stimulation
- TMS
- transcranial magnetic stimulation
- VMPFC
- ventral medial prefrontal cortex
- Copyright © 2018 by The American Society for Pharmacology and Experimental Therapeutics