Development of a patient-reported assessment to identify placebo responders in a generalized anxiety disorder trial

https://doi.org/10.1016/j.jpsychires.2009.04.001Get rights and content

Abstract

Placebo response is thought to be a primary contributor to uninformative (failed) trials in clinical drug development. This study describes the development of a patient-reported assessment to detect likely placebo responders. A novel scale, the Placebo Response Screening Scale (PRSS), was developed to assess domains expected to be associated with placebo response. The scale was administered during the screening visit of a 4-week, placebo-controlled study of alprazolam and an investigational compound in 211 patients with generalized anxiety disorder (GAD). Items that predicted placebo response were identified. Sensitivity and specificity of the instrument were used to determine a threshold score for use in screening likely placebo response. The PRSS was then evaluated by comparing active treatment and placebo groups and subsetting the groups based on subject PRSS scores. Twenty items were selected for being predictive of patient global improvement rating, clinician global improvement rating, or improvement on Hamilton Rating Scale for Anxiety (HAM-A) scores in placebo-arm patients. Receiver operating characteristic concordance values ranged from 0.77 to 0.96 for the different definitions of placebo responder. A cut-score of 50 on a scale of 0–100 was chosen to maximize sensitivity (range 0.67–0.79) and specificity (range 0.78–1.00). Fifty-six patients with scores of 50 or higher were flagged as potential placebo responders. Excluding these 56 patients from the analysis resulted in a greater separation of active treatment from placebo. The PRSS is a promising tool for predicting placebo response in clinical trials and requires further use and validation.

Introduction

Placebo-controlled trials have been used to identify effective psychotropic medications for the past 50 years, and are necessary to demonstrate a specific treatment effect of drug candidates in indications where there is a variable degree of improvement over time. Unfortunately, a known active control drug (i.e., a marketed medicine with demonstrated efficacy in the study population) sometimes fails to demonstrate a treatment effect, indicating a lack of assay sensitivity. When the active drug fails to separate from placebo, the study has failed. The uninformative results from failed trials require costly repetition of studies, exposing additional subjects to potentially ineffective drug candidates. Failed trials have been a significant problem in studies of subjects with major depressive disorder, where approximately half of placebo-controlled trials have been reported to fail to distinguish a known active control from placebo (Khan et al., 2002a). Failed trials have also been a significant problem in studies of anxiety and other disorders. For example, Khan et al. (2002a), in a review of the available data in the FDA SBA database, found that only 45% of anxiolytics produced statistically significant results in GAD clinical trials. Trials with a high placebo response are thought to be less likely to distinguish known active controls from placebo.

A number of investigations have tried to identify predictors of placebo response in order to minimize this response and improve trial outcomes. Stein et al. (2006) found that placebo response in GAD and major depressive disorder (MDD) was not related to gender, age at onset of disorder, or duration of episode. Enhanced placebo response has generally been associated with lesser symptom severity in anxiety and depression studies, although not always (Khan et al., 2002b, Stein et al., 2006, Schweizer and Rickels, 1997). In concordance with this, greater treatment benefits have generally been shown in more severely ill patients in depression and anxiety disorder clinical trials (Khan et al., 2005, Stein et al., 2006, Pande et al., 2000, Kirsch et al., 2008), but data to support this are stronger for depression trials than for anxiety disorder trials. Efforts to increase symptom severity exclusion criteria raise concerns about the possible upward-biasing of subjective rating scale scores (Mundt et al., 2007) and decreased recruitment.

In addition to clinical variables associated with specific anxiety disorders, as well as demographic characteristics, if one looks across a variety of clinical disorders and experimental paradigms, a number of psychological and contextual factors have been suggested to contribute to the placebo response (Price et al., 2008). Psychological variables suggested to be associated with placebo response have included motivations (Geers et al., 2005), social acquiesence (traditionalism) (McNair et al., 1979), and openness to experience and suggestibility (De Pacalis et al., 2002). Substantial evidence indicates that a patient’s expectations of nonvolitional responses to a therapy (response expectancies) can have a substantial influence on the magnitude of the placebo response; and that manipulation of these response expectancies through verbal suggestion or other means can change the magnitude of the placebo response (Kirsch, 1985, Pollo et al., 2001). The therapeutic alliance can have a substantial effect on treatment response, in some instances including response to placebo (Horvath and Symonds, 1991, Schweizer and Rickels, 1997). Prior experience with treatment (Colloca and Benedetti, 2006) and classical conditioning (Goebel et al., 2002, Benedetti et al., 2003) are additional contextual factors that have been associated with the placebo response, and classical conditioning may be one mechanism that shapes expectancies (Stewart-Williams and Podd, 2004). Placebo effects may be most pronounced when psychological factors, such as motivation and suggestibility, combine with contextual factors (Geers et al., 2005, De Pacalis et al., 2002, Hyland et al., 2007).

Past efforts to identify patient characteristics that can be used to exclude placebo responders from clinical trials of new anxiolytics in development have met with limited success. This may not be surprising as, in general, in industry-sponsored clinical trials, relatively limited information is collected prior to randomization that addresses the psychological and contextual factors that are thought to contribute to the placebo response.

In order to further understand the placebo response and to begin the development of a measure that could be used to prospectively identify subjects as likely placebo responders, we developed a series of questions based on concepts hypothesized to be components of the placebo response and compiled them into a patient-reported assessment, the Placebo Response Screening Scale (PRSS), and then evaluated the PRSS as a predictor of placebo response in a GAD trial.

This study describes the development and evaluation of the PRSS and then examines the resulting impact of excluding potential placebo responders from the analysis of the Hamilton Rating Scale for Anxiety (HAM-A) (Hamilton, 1959) total score in a placebo controlled double-blind randomized clinical trial.

Section snippets

Methods

The study consisted of two phases: (1) instrument development and (2) instrument evaluation. The instrument development phase included a literature review, discussions with psychologists and experts on clinical trials and placebo response, and cognitive debriefing interviews. A description of the methods and results for the instrument development phase is provided as supplementary materials on the journal website. Evaluation of the instrument involved assessing the predictive properties of the

Subject selection

Data were collected during a randomized, four-week, double-blind, multi-center, fixed-dose, placebo-controlled clinical study in the United States. The study arms included one marketed GAD treatment (alprazolam 1mg bid), two doses of an active test drug (PD 0332334 100 mg bid and PD 0332334 250 mg bid), and a placebo group. The three active treatment arms were collapsed for the purpose of the treatment versus placebo comparisons in this report. The PRSS was an exploratory instrument included in

Results

The refined PRSS resulting from the instrument development phase and tested in the instrument evaluation phase consisted of 41 items as shown in Table 1. The first 37 items employed a 9-point response scale (1 = “Completely disagree” to 9 = “Completely agree”); Items 38 and 39 used a 5-point scale (“0,” “1,” “2–3,” “4–5,” and “5 or more”) that reflected frequency; Items 40 and 41 employed a 7-point response scale (1 = “Very much better”, 2 = “Much better”, 3 = “A little better”, 4 = “Unchanged”, 5

Instrument evaluation

A total of 211 subjects were included in the intent-to-treat population. Sample characteristics are summarized in Table 2. More than two-thirds of the sample was white (68.7%), 62.6% of the sample was female, and the average age was 38.8 years. Fifty placebo group subjects (68% white, 52% female) completed the study and 177 subjects completed the PRSS. Item-level descriptive statistics showed PRSS item non-response to be very low and there were no item distribution anomalies.

Discussion

We have developed a patient-reported assessment, the PRSS, and employed it in a clinical trial. In this study, the 20-item PRSS, shown in Table 1, exhibited highly satisfactory properties, including validity, sensitivity, and specificity. With these advantages in mind, but given the exploratory nature of the analyses presented here, we recommend further exploration of the entire 41-item PRSS, with particular emphasis on the 20 items identified in this study. Because scale refinement is an

Role of the funding source

This work was funded by Pfizer Inc. Pfizer Inc. was involved in all aspects of this work.

Contributors

Dr. Feltner, Dr. Lenderking and Dr. Morlock were involved in the design of the original version of the PRSS. Dr. Feltner and Dr. Morlock were involved in the design and conduct of the clinical study. Dr. Hill and Dr. Williams did the statistical and psychometric analyses. All authors contributed to planning the statistical and psychometric analyses, to the data analysis and interpretation, and to writing the manuscript. Dr. Feltner was the primary author.

Conflict of interest statement

Dr. Feltner is an employee of and owns stock in Pfizer Inc. Dr Morlock and Dr. Lenderking were employees of Pfizer Inc. at the time this work was conducted. Dr. Hill and Dr. Williams were consultants hired by Pfizer Inc.

Acknowledgements

The authors wish to thank Dr. Robert Berman and Dr. George Haig for commenting on the original version of the PRSS.

References (33)

  • M.U. Goebel et al.

    Behavioral conditioning of immunosuppression is possible in humans

    FASEB Journal

    (2002)
  • D.M. Green et al.

    Signal detection theory and psychophysics

    (1966)
  • W. Guy

    ECDEU assessment manual for psychopharmacology (United States Department of Health, Education, and Welfare Publication No. 76-338)

    (1976)
  • M. Hamilton

    The assessment of anxiety states by rating

    British Journal of Medical Psychology

    (1959)
  • A.O. Horvath et al.

    Relation between working alliance and outcome in psychotherapy: a meta-analysis

    Journal of Counseling and Psychology

    (1991)
  • A. Khan et al.

    Are placebo controls necessary to test new antidepressants and anxiolytics?

    International Journal of Neuropsychopharmacology

    (2002)
  • Cited by (16)

    • Prospective evaluation of chronic pain disorders and treatments

      2018, Journal of Neuroscience Methods
      Citation Excerpt :

      The difference between effects, when the treatment is overtly administered (open) or given without the patients’ knowledge (hidden), indicates the strength of suggestibility if the treatment cannot be detected. Alternatively, a placebo can occasionally be given, or a placebo responder assessment scale has potential to identify high and low suggestibility (Feltner et al., 2009). Individuals who respond well to a treatment may do so because they are highly suggestible.

    • Can knowledge of Placebo and Nocebo Mechanisms Help Improve Randomized Clinical Trials?

      2018, International Review of Neurobiology
      Citation Excerpt :

      These factors include demographic variables, such as age, sex, and race (Aslaksen, Bystad, Vambheim, & Flaten, 2011; Häuser, Bartram-Wunn, Bartram, Reinecke, & Tölle, 2011; Wrobel et al., 2015); illness characteristics (Bialik, Ravindran, Bakish, & Lapierre, 1995; Brown, Johnson, & Chen, 1992; Cepeda, Berlin, Gao, Wiegand, & Wada, 2012; Niklson, Edrich, & Verdru, 2006; Waxmonsky, Waschbusch, Glatt, & Faraone, 2011; Weimer, Colloca, & Enck, 2015); personality traits (Darragh, Booth, & Consedine, 2015, 2016; Geers, Helfer, Kosbab, Weiland, & Landry, 2005; Jakšić, Aukst-Margetić, & Jakovljević, 2013); culture (Bhugra & Ventriglio, 2015; Moerman, 2000); or genetic profiles (Hall et al., 2012; Hall, Loscalzo, & Kaptchuk, 2015; Peciña et al., 2014; Peciña & Zubieta, 2015; Wang et al., 2017). Using a psychological approach, Feltner and coworkers have developed a scale, the Placebo Response Screening Scale (PRSS), to identify specific domains associated with placebo response (Feltner, Hill, Lenderking, Williams, & Morlock, 2009). The scale was administered to more than 200 patients with generalized anxiety disorder, during the screening visit of a 4-week, placebo-controlled study of alprazolam.

    • Placebo effects in psychiatry: Mediators and moderators

      2015, The Lancet Psychiatry
      Citation Excerpt :

      Feltner and colleagues86 developed a highly specific psychometric screening scale for placebo susceptibility and tested it in more than 200 patients with general anxiety disorder. A score of more than 50 (of 100) points on the Placebo Response Screening Scale86 was able to improve sensitivity. Exclusion of patients scoring more than 50 points from the sample resulted in substantially better separation of active treatment from placebo in general anxiety disorder.

    • The elusive rat model of conditioned placebo analgesia

      2014, Pain
      Citation Excerpt :

      Visual inspection of Fig. 6 suggests that skewness patterns may have been influenced by outliers, which may represent a subpopulation of placebo high responders. As it is known that humans can be classified as high and low responders to placebo effects [17,30,63,68], the evidence that such subpopulations may exist in rats is interesting and warrants further investigation. Normality tests showed that the vehicle/vehicle group in each experiment was normally distributed, and that the drug/vehicle groups in experiments 1 and 3 were not.

    • Are there placebo or nocebo effects in balancing performance?

      2023, Cognitive Research: Principles and Implications
    View all citing articles on Scopus
    View full text