Elsevier

The Spine Journal

Volume 20, Issue 6, June 2020, Pages 847-856
The Spine Journal

Clinical Study
Measuring clinically relevant improvement after lumbar spine surgery: is it time for something new?

https://doi.org/10.1016/j.spinee.2020.01.010Get rights and content

Abstract

BACKGROUND CONTEXT

Minimum clinically important difference (MCID) for patient-reported outcome measures is commonly used to assess clinical improvement. However, recent literature suggests that an absolute point-change may not be an effective or reliable marker of response to treatment for patients with low or high baseline patient-reported outcome scores. The multitude of established MCIDs also makes it difficult to compare outcomes across studies and different spine surgery procedures.

PURPOSE

To determine whether a 30% reduction from baseline in disability and pain is a valid method for determining clinical improvement after lumbar spine surgery.

STUDY DESIGN

Retrospective analysis of prospective data from a national spine registry, the Quality Outcomes Database.

PATIENT SAMPLE

There were 23,280 participants undergoing elective lumbar spine surgery for degenerative disease who completed a baseline and follow-up assessment at 12 months.

OUTCOME MEASURES

Patient-reported disability (Oswestry Disability Index [ODI]), back and leg pain (11-point Numeric Rating Scale [NRS]), and satisfaction (NASS scale).

METHODS

Patients completed baseline and a 12-month postoperative assessment to evaluate the outcomes of disability, pain, and satisfaction. The change in ODI and NRS pain scores was categorized as met (≥30%) or not met (<30%) percent reduction MCID. The 30% reduction from baseline was compared with a wide range of well-established absolute point-change MCID values. The relationship between 30% reduction and absolute change values and satisfaction were primarily compared using receiver operating characteristic (ROC) curves, area under the curve (AUROC), and logistic regression analyses. Analyses were conducted for overall scores and for disability and pain severity categories and by surgical procedure.

RESULTS

Thirty percent reduction in ODI and back and leg pain predicted satisfaction with more accuracy than absolute point-change values for the total population and across all procedure categories (p<.001), except for when compared with the highest absolute point-change threshold for leg pain (3.5-point reduction). The largest AUROC differences, in favor of 30% reduction, were found for the lowest disability (ODI 0–20%: 21.8%) and bed-bound disability (ODI 81%–100%: 13.9%) categories. For pain, there was a 3.4%–12.4% and 1.3%–9.8% AUROC difference for no/mild back and leg pain (NRS 0–4), respectively, in favor of a 30% reduction threshold.

CONCLUSIONS

A 30% reduction MCID either outperformed or was similar to absolute point-change MCID values. Results indicate that a 30% reduction (baseline to 12 months after surgery) in disability and pain is a valid method for determining clinically relevant improvement in a broad spine surgery population. Furthermore, a 30% reduction was most accurate for patients in the lowest and highest disability and lowest pain severity categories. A 30% reduction MCID allows for a standard cut-off for disability and pain that can be used to compare outcomes across various spine surgery procedures.

Introduction

Lumbar spine surgery is one of the most prevalent and fastest-growing medical interventions in the United States. The rates of elective lumbar spine surgery have increased 300% in recent decades [1], [2], [3]. In 2011, spinal fusions cost the United States health-care system a total of $12.8 billion, more than any other procedure type [4]. Due to the prevalence, incidence, and cost of these procedures along with the shift toward value-based care, accurate, and efficient assessment of patient benefit from lumbar spine surgery is imperative.

Minimum clinically important difference (MCID) [5] represents the smallest, clinically relevant change in a patient-reported outcome (PRO) score such as the Oswestry Disability Index (ODI) [6,7] and numeric rating scales (NRS) for back pain and leg pain [8]. MCID thresholds in spine surgery are used to determine whether interventions benefit patients [9], [10], [11], [12], [13] and to develop predictive calculators to facilitate informed medical decision making [14], [15], [16]. The most widely used MCID values in lumbar spine surgery for ODI, NRS back pain, and NRS leg pain are 12.8, 1.2, and 1.6 points, respectively [17]. These values were determined by Copay et al. in patients with diverse lumbar pathologies undergoing various surgical procedures [17]. Other studies have defined MCID point-change values for a wide range of lumbar surgical subpopulations, including transforaminal lumbar interbody fusion for degenerative lumbar spondylolisthesis [18], neural decompression and fusion for same level recurrent lumbar stenosis [19], and revision fusion for symptomatic pseudarthrosis [20].

Although MCID is an accepted classification strategy for clinical effectiveness, the literature suggests that an absolute change from baseline, as opposed to relative or proportional, may not be an effective or reliable marker of response to treatment for patients with low or high baseline PRO scores [21,22]. Studies in the chronic pain literature that compare absolute change measures to thresholds of clinical relevance defined by percent reduction from baseline show improved performance with the percent reduction measurements [23]. Furthermore, Ostelo et al. developed recommendations on back pain outcome measures based on literature review, expert panel, and a workshop and concluded that a 30% change from baseline can be considered clinically meaningful improvement [24]. To date, one study in the spine surgery literature has calculated percent improvement thresholds for various PROs [25]. However, these values were developed with the goal of identifying thresholds for substantial clinical benefit, which is a higher change threshold than MCID, and from a single center study.

The primary objective of this study was to determine whether a percent reduction from baseline in disability and back and leg pain is a valid method for determining MCID after lumbar spine surgery. We hypothesized that a 30% reduction would more accurately represent clinical improvement than established MCIDs that utilize absolute point-change values. Percent reduction from baseline may be a more clinically relevant method for identifying response to treatment among spinal surgery populations by accounting for baseline PRO score.

Section snippets

Study design and population

This study is a retrospective analysis of data from a prospective surgical spine registry collected between January 2012 and March 2018 and located at 74 sites in the United States, Quality Outcomes Database (QOD) [26]. A standardized enrollment process for patients undergoing elective surgery for degenerative conditions is used at the QOD participating sites that include both academic and private clinics. Lower volume clinical sites enroll patients continuously; higher volume centers follow a

Results

A total of 23,280 patients, 47% female and mean age 59.2 (SD: 14.1), were included in this study (Table 1). Patients with private insurance comprised 50.1% of the sample, and 46.4% had public insurance or were uninsured. The percentage of patients who were current smokers was 16% and patients presented with a variety of preexisting medical conditions, including diabetes mellitus (18.5%), coronary artery disease (11.5%), anxiety (16.5%), depression (20.3%), and osteoporosis (4.4%). Approximately

Discussion

The purpose of this study was to determine whether a 30% reduction from baseline in disability and pain is a valid method for determining clinical improvement following lumbar spine surgery. Thirty percent reduction was compared with a wide range of established absolute point-change values to assess validity. Results from the ROC curves and logistic regression models demonstrated that a 30% reduction in disability and back pain had a higher accuracy for predicting satisfaction as compared with

Conclusions

Findings demonstrate that a 30% reduction (baseline to 12 months after surgery) in PRO measures of disability and pain is a valid method for determining clinically relevant improvement in a broad spine surgery population. A 30% reduction either outperformed or had a similar accuracy for predicting satisfaction as compared with a wide range of established absolute point-change MCID values. In particular, results highlight that a 30% reduction MCID is most accurate for patients in the lowest and

Acknowledgment

This study was not supported by any kind of funding.

References (56)

  • S Chotai et al.

    Effect of patients' functional status on satisfaction with outcomes 12 months after elective spine surgery for lumbar degenerative disease

    Spine J

    (2017)
  • AG Copay et al.

    Assessment of spine surgery outcomes: inconsistency of change amongst outcome measurements

    Spine J

    (2010)
  • G Guyatt et al.

    Measuring change over time: assessing the usefulness of evaluative instruments

    J Chronic Dis

    (1987)
  • RA Deyo et al.

    Trends, major medical complications, and charges associated with surgery for lumbar spinal stenosis in older adults

    JAMA

    (2010)
  • M Read et al.

    Trends in isolated lumbar spinal stenosis surgery among working US adults aged 40-64 years, 2010-2014

    J Neurosurg Spine

    (2018)
  • HW Bae et al.

    Nationwide trends in the surgical management of lumbar spinal stenosis

    Spine

    (2013)
  • Weiss AJ EA, Andrews RM. Characteristics of operating room procedures in U.S. hospitals, 2011: statistical brief #170....
  • JC Fairbank et al.

    The Oswestry low back pain disability questionnaire

    Physiotherapy

    (1980)
  • JC Fairbank et al.

    The Oswestry Disability Index

    Spine (Phila Pa 1976)

    (2000)
  • JK Scheer et al.

    Comprehensive study of back and leg pain improvements after adult spinal deformity surgery: analysis of 421 patients with 2-year follow-up and of the impact of the surgery on treatment satisfaction

    J Neurosurg Spine

    (2015)
  • CH Crawford et al.

    Back pain improvement after decompression without fusion or stabilization in patients with lumbar spinal stenosis and clinically significant preoperative back pain

    J Neurosurg Spine

    (2016)
  • JK Scheer et al.

    Impact of age on the likelihood of reaching a minimum clinically important difference in 374 three-column spinal osteotomies: clinical article

    J Neurosurg Spine

    (2014)
  • M Alimi et al.

    Minimally invasive laminectomy for lumbar spinal stenosis in patients with and without preoperative spondylolisthesis: clinical outcome and reoperation rates

    J Neurosurg Spine

    (2015)
  • MJ McGirt et al.

    An analysis from the quality outcomes database, Part 1. disability, quality of life, and pain outcomes following lumbar spine surgery: predicting likely individual patient outcomes for shared decision-making

    J Neurosurg Spine

    (2017)
  • AL Asher et al.

    An analysis from the quality outcomes database, Part 2. predictive model for return to work after elective surgery for lumbar degenerative disease

    J Neurosurg Spine

    (2017)
  • T Oh et al.

    Potential of predictive computer models for preoperative patient selection to enhance overall quality-adjusted life years gained at 2-year follow-up: a simulation in 234 patients with adult spinal deformity

    Neurosurg Focus

    (2017)
  • SL Parker et al.

    Utility of minimum clinically important difference in assessing pain, disability, and health state after transforaminal lumbar interbody fusion for degenerative lumbar spondylolisthesis

    J Neurosurg Spine

    (2011)
  • SL Parker et al.

    Minimum clinically important difference in pain, disability, and quality of life after neural decompression and fusion for same-level recurrent lumbar stenosis: understanding clinical versus statistical significance

    J Neurosurg Spine

    (2012)
  • Cited by (0)

    FDA device/drug status: Not applicable.

    Author disclosures: AMA: Nothing to disclose. ERO: Nothing to disclose. JSP: Consulting: Orthopaedics of Steamboat Springs (C). IK: Research Support (Investigator Salary, Staff/Materials): NeuroPoint Alliance, Inc (Money paid to institution (D)); Grants: CSRS (C). AS: Nothing to disclose. CJD: Royalties: Wright Medical (B); Consulting: Stryker (D), Medtronic (D). MB: Nothing to disclose. ALA: Consulting: Globus (B), Stryker (B). KRA: Consulting: Pacira (B), NeuroPoint Alliance Inc (B); Scientific Advisory Board/Other Office: APTA (B), Palladian Health (B).

    View full text