Article Text

Download PDFPDF

Unintended consequences: quantifying the benefits, iatrogenic harms and downstream cascade costs of musculoskeletal MRI in UK primary care
  1. Imran Mohammed Sajid1,2,
  2. Anand Parkunan3,
  3. Kathleen Frost4
  1. 1NHS West London Clinical Commissioning Group, London, UK
  2. 2University of Global Health Equity, Kigali, Rwanda
  3. 3Healthshare Community NHS Musculoskeletal Services, London, UK
  4. 4NHS Central London Clinical Commissioning Group, London, UK
  1. Correspondence to Dr Imran Mohammed Sajid; imransajid{at}nhs.net

Abstract

Objectives The largest proportion of general practitioner (GP) magnetic resonance imaging (MRI) is musculoskeletal (MSK), with consistent annual growth. With limited supporting evidence and potential harms from early imaging overuse, we evaluated practice to improve pathways and patient safety.

Methods Cohort evaluation of routinely collected diagnostic and general practice data across a UK metropolitan primary care population. We reviewed patient characteristics, results and healthcare utilisation.

Results Of 306 MSK-MRIs requested by 107 clinicians across 29 practices, only 4.9% (95% CI ±2.4%) appeared clearly indicated and only 16.0% (95% CI ±4.1%) received appropriate prior therapy. 37.0% (95% CI ±5.5%) documented patient imaging request. Most had chronic symptoms and half had psychosocial flags. Mental health was addressed in only 11.8% (95% CI ±6.3%) of chronic sufferers with psychiatric illness, suggesting a solely pathoanatomical approach to MSK care. Only 7.8% (95% CI ±3.0%) of all patients were appropriately managed without additional referral. 1.3% (95% CI ±1.3%) of scans revealed diagnoses leading to change in treatment (therapeutic yield). Most imaged patients received pathoanatomical explanations to their symptoms, often based on expected age or activity-related changes. Only 16.7% (95% CI ±4.2%) of results appeared correctly interpreted by GPs, with spurious overperception of surgical targets in 65.4% (95% CI ±5.3%) who suffered ‘low-value’ (ineffective, harmful or wasteful) post-MRI referral cascades due to misdiagnosis and overdiagnosis. Typically, 20%–30% of GP specialist referrals convert to a procedure, whereas MRI-triggered referrals showed near-zero conversion rate. Imaged patients experienced considerable delay to appropriate care. Cascade costs exceeded direct-MRI costs and GP-MSK-MRI potentially more than doubles expenditure compared with physiotherapist-led assessment services, for little-to-no added therapeutic yield, unjustifiable by cost–consequence or cost–utility analysis.

Conclusion Unfettered GP-MSK-MRI use has reached unaccceptable indication creep and disutility. Considerable avoidable harm occurs through ubiquitous misinterpretation and salient low-value referral cascades for two-thirds of imaged patients, for almost no change in treatment. Any marginally earlier procedural intervention for a tiny fraction of patients is eclipsed by negative consequences for the vast majority. Only 1–2 patients need to be scanned for one to suffer mismanagement. Direct-access imaging is neither clinically, nor cost-effective and deimplementation could be considered in this setting. GP-MSK-MRI fuels unnecessary healthcare utilisation, generating nocebic patient beliefs and expectations, whilst appropriate care is delayed and a high burden of psychosocial barriers to recovery appear neglected.

  • Medical error
  • measurement/epidemiology
  • Iatrogenic Disease
  • Evidence-Based Practice
  • Diagnostic errors
  • Primary care

Data availability statement

Deidentified data can be made available on reasonable request from the corresponding author, ORCID ID 0000-0002-0332-9704.

http://creativecommons.org/licenses/by-nc/4.0/

This is an open access article distributed in accordance with the Creative Commons Attribution Non Commercial (CC BY-NC 4.0) license, which permits others to distribute, remix, adapt, build upon this work non-commercially, and license their derivative works on different terms, provided the original work is properly cited, appropriate credit is given, any changes made indicated, and the use is non-commercial. See: http://creativecommons.org/licenses/by-nc/4.0/.

Statistics from Altmetric.com

Introduction

General practitioner (GP) direct access musculoskeletal (MSK) magnetic resonance imaging (MRI) is widespread, under well-intentioned aspirations for earlier disease detection, efficient patient journeys and reduction of referrals by enabling greater GP management. One in 10 patients with back pain presenting to primary care receives advanced imaging.1 Despite consistent imaging growth, there is a paucity of supporting evidence in this setting.

Imaging interpretation is nuanced as incidental age or activity-related findings are highly prevalent in asymptomatic joints (table 1). There are calls to shift away from a purely pathoanatomical model, towards a biopsychosocial approach to care, reducing ‘low-value’ (ineffective, harmful or wasteful) overuse and overdiagnosis.2 3

Table 1

Expected age or activity related epidemiological findings in musculoskeletal MRI

Concerns around GP-MSK-MRI

Early MSK-MRI is linked to greater disability and prolonged recovery,4 5 with non-guideline imaging associated with transition to chronic back pain.6 Findings can negatively affect patient perceptions, with lower confidence in conservative management, fear that exercise may worsen the condition, loss of control, over-reliance on surgery as well as poorer functional outcomes.7–12 Cognitions influence distress, disability and quality-of-life.13 The term ‘Victims of Modern Imaging Technologies’ describes harmfully disease-labelling patients as a result of increased imaging access,14 while incidental findings also place pressure on GPs.15 A high proportion of GP-MSK-MRI may be inappropriate,16 and disseminated scanning is an implicated driver behind ‘low-value’ arthroscopies.17 Expanding use of specialist tests down to primary care, dubbed ‘diagnostic downshift’, often has unintended clinical and economic impacts.18

Imaging consequences include unnecessary surgical referrals. There has been a shift away from conventional surgical approaches in favour of conservative therapy for many common conditions. Shoulder decompression,19 20 rotator cuff repair,21 shoulder labral repair,22 osteochondroplasty for femoroacetabular impingement23 and knee meniscectomy24 are just some examples. Strict procedural criteria are enforced in some regions, while some high-volume spinal injections have been decommissioned.25 Non-specialists may be unfamiliar with such trends and even GPs with ‘special interest’ have been shown to hold antiquated beliefs, most resistant to current evidence.26

Radiology reporting has significant inter-observer variability,27 for example agreement between radiologists and specialists is as low as 44% in shoulder MRI.28 GPs cannot review images to clinically correlate findings, limited to written reports. Furthermore, GPs express low confidence in MSK conditions,29 raising doubt over specialist diagnostic interpretation.

Lower disease prevalence in primary care results in lower yields from diagnostic strategies and guidelines have increasingly called for more selective imaging.30 31 Additionally, investment in readily accessible and evidenced community MSK ‘interface’ triage services,32–35 recommended in national MSK transformation strategy,36 calls into question the need for continued GP-MSK-MRI access.

Utility of GP-MSK-MRI

One randomised controlled trial of knee MRI access almost two decades ago showed only modest improvement in GP confidence, with no change in diagnosis or treatment.37 Cost-effectiveness was shown based on marginal, clinically non-significant improvements.38 39 A recent multicentre randomised controlled trial demonstrated no difference in quality-of-life from GP knee-MRI, with no reduction in orthopaedic referrals, while lacking cost-effectiveness.40 Both studies relied on self-report for utilisation. Meta-analysis suggests little-to-no outcome benefit from GP MSK imaging.41 Despite concerns around imaging overuse and iatrogenic downstream consequences,42–44 we found no studies quantifying recent UK GP-MSK-MRI benefits or harms to inform commissioning decisions.45

AIMS & Objectives

This evaluation aimed to assess the utility of MSK-MRI in primary care, quantifying the appropriateness of use, interpretation and both therapeutic and harmful cascades, to inform local pathway development and improve patient safety as part of a sector-wide quality improvement initiative.

Methods

Participants and design

Diagnostic suppliers provided activity data for January to December 2017 across three UK National Health Service (NHS) clinical commissioning groups (CCGs) in a metropolitan centre. Primary care records from invited practices were reviewed by clinical staff in this observational cohort evaluation of routinely collected data (retrospective study of prospectively collected data). A random number generator was used to select cases to avoid sampling bias. MRI request, results and least 12 months of follow-up records were required for inclusion.

Procedures and measures

Diagnostic ‘value’ goes beyond accuracy or direct-costs and evaluation frameworks cover accessibility, interpretation, as well as diagnostic and therapeutic yield (change in diagnosis and treatment based on results).46 47 Therefore, patient characteristics were captured from records, along with timeframes, results, details of follow-up discussion, subsequent management or referral activity and outcomes from specialist referrals, including 'conversion rate' (patients receiving a specialist intervention). Conversion rate is a limited, yet accessible commonly adopted proxy measure for ‘low-value’ surgical or procedural MSK referrals, also highlighting therapeutic yield. Joint injections available in primary care were not considered specialist intervention.

Analysis

Assessing ‘appropriateness’ of requesting and interpretation is subjective.45 48 Guidelines vary, often lacking detail, or setting-of-care. Data were reviewed by two clinicians. Reviewer one was a local GP, accredited in pain medicine, sector-wide commissioning policy chair for evidence appraisal and the local MSK and diagnostics clinical lead, managing pathway development. Reviewer two was a consultant extended-scope physiotherapist and clinical director of the local community MSK-interface service. Evaluators categorised imaging indication as ‘likely, ‘unclear’ or ‘unlikely’. Results were similarly classified as to whether they contained clinically relevant or incidental findings and whether GPs interpreted findings correctly, based on records and subsequent management. Categorisation was based on evaluators’ expert opinion.

GP referral choices reflect their clinical impression. ‘Procedural’ referrals were classified as those sent directly for orthopaedic or spinal neurosurgical opinions, as well as to services for consideration of spinal injections . The local recommended pathway, to the physiotherapist-led community MSK-interface service, comprises triage and early patient access to physiotherapy, podiatry, rheumatology, orthopaedic and pain specialist expertise, with onward referral for surgical or secondary care input, where necessary. This interface service can also triage referrals following MRI findings, to direct appropriate patients to secondary care without additional consultation, based on results. Whilst there may be many reasons for a more specialist opinion, since such input is available within the community interface pathway, post-MRI GP referrals bypassing this recommended triage reflect setting an expectation of a structural target for which an interventional procedure may be likely. Such specialist opinions following MRI also carry a cost implication.

Cost–consequence and cost–utility analysis was performed based on recorded healthcare utilisation, which was recorded temporally as pre-MRI, peri-MRI (organised at the same clinical encounter as the MRI request) or post-MRI.

Descriptive and inferential statistics were computed in Microsoft Excel with Analysis ToolPak, using ‘Wald method’ two-tailed 95% CIs for proportion point estimates. χ2 analysis was used to compare the audited sample against wider distribution of scans, while linear regression was used to compare practice imaging rate against appropriateness of imaging and interpretation. For both, p values were considered significant at the alpha level <0.05. Inter-rater reliability of all initial judgements by both evaluators was demonstrated both by weighted kappa measurement and percent agreement.49

Patient and public involvement

As part of local quality improvement in MSK pathway design, patient ‘champions’ and representatives from patient charity groups were interviewed. Patients echoed confusion over mixed messaging around their imaging results. The negative impact of clinician language was raised. Patients wanted more consistency than experienced, prompting this evaluation.

Results

Patient and scan characteristics

During 2017, 6,621 MSK-MRIs were performed for a primary care population of approximately 670,000. The mean annual rate was 9.9 (range 0.2–31.8) GP-MSK-MRIs per-1,000 registered patients. Greater than 100-fold variation in requesting-rate reflects unwarranted variation in care.

Twelve cases were excluded due to incomplete records. A total of 306 MRI referrals (144 males and 162 females) were reviewed, requested by 105 different GPs and two practice nurses across 29 practices, providing a 95% CI sampling error ≤5.6%. Practices covered a range of deprivation scores, from decile 2 to 9, including small (523) to large (19,533) list sizes, training and non-training practices, as well as high and low referrers. Median patient age was 53 (range 13–90, IQR 24 years). One-third of cases represented symptoms greater than 1 year, with remaining cases evenly distributed between acute (less than 7 days), 7–28 days, 29–84 days, 85–126 days and 127–365 days. Patient MRI request was documented in 37.0% (95% CI ±5.5%, n=113), including recommendations from private physiotherapists, social contacts or other specialties, such as emergency departments. Median wait-time from request to scan was 12 days (range 1–99 days). GPs prescribed sedation for 1.3% (95% CI±1.3%, n=4) and referred for open MRI in 0.3% (95% CI±0.6%, n=1). 23.9% (95% CI±4.8%, n=73) had prior imaging. 19.0% (95% CI±4.4%, n=58) had prior radiographs (most with degenerative changes), 2.3% (95% CI±1.7%, n=7) had prior MRI and 1.6% (95% CI±1.4%, n=5) had prior ultrasound. Conservative therapy (such as physical therapy or exercise) was documented in only 16.0% (95% CI±4.1%, n=49) prior to MRI. Body parts scanned are shown in table 2.

Table 2

Body part scans

Growing demand has been met by increased supply, with routine scanning within 2 weeks. There is, however, fragmentation among a multiprovider landscape. Preappointment imaging was often not available at specialist consultation when carried out by alternate providers.

Direct imaging costs for the 306 patients came to £38,746.00, based on 2017/2018 NHS national tariff (local variation can exist).50 This comprised 186 single area scans, 110 two or three part scans and 10 scans including more than three body parts.

Table 3 demonstrates prognostic flags for chronic pain.51 51.0% (95% CI±5.6%, n=156) had at least one psychosocial risk factor (orange, yellow, blue and black flags). During the study period, support, either from GP, mental health or third sector, was documented in only 11.8% (95% CI±6.3%, n=12) of the 101 chronic cases (symptoms >84 days) with orange flags (not including continuing ongoing medication).

Table 3

Presence of ‘flags’ for musculoskeletal pain

MRI Ordering, Findings and Cascades

70.3% (95% CI±5.1%, n=215) of MRI requests directly copied GP records, varying in detail, often limited for robust vetting. Six requests were amended by radiology providers (two sacroiliac scans rejected and additional body parts added to four requests).

Table 4 shows indicated requests, incidental and relevant findings, as well as interpretation, along with initial inter-rater agreement. Only 16.3% (95% CI±6.2%, n=22) of 135 knee cases were traumatic, mostly low-energy twists or falls whilst walking. 63.0% (95% CI±8.1%, n=85) of knee patients were above age 50, with predominantly degenerative conditions.

Table 4

MRI indication, results and interpretation of findings

Only 5.9% (95% CI±2.6%, n=18) of MRI results were unremarkable. 87.3% (95% CI±3.7%, n=267) likely contained incidental findings. 8.2% (95% CI±3.1%, n=25) had findings thought likely relevant to symptoms, with 42.9% (95% CI±5.5%, n=131) of unclear relevance to symptoms.

7.5% (95% CI±3.0%, n=23) never consulted for the issue again, likely reflecting self-resolution. Results were discussed with the same requesting clinician in only 47.1% (95% CI±5.6%, n=144) of cases.

GPs appeared to correctly interpret MRI changes, with appropriate advice and management in only 16.7% (95% CI±4.2%, n=51) of cases. MRI interpretation was unclear in 7.2% (95% CI±2.9%, n=22) and grossly erroneous in 68.6% (95% CI±5.2%, n=210), reflected by the high level of post-MRI procedural specialist referrals highlighted in yellow in table 5.

Table 5

Associated referral activity for imaged patients

9.8% (95% CI ±3.3%, n=30) of patients had no associated referrals. 7.8% (95% CI ±3.0%, n=24) were safely, autonomously managed by the GP (without misdiagnosis, nor referral to other services).

66.7% (95% CI ±5.3%, n=204) of patients had 229 post-MRI referrals for suspected structural targets. These were to ‘tier 2’ MSK clinics and secondary care orthopaedic, neurosurgery, neurology (mis-referred for injection for radiculopathies) and pain clinics for spinal procedures. There were no referrals to pain services for the documented purpose of a pain management or rehabilitation programme. Imaging can further fragment MSK care as 60.1% (95% CI ±5.5%, n=184) had multiple pre-MRI, peri-MRI or post-MRI referrals for the same condition. Many underwent GP-MSK-MRI while under concurrent care of other services. There was little-to-no documentation of patient-demand for post-MRI specialist referrals, nor of any shared decision-making.

Three ‘false-positives’ for serious disease (two cauda equina syndrome (CES)) and one osteomyelitis) in clinically unsuspicious cases, resulted in cascades of emergency referrals, further investigation, and patient distress. All were ultimately dismissed as clinically irrelevant. In low-prevalence settings, even highly specific tests result in high false-positive rates.

Therapeutic yield (change in treatment based on results) was 1.3% (95% CI ±1.3%, n=4). One patient received total knee replacement (which does not require MRI), with documented lack of benefit. One underwent cervical decompression for presumed radiculopathy, received no benefit, subsequently underwent cubital tunnel decompression, with no benefit, ultimately diagnosed with medically unexplained symptoms. Suprascapular nerve block for neck pain was offered but declined by one patient. One patient, diagnosed with knee osteoarthritis, which again does not require MRI, insisted on meniscectomy for a tear, rather than the arthroplasty recommended.

65.4% (95% CI ±5.3%, n=200) of imaged patients erroneously referred post-MRI directly for procedural opinions were not offered a specialist intervention; all ultimately advised to manage conditions conservatively. Their needs should have been met via the established community MSK-interface triage pathway, with tier 1 physiotherapy appropriate first-line management for the majority.

Of the 244 patients referred to physiotherapist-led services, 64.8% (95% CI ±6.0%, n=158) were only referred after MRI results, a median delay of 32 days. 10.8% (95% CI ±3.5%, n=33) of imaged patients were referred only to procedural secondary care pathways, waiting many months longer, only to be told they should receive physiotherapy.

Linear regression showed little correlation between practice imaging-rate and the rate of likely or unclear indicated requests (r=0.10, r2=0.01, p=0.62), nor the rate of post-MRI ‘low-value’ cascades (r=0.24, r2=0.06, p=0.20). Low imaging-rate practices had similar (in)appropriate requesting and cascades to high imaging-rate practices.

Cost-effectiveness

A cost–consequence analysis is shown in table 6, comparing GP direct access to MSK-MRI and secondary care referrals, versus the recommended community MSK-interface pathway for triage and management.

Table 6

Cost–consequence analysis

Patient satisfaction from imaging and potentially earlier referral of four surgical candidates from GP-MSK-MRI unlikely warrants the variation in care, fragmentation, significant misdiagnosis, as well as doubling of costs compared with a pathway where MRI responsibility is shifted further along the clinical journey, to the MSK-interface service (see table 6). GP-MRI direct costs were £38,746.00, while generating greater cascade costs of £53,135.20.

Additional therapeutic benefit for the GP-MSK-MRI pathway was only potentially demonstrated in one case of arthroscopic meniscectomy, for which quality-of-life-years (QALY) gain is 0.04 QALYs over a 9-year time horizon.52 With a £69,332.90 cost difference between diagnostic strategies, the cost–utility incremental cost-effectiveness ratio is £1,733,322.50 (£69,332.90/0.04) per QALY for the GP-MSK-MRI diagnostic strategy, astronomically greater than UK willingness-to-pay thresholds of £20,000–30,000 per QALY.53

Discussion

MRI ordering

Only 4.9% (95% CI ±2.4%, n=15) of MRIs appeared indicated. Patient demand, rather than clinical need, often influenced requesting. Causal structure-pain relationships are ambiguous, yet individuals often seek exact structural diagnoses.54 55 These do not change management for the overwhelming majority of primary care presentations, based around education and goal-focused therapy. However, only 16.0% (95% CI ±4.1%, n=49) received conservative therapy prior to imaging.

While concern around sinister pathology may motivate imaging, no malignancy was identified in this, although limited, sample. UK guidelines56 do not advocate GP-MSK-MRI for MSK malignancy, with alternate pathways for suspicious presentations. Furthermore, systematic review does not show faster time-to-cancer-diagnosis, nor improved outcomes, from GP advanced diagnostics.57 Additionally, suspected CES requires same-day evaluation, not outpatient imaging. Of note, ‘red-flags’ lack validity and specificity in primary care, for example 80% of back pain patients may have at least one,58 while 64% of those with malignancy may have none.59

GPs almost always documented CES screening in low back pain (despite being unlikely to ever see a true CES),60 while rarely addressing highly prognostic psychosocial flags.51 61–77 Most presentations were chronic, in itself not necessarily indication for imaging. The high burden of psychosocial distress seen reflects the bi-directional relationship between chronic pain and mental health.78 Support for such potential recovery barriers was documented in only 11.8% (95% CI ±6.3%, n=12) of those with chronic pain and psychiatric illness. Poor clinician recognition of pain psychosocial factors is echoed in other studies.54 79 80 Imaging overuse suggests practice wedded to the pathoanatomical approach alone, which may shift focus to irrelevant structural findings, distracting clinicians and patients from unmet psychosocial needs.

Spinal imaging was often requested for referred pain or minimal sensory symptoms, without suspicious features. Identifying radicular symptoms is nuanced due to overlapping innervation territories, myotomal or sclerotomal pain referral and examination differences between small and large nerve fibres. Many conditions mimic neuropathy and there was no documented use of validated diagnostic tools such as the Leeds Assessment of Neuropathic Symptoms and Signs (LANSS) or the Douleur Neuropathique 4 (DN4). For foot, ankle or shoulder MRIs, ultrasound would often have been more appropriate, if necessary. Similarly, if required, plain radiographs should have replaced most knee MRIs for atraumatic elderly presentations. Many scans occurred for degenerative conditions in late decades, where MRI has a limited role.

Imaging interpretation, referrals and cascades

Only 5.9% (95% CI ±2.6%, n=18) of MRIs were unremarkable, reflecting ubiquitous (often incidental) findings. Incidental findings were also intra-abdominal, such as fibroids, haemangiomas and diverticular disease. With such high prevalence of imaging changes, imaging for reassurance is therefore problematic, despite contrary clinician beliefs.54 Furthermore, evidence shows tests contribute little towards reassurance.81 82 While some GPs hold MSK expertise, only half of results were discussed with the requesting clinician familiar with the presentation.

Only 16.7% (95% CI ±4.2%, n=51) of MRI reports appeared correctly interpreted. Most patients received pathoanatomical explanations, based on often incidental age-expected findings. Medicalising terminology reduces self-reported health,83 increases anxiety, perceived severity and preference towards invasive management.84 Structural disease-labelling can be nocebic, increasing fear-avoidance behaviours, perceptions that physical therapy is incompatible with recovery and over-reliance on surgical intervention.7–12 This places pressure on specialists to subsequently re-frame engrained expectations away from a surgical fix. Negative patient cognitions, which endure for years,85 may influence MSK pain-related distress, disability and quality-of-life.13

GP referrals to surgical or pain interventional specialties have conversion-rates of 20%–30%,34 86–90 whilst conversion is around 75% for referrals from MSK-interface services.32 35 91 However, conversion to a procedure was only 1.9% (95% CI ±1.9%, n=4) for such GP referrals following MRI. MRI-access is unlikely to reduce referrals due to such deterioration in decision-making. While GP-MRI may reduce some community MSK-interface referrals, such pathways are more likely to benefit patients,32 as well as being more cost-effective.

90.2% (95% CI ±3.3%, n=276) had one-or-more referrals to other services, equally capable of organising imaging, where appropriate, reflecting the additional input required beyond a test for persisting symptoms. GP-MSK-MRI does not appear to enable more autonomous management. Only 7.8% (95% CI ±3.0%, n=24) were safely managed within primary care, without misdiagnosis, overdiagnosis or further referral.

GP-MSK-MRI potentially accelerated procedures for 1.3% (95% CI ±1.3%, n=4) of imaged patients, of which only one improved, following a non-guideline intervention. However, erroneous over-perception of structural pathology resulted in delays, often of months, to appropriate care, with ‘low-value’ procedural referrals and potentially enduring negative perceptions for 65.4% (95% CI ±5.3%, n=200) of imaged patients. With a mean 9.9 MRI-scans per 1,000 GP-registered patients, we can extrapolate adverse consequences for 6.5 per 1,000 registered, or >4,000 patients annually across the study population. If misdiagnosis, mis-referral and delay-to-care are considered patient harm, the number-needed-to-harm (NNH) is only 1.5 (1/0.654). NNH is traditionally rounded-down, placing NNH at one for GP-MSK-MRI. Considering the likelihood-to-be-helped-versus-harmed metric,92 (likelihood-of-benefit divided by likelihood-of-harm), the likelihood of therapeutic yield versus mismanagement from GP-MSK-MRI is as low as 0.02 (1.3/65.4). This is a limited metric, aggregating all gains and losses, but gives an approximation of the direction of trade-offs.

While MRI spending is a low proportion of MSK system costs,93 cascades alter the economic analysis. Cascade costs were significantly greater than direct-imaging costs. There was little-to-no added therapeutic yield and compared with physiotherapist-led assessment services, both cost-consequence and a crude cost-utilty incremental cost-effectivenes ratio, do not justify GP-MSK-MRI funding. Cost-utility studies often neglect full costs, that is, all additional unindicated scans occurring for the small yield of patients who receive benefit, as well as unintended cascades.

Changing behaviour

Guidelines alone have limited impact, as over one-third of scans were lumbar, against 2016 National Institute for Health and Care Excellence recommendations against routine use in primary care.30 Pressure from patients, other health professionals, defensive practice, risk-aversion, educational deficiencies and action-bias all drive ‘low-value’ testing. ‘Illusory-causation’ describes our propensity to perceive spurious causal relationships.94 Widespread, often incidental, MRI findings create erroneous positive feedback to GPs, or ‘belief-reinforcement’, bolstering aberrant ordering behaviours. ‘Harms’ are not immediately tangible and without accurate real-time feedback, decision-making heuristics cannot be improved.

Benchmarking practice MRI-rates alone may be an inadequate quality-indicator as this lacked correlation to MRI appropriateness or interpretation. Education, incentives and behavioural ‘nudges’ within electronic ordering systems, may help, with limited impact.95–98 While there is scope to improve radiology reporting,99 benefit is mixed.12 100 Educating on the low utility and potential harm of imaging, challenging beliefs and persuading that less-is-more, can be difficult, introducing back-fire and reactance effects.54 101–103 This may be onerous within brief GP consultations, particularly when the majority expect imaging.104

Lack of access barriers or wait-time rationing can result in supply-induced demand. Per capita commissioned scanning capacity should be scrutinised, as supply-side volume controls can effectively contain inefficiencies.105 Lack of clinical or cost-benefit, along with prevalent harm, invites consideration for GP-MSK-MRI deimplementation. Furthermore, the financial case underlying funding of MSK-interface services often includes assumptions around reduced imaging costs, unlikely to be realised with ongoing unfettered GP-MRI access.

Strengths and limitations

Random selection, with only 12 cases excluded, from a 1-year sample, diverse range of practices, clinicians and patients likely reflects UK practice.

Primary care records robustly capture healthcare utilisation, across providers and sectors. Records may not reflect real-world symptoms, nor consequences in all domains such as physical, psychological, social, financial, treatment burden and dissatisfaction.106 Without patient-orientated outcome measures, the cost–utility assessments are largely estimated. Other studies, however, did not demonstrate significant quality-of-life benefits.38–40 The cost–consequence estimates also compared against average activity patterns seen in the MSK-interface service, rather than a matched comparator group.

While we could not capture exact consultation dialogue, there was documentation in the majority of cases to demonstrate inaccurate perception of surgical targets, reflected by the subsequent higher-cost, triage-bypassing, direct referrals for surgical or procedural opinions.

Different cascades may be seen in regions without readily accessible MSK-interface pathways, which may themselves induce demand. While there was no difference between the two radiology providers, it may be worth evaluating more providers for potential reporting variation.

Separate evaluators mitigated individual rating bias inherent in measures based on expert opinion, without strict dichotomous criteria. There was only ‘fair’ agreement regarding MRI indication (k=0.23, 95% CI ±0.12) and clinical relevance of findings (k=0.23, 95% CI ±0.08), reflecting the subjective nature of such judgements. There was substantial agreement (k=0.70, 95% CI ±0.11) regarding incidental findings and almost perfect inter-rater agreement regarding result interpretation (k=0.84, 95% CI ±0.06). In all initial disagreement, consensus was achieved following further individual case review, including documented specialist consultations. Despite subjectivity of some measures, the extreme outcomes are unlikely explained by evaluator bias alone.

We did not have a comparator group of non-imaged patients. However, we could contrast against conventional GP referral conversion rates, including those without MSK-MRI access. The high proportion of ‘low-value’ post-MRI referrals could be related to confounding characteristics of imaged patients. However, such a high rate of referral cascades with near-zero conversion, provides convincing signal on the disutility of post-MRI care in this setting, even without comparator analysis.

Summary and policy implications

Structural pathology can change management, and imaging is useful in trauma, investigating rare sinister disease, or guiding specific procedures. Whilst judicious imaging with qualified interpretation no doubt occurs within primary care, this appears to be infrequent. Expanding MRI use outside of specialist settings is problematic, with significant imaging indication creep in primary care. Widespread ‘biostatistically normal-for-age’, or activity-related expected findings, along with a shift away from conventional surgical approaches, creates a salient problem of GPs overperceiving spurious surgical or procedural targets from imaging reports. MRI may appease biases underlying clinician autonomy and patient satisfaction, yet generates aggregate harm, through misdiagnosis and overdiagnosis. Imaging stewardship and improving the mixed messaging around results are priorities. Whilst a tiny fraction of patients may receive earlier surgery through GP-MSK-MRI, this is eclipsed by negative consequences for the vast majority. Less than two patients require MRI in primary care for one to suffer avoidable low-value cascades. As well as resource waste, this generates delay to appropriate care along with potentially nocebic patient perceptions impacting management and outcomes, which can endure for years. Such consequences raise overlooked safety and effectiveness concerns across currently commissioned imaging services. GP-MSK-MRI deimplementation may be appropriate, shifting scanning capacity to community-based MSK services in the UK. This will likely be more clinically and cost-effective, reducing iatrogenic harm and enabling primary care to focus on unmet psychosocial patient needs and delivering guideline care.

Data availability statement

Deidentified data can be made available on reasonable request from the corresponding author, ORCID ID 0000-0002-0332-9704.

Ethics statements

Ethics approval

This evaluation was undertaken as part of the NWL CCG diagnostics optimisation and quality, innovation, productivity and prevention (QIPP) transformation programmes. No patient identifiable data were shared outside of clinicians involved in patient care. Data were handled in accordance with locally published CCG fair processing policies. As a service development evaluation based on routinely collected data, by those involved in patient care, further ethics approval from NHS Research Authority was not required as per the NHS Health Research Authority online decision tool based on the UK Policy Framework for Health and Social Care Research.

Acknowledgments

We would like to thank Healthshare Community NHS Musculoskeletal Services for their collaboration with NHS clinical commissioners on this quality improvement work and supporting the open-access fees to improve accessibility for policy makers.

References

Footnotes

  • Twitter @imransajid

  • Contributors IMS (commissioning clinical lead) and KF (diagnostics programme lead) led the diagnostics optimisation and quality, innovation, productivity and prevention (QIPP) programmes for the NWL collaboration of clinical commissioning groups, under which this evaluation was carried out. IMS and AP (clinical director of MSK service) both acted as evaluators for key measures in the data analysis. All authors had input in design of the key measures. IMS drafted the manuscript which was reviewed and edited by AP and KF.

  • Funding The authors have not declared a specific grant for this research from any funding agency in the public, commercial or not-for-profit sectors.

  • Competing interests None declared.

  • Patient and public involvement Patients and/or the public were involved in the design, or conduct, or reporting, or dissemination plans of this research. Refer to the Methods section for further details.

  • Provenance and peer review Not commissioned; externally peer reviewed.

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.