Statistics from Altmetric.com
Drs White and Cummings state1 that we negatively reported findings of our ‘positive study’—namely, our trial evaluating acupuncture for chronic knee osteoarthritis (OA).2 Our study was not a ‘positive study’ as they suggest. Rather, our study showed no benefit of needle or laser acupuncture compared with sham laser acupuncture on either of our two primary outcomes (pain and function), and small clinically irrelevant benefits compared with no acupuncture for both laser and needle acupuncture.
In accordance with best practice in the conduct and interpretation of clinical trials, we (1) a priori specified our primary outcome measures, including the minimum clinically important difference (MCID) on the scale of measurement for each outcome measure; (2) determined and recruited the sample size needed to show meaningful between-group differences in primary outcomes based on our chosen MCIDs and estimated SDs with adequate power; and (3) interpreted our findings based on both of these primary outcomes, their MCIDs and considering both control conditions included in our study design (ie, sham laser acupuncture and no acupuncture). Accordingly, the conclusion stating that our findings do not support acupuncture for these patients is appropriate and is the only conclusion that can (and should) be drawn from our study.
We powered our study to detect the absolute MCID between groups in pain (1.8 units) and function (6 units), which have been recommended specifically for our chosen primary outcome measurement tools (numerical rating scale and Western Ontario and McMaster Universities OA Index, respectively). Estimated between-group differences did not reach these thresholds, nor were active acupuncture groups statistically different from sham laser. Drs White and Cummings do not like our choice of MCIDs for our primary outcomes. Their comments focus solely on MCIDs expressed as a dimensionless quantity (or, equivalently, in SD units). However, this approach confounds the absolute size of effect on the scale of the outcome measure with the variability (SD) of the outcome measure between patients. By their definition, two trials with exactly the same difference in mean outcome between treatments would result in a different MCID solely because of differing diversity of patient populations. Our approach of specifying an absolute MCID separates the definition of a clinically meaningful change from decisions regarding the patient population of interest, which clarifies the clinical interpretation of the trial results.
Drs White and Cummings imply that our presentation of secondary results was unthoughtful because we did not quote the results from the supplemental content. The results in the main tables (tables 3 and 4) are based on analyses using multiple imputation of the non-negligible amount of missing outcome data. The results in the supplemental content are based on complete case analyses, which require stricter assumptions about the missing outcome data than the main tables and, as such, are likely to be more prone to bias than the main analyses. We therefore concentrated interpretation on the most statistically sound analyses.
Drs White and Cummings suggest our comparison of needle acupuncture with sham laser acupuncture is ‘clinically irrelevant’ because ‘sham laser is not an available therapy’. We are rather surprised by this statement. Of course sham laser is not an available therapy: sham treatments, by their very definitions, are fake treatments used for one reason only in clinical research—to isolate the active physiological effects of a given treatment from placebo contextual effects. If this assertion by the authors was true, then most pharmacological research needs to be discarded given that a sham treatment (placebo pill) is the gold standard control condition for drug clinical trials. An individual patient meta-analysis3 has shown that effect sizes for needle acupuncture compared with sham needle acupuncture are very small (0.16, 95% CI 0.07 to 0.25) and unlikely to be of any clinical relevance. It is unclear why Drs White and Cummings think we should have used a sample size large enough to detect such small and clinically meaningless differences between needle and sham laser acupuncture. They highlight that the National Institute for Health and Clinical Excellence (NICE) chose a threshold of 0.5 (standardised mean difference) to interpret findings of their meta-analysis when devising clinical practice guidelines for OA.4 However, Drs White and Cummings failed to state that NICE considered the comparison of acupuncture with sham acupuncture to be the most appropriate clinical comparison to assess the benefits and harms of acupuncture, which is why acupuncture is not recommended for OA by NICE in the 2014 guidelines.
Drs White and Cummings state that our manual needle acupuncture was not optimal because we did not use electrical stimulation. However, the most up-to-date evidence from a 2013 meta-regression study that pooled data from 29 trials of acupuncture for chronic pain (including OA) showed that electrical stimulation did not significantly influence the effects of needle acupuncture on pain.5
Drs White and Cummings state that we should have concluded that ‘patients with OA knee should consider acupuncture as an option’. We agree with this statement when it is with reference to no treatment at all, as long as it is qualified with the appropriate evidence from the trial—that is, ‘patients with OA knee should consider needle, laser or sham laser acupuncture as an option’—because all were shown to be equally efficacious in comparison with no treatment. To omit the fact that the needle and laser acupuncture demonstrated nil benefit over sham laser acupuncture is misrepresenting the results of the trial.
We agree patients with knee OA need a considered answer to their question: ‘Should I try acupuncture?’ So too do clinicians, policymakers and funders of healthcare services asking: ‘Should my patient have acupuncture?’ or ‘Should tax-payers’ money support the provision of acupuncture for knee OA?’ Interpreting the acupuncture evidence base remains challenging, given differences in opinion regarding the most appropriate comparator for determining acupuncture efficacy as well as lack of consensus about what constitutes a MCID in OA. Our trial adds to the substantial body of literature and will no doubt fuel the acupuncture debate further. Based on our trial findings, it is likely that an individual patient with OA will experience some pain relief from adding acupuncture to their usual care; however, the benefit will be due to placebo effects (rather than physiological effects of acupuncture) and of no clinical importance according to our a priori definitions of the MCID. Policymakers and funders of healthcare services will decide whether they should invest in treatments that offer no benefit over and above sham treatments. OA is a long-term condition with no cure that requires a chronic disease management approach. This should focus on active self-management by patients, not passive treatments provided by clinicians. Given the effectiveness of exercise and weight loss for knee OA (core recommended treatments in OA clinical practice guidelines6 ,7) and the underutilisation of these strategies in primary care,8–10 should we really be recommending acupuncture for patients with knee OA?
Competing interests None.
Provenance and peer review Commissioned; internally peer reviewed.
If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.