no competing interests
This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.
A meta-analysis of a subset of eight âlarger higher qualityâ randomised controlled trials (RCTs), drawn from 110 matched RCTs each of homeopathy and conventional medicine, concluded that the results of the trials were consistent with the hypothesis that homeopathy is a placebo effect [1]. This meta-analysis was criticised for the heterogeneity of the trials on which its conclusion was based (all eight were for different conditions).In an apparent paradox, the same meta-analysis concluded that homeopathy had a âsubstantial beneficial effectâ in acute upper respiratory tract infections (URTI), without evidence of positive bias. Other meta-analyses have reached similar conclusions [2, 3]. There is evidence from clinical studies of varying designs that homeopathy may be effective in treating acute otitis media [4-6]. Homeopathy is frequently prescribed for URTI by homeopathic GPs [7]. There is also some evidence from western Europe that general practitioners (GPs) with homeopathic training prescribe fewer antibiotics than their counterparts in conventional medicine [8-10].The plausibility paradoxThe problem with homeopathy for most doctors and scientists is the inherent implausibility of the idea that ultra-diluted solutions can have chemical effects [11]. Clearly it is highly unlikely that a medicine that does not contain a single molecule of the original substance could work like a conventional medicine. Sometimes the outcome of RCTs overturns theory, but at other times evidence is dismissed because of theory. Vandenbroucke states âAccepting that infinite dilutions work would subvert more than conventional medicine; it wrecks a whole edifice of chemistry and physicsâ [12].An early systematic review of clinical trials stated, âwe would accept that homoeopathy can be efficacious, if its mechanism of action were more plausibleâ [13]. Contrary views have also been expressed: demanding more evidence may itself be considered unscientific; the same level of supporting clinical trial evidence should be accepted for all scientific developments. If a lower level of proof is set for hypotheses that fit prior beliefs then we bias our view of science in favour of such beliefs and may be easily misled [14].Does the fact that it is highly unlikely that many homeopathic medicines have a chemical effect really wreck a âwhole edifice of chemistry and physicsâ? Chaplin mentions a number of possible mechanisms of action that are more likely than chemical effects, like water clustering and nanobubbles [14]. âInherent implausibilityâ is a poor guide to future understanding. History is littered with examples of ideas that at one time appeared highly implausible but are now accepted as fundamental truths: the Copernican revolution and quantum physics are well-known examples [15].The possibility of other mechanisms, the opinions of users and prescribers, fundamental research and epidemiological evidence are all ignored because of the implausibility of a chemical effect of extremely high dilutions. Goodman used Bayesâ theorem to illustrate that the usual proof is not sufficient for belief in efficacy [16]. Rosendaal and Bouter illustrated this by assigning one significantly positive RCT a likelihood ratio (LR) of 16 [17]. This LR is then entered into Bayesâ formula:Posterior odds = LR x prior odds#Their estimate of the prior that homeopathy âworksâ was one in a million; implying that âworksâ actually meant âworks in an accepted pharmacological wayâ. Then they calculate using Bayesâ formula that the chance that homeopathy works goes from one in a million to less than one in ten thousand after one positive RCT. The principal weakness of Bayesian statistics is the subjectivity in estimating the prior chance [18]. Priors are usually estimated by experts in the field. Should the prior for homeopathy be the chance that it has a chemical effect or the chance of other effects? In Bayesian reasoning all evidence should be used for sequential updating with the Bayesâ formula, and very low priors especially are particularly influenced by this updating [19]. If we suppose that the proof of one RCT has LR=16, sequential updating for eight positive trials proceeds as in table 1.Illustration 1: Table 1This example merely shows that evidence consisting of a considerable number of RCTs and a variety of other evidence cannot be dismissed by a simple Bayesian argument. A complete Bayesian discourse about proof is much more complex [20]. We see that 7 consecutive, positive, trials suffice to bring belief from one in a million to very nearly 100%, and that there is a âceiling effectâ: additional positive studies have very little impact. The 8 trials on homeopathy for URTI have certainly not had such an impact on beliefs in the medical community. This might be due to suspicion of bias based on the plausibility fallacy.Sources of biasSterne et al assumed that quality bias accounted for the positive results of RCTs of homeopathy [21], but several authors have concluded that the quality of evidence for homeopathy is not inferior to that for conventional medicine [12, 13]. Shang's analysis was the first to make direct comparison of homeopathy trials with conventional trials. Plots of odds ratio versus the standard error of RCTs show a picture that is not consistent with a placebo effect and a similar pattern for homeopathy and conventional medicine (figure 1)[12]. There was no statistically significant difference in asymmetry.But there is incommensurability between the homeopathic and conventional data sets: for instance it excluded some larger homeopathy trials with positive effect because no matching trial could be found [22-24]. The plot for homeopathy included 16 unpublished trials, the conventional plot none. There was an additional difference in quality: homeopathy had 21 out of 110 (19%) good quality trials, conventional medicine had 9 out of 110 (8%). Both publication bias and quality bias lead to exaggerated effects. Adding the difference in quality for 12 trials results in a less biased effect in 28 out of 110 (25%) of the homeopathy trials.Comparison of 110 homeopathy trials with 110 matched conventional trials does not indicate a difference in efficacy of both methods. Several authors show statistically non-significant results with subsets of trials. Reconstruction of the meta-analysis shows that other, equally justifiable, subsets of high quality trials yield statistically significant positive results [25]. Considering the plot of both methods, this would also be a common occurrence with subsets of conventional medical trails.Illustration 2: Figure 1Plausibility biasThe differing conclusions of the meta-analyses of the homeopathy and conventional medicine subsets, and particularly for the homeopathy URTI subset, do not reflect the nature of the evidence, nor its quality, but negative âplausibility biasâ. There is growing evidence that antibiotics do more harm than good in URTI, despite a plausible rationale for their use; their continued use reflects positive plausibility bias. Plausibility bias obstructs a fair evaluation of the evidence around homeopathy; its extent and implications have not been adequately recognised or discussed. In the current circumstances, negative plausibility bias concerning homeopathy should not impede further research. Nevertheless, such new research in homeopathy, if positive, may have limited impact on practice unless and until homeopathy can be established within a plausible theoretical framework.Treatment of URTI and further research in homeopathyThe use of homeopathy for URTI, on the available evidence, demands further investigation. URTI is an âeffectiveness gapâ condition, a common clinical problem for which there is a lack of effective treatments [26]. Extensive discussions about RCT evidence in homeopathy are so far inconclusive, but do these discussions not mirror the problems with the interpretation of conventional evidence?Antibiotics have saved countless lives, but it is clear that there is little place for them in uncomplicated URTI: they do not reduce the risk of serious complications [27, 28] and they are ineffective in otitis media [29]. Bezáková et al suggest that acute otitis media recurs more frequently in young children treated with antibiotics than in those given placebo, perhaps due to selection of more virulent microflora [30], and the use of antibiotics for respiratory tract infections leads to increased antibiotic resistance [31]. Despite widespread awareness of the need to reduce the use of antibiotics for URTI, they are still frequently prescribed [32-25]. URTI is the most prevalent disease category in general practice [36]. As the problems associated with antibiotic use are increasingly recognised there is a need to consider alternative treatments such as homeopathy.The specific research we propose, conducted in primary care, is to test the hypothesis that homeopathy averts, reduces or delays antibiotic prescriptions in the management of acute otitis media or other URTI.There are a number of considerations to be taken into account in designing such a study. These include:Trials using an antibiotic treated group in uncomplicated URTI are unethical since the evidence suggests that they do more harm than good in this situation.-Trials should be of relatively long duration: URTI are often recurrent and the disadvantages of antibiotics are most evident in this context.-Homeopathic prescribing requires skilled practitioners.-Homeopathy is associated with strong patient preferences; previous RCTs in primary care have foundered on this issue [37].The research question would not be: âCan ultra-diluted medicines exert physiological effects?â. A clinical trial is a clumsy and expensive way of answering such a question, which would be much better answered by biological models. A number of such models have been described [38], and their further development might enable homeopathy to become framed in the plausible theoretical background that it requires.# Odds = chance / (1 â chance); in words, the chance that something will happen divided by the chance that it will not happen. Odds = 1 means: chance is fifty-fifty.LR = Likelihood ratio = True positives / False positives
We conclude therefore that a controlled clinical trial on homeopathy for otitis media (or other URTI) should be of pragmatic design and large-scale in nature. If viewed against a background of enhanced plausibility through new basic research, the results of such a trial might have far-reaching impact on the treatment of otitis media (URTI) and on the contribution of homeopathy in primary care practice.
RCT: randomised controlled trialURTI: upper respiratory tract infectionsLR: Likelihood Ratio
[1] Shang A, Huwiler-Muntener K, Nartey L, Jüni P, Dörig S, Sterne JAC, Pewsner D, Egger M. Are the clinical effects of homoeopathy placebo effects? Comparative study of placebo-controlled trials of homoeopathy and allopathy. Lancet 2005; 366: 726-32.[2] Bornhöft G, Wolf U, Ammon K, Righetti M, Maxion-Bergemann S, Baumgartner S, Thurneysen AE, Matthiessen PF. Effectiveness, safety and cost-effectiveness of homeopathy in general practice â summarized health technology assessment. Forschende Komplementärmedizin. 2006; 13 Suppl 2:19â29.[3] Bellavite P, Ortolani R, Pontarollo F, Piasere V, Benato G, Conforti A (2006). Immunology and homeopathy. 4. Clinical studies â Part 1. Evidence-based Complementary and Alternative Medicine: eCAM, 3:293â301.[4] Frei H,.Thurneysen A. Homeopathy in acute otitis media in children: treatment effect or spontaneous resolution? Br.Homeopath.J 2001;90:180-2.[5] Jacobs J, Springer DA, Crothers D. Homeopathic treatment of acute otitis media in children: a preliminary randomized placebo-controlled trial. Pediatr.Infect.Dis.J 2001;20:177-83.[6] Friese KH, Kruse S, Ludtke R, Moeller H. The homoeopathic treatment of otitis media in children â comparisons with conventional therapy. Int.J Clin Pharmacol.Ther 1997;35:296-301.[7] Witt CM, Lüdtke R, Mengler N, Willich SN. How healthy are chronically ill patients after eight years of homeopathic treatment? â Results from a long term observational study. BMC Public Health 2008, 8:413. http://www.biomedcentral.com/content/pdf/1471-2458-8-413.pdf[8] Rossi E, Crudeli L, Endrizzi C, Garibaldi D. Cost-benefit evaluation of homeopathic versus conventional therapy in respiratory diseases. Homeopathy 2009;98:2-10.[9] Trichard M, Chaufferin G, Nicoloyannis N. Pharmacoeconomic comparison between homeopathic and antibiotic treatment strategies in recurrent acute rhinopharyngitis in children. Homeopathy 2005;94:3-9.[10] Van Wassenhoven M, Ives G. An observational study of patients receiving homeopathic treatment. Homeopathy 2004;93:3-11.[11] Vandenbroucke JP, Crean AJM de. Alternative medicine: a âmirror imageâ for scientific reasoning in conventional medicine. Ann Intern Med. 2001;135:507-513[12] Vandenbroucke JP. Medical journals and the shaping of medical knowledge. Lancet 1998;352:2001-6[13] Kleijnen J, Knipschild P, ter Riet G. Clinical trials of homoeopathy. BMJ 1991;302:316â323[14] Chaplin MF. The Memory of Water: an overview. Homeopathy 2007; 96: 143â150.[15] Chalmers AF. What is this thing called science? 3rd Rev Ed., University of Queensland Press, 1999[16] Goodman SN. Toward evidence-based medical statistics. 2: The Bayes factor. Ann Intern Med 1999;130:1005-1013.[17] Rosendaal FR Bouter LM. Dwalingen in de methodologie (slot). XXXIX. De ultieme waarheid. Ned Tijdschr Geneesk 2002;7:304-9[18] Chaloner K. Elicitation of prior distributions. In: Berry DA, Stangl DK, eds. Bayesian biostatistics. New York, Basel: Marcel Dekker Inc, 1996:141-156.[19] Spiegelhalter DJ, Freedman LS, Parmar MKB. Bayesian approaches to randomized trials. In: Berry DA, Stangl DK, eds. Bayesian biostatistics. Marcel Dekker, Inc. New York 1996, 67-108[20] Rutten ALB. How can we change beliefs? A Bayesian perspective. Homeopathy 2008; 97: 214-219[21] Sterne JAC, Egger M, Davey Smith G. Investigating and dealing with publication and other biases in meta-analysis. BMJ 2001;323:101-105[22] Wiesenauer M, Gaus W. Wirksamkeitsnachweis eines Homöopathikums bei chronischer Polyarthritis. Eine randomisierte Doppelblindstudie bei niedergelassenen Ãrzten. Aktuelle Rheumatologie 1991;16:1-9[23] Paterson J. Report on the mustard gas experiments (Glasgow and London). British Homeopathic Journal 1943;33:1-12[24] Mössinger P. Zur therapeutischen Wirksamkeit von Hepar sulphuris calcareum D4 bei Pyodermien und Furunkeln. Allgemeine Homöopathische Zeitung 1980;225:22-28[25] Lüdtke R, Rutten ALB. The conclusions on the effectiveness of homeopathy highly depend on the set of analyzed trials. J Clin Epidemiol. 2008; 61: 1197-1204.[26] Fisher P, van Haselen R, Hardy K, Berkovitz S; McCarney R. Effectiveness Gaps: A new concept for evaluating health service and research needs applied to complementary and alternative medicine. J Alt Comp Med 2004:10;627â632[27] Petersen I, Johnson AM, Islam A, Duckworth G, Livermore DM, Hayward AC. Protective effect of antibiotics against serious complications of common respiratory tract infections: retrospective cohort study with the UK General Practice Research Database. BMJ 2007;335:982[28] Arroll B, Kenealy T, Falloon K. Are antibiotics indicated as an initial treatment for patients with acute upper respiratory tract infections? A review. N.Z.Med.J. 2008;121:64-70.[29] Glasziou PP DMCSSHM. Antibiotics for acute otitis media in children. Cochrane Database Syst Rev 2004;CD000219.[30] Bezáková N, Damoiseaux RA, Hoes AW, et al. Recurrence up to 3.5 years after antibiotic treatment of acute otitis media in very young Dutch children: survey of trial participants. BMJ 2009;338:b2525.[31] Costelloe C, Metcalfe C, Lovering A, Mant D. Hay AD. Effect of antibiotic prescribing in primary care on antimicrobial resistance in individual patients: systematic review and meta-analysis. BMJ 2010;340:c2096[32] Aspinall SL, Good CB, Metlay JP, Mor MK, Fine MJ. Antibiotic prescribing for presumed nonbacterial acute respiratory tract infections. Am.J.Emerg.Med. 2009;27:544-51.[33] El Sayed MF, Tamim H, Jamal D, Mumtaz G, Melki I, Yunis K. Prospective study on antibiotics misuse among infants with upper respiratory infections. Eur.J.Pediatr. 2009;168:667-72.[34] Li J, De A, Ketchum K, Fagnan LJ, Haxby DG, Thomas A. Antimicrobial prescribing for upper respiratory infections and its effect on return visits. Fam.Med. 2009;41:182-7.[35] Thompson PL, Spyridis N, Sharland M, Gilbert RE, Saxena S, Long PF et al. Changes in clinical indications for community antibiotic prescribing for children in the UK from 1996 to 2006: will the new NICE prescribing guidance on upper respiratory tract infections just be ignored? Arch.Dis.Child 2009;94:337-40.[36] Cooper RJ, Hoffman JR, Bartlett JG, Besser RE, Gonzales R, Hickner JM, Sande MA. Principles of appropriate antibiotic use for acute pharyngitis in adults: Background. Ann Intern Med. 2001, 134: 509-517.[37] Katz T, Fisher P, Katz A, Davidson J, Feder G. The feasibility of a randomised, placebo-controlled clinical trial of homeopathic treatment of depression in general practice. Homeopathy 2005;94:145-52[38] Endler PC, Thieves K, Frass M, Bonamin L, Scherr C, Baumgartner S. Repetitions of fundamental research models for homeopathically prepared dilutions beyond 10-23: a bibliometric study. Homeopathy 2010; 99: 25-36.