Cookies on this website

We use cookies to ensure that we give you the best experience on our website. If you click 'Accept all cookies' we'll assume that you are happy to receive all cookies and you won't see this message again. If you click 'Reject all non-essential cookies' only necessary cookies providing core functionality such as security, network management, and accessibility will be enabled. Click 'Find out more' for information on how to change your cookie settings.

OBJECTIVE: To examine the presence and extent of small study effects in clinical osteoarthritis research. DESIGN: Meta-epidemiological study. DATA SOURCES: 13 meta-analyses including 153 randomised trials (41 605 patients) that compared therapeutic interventions with placebo or non-intervention control in patients with osteoarthritis of the hip or knee and used patients' reported pain as an outcome. METHODS: We compared estimated benefits of treatment between large trials (at least 100 patients per arm) and small trials, explored funnel plots supplemented with lines of predicted effects and contours of significance, and used three approaches to estimate treatment effects: meta-analyses including all trials irrespective of sample size, meta-analyses restricted to large trials, and treatment effects predicted for large trials. RESULTS: On average, treatment effects were more beneficial in small than in large trials (difference in effect sizes -0.21, 95% confidence interval -0.34 to -0.08, P=0.001). Depending on criteria used, six to eight funnel plots indicated small study effects. In six of 13 meta-analyses, the overall pooled estimate suggested a clinically relevant, significant benefit of treatment, whereas analyses restricted to large trials and predicted effects in large trials yielded smaller non-significant estimates. CONCLUSIONS: Small study effects can often distort results of meta-analyses. The influence of small trials on estimated treatment effects should be routinely assessed.

Original publication

DOI

10.1136/bmj.c3515

Type

Journal article

Journal

BMJ

Publication Date

16/07/2010

Volume

341

Keywords

Humans, Osteoarthritis, Hip, Osteoarthritis, Knee, Pain, Randomized Controlled Trials as Topic, Sample Size, Treatment Outcome