Cookies on this website

We use cookies to ensure that we give you the best experience on our website. If you click 'Accept all cookies' we'll assume that you are happy to receive all cookies and you won't see this message again. If you click 'Reject all non-essential cookies' only necessary cookies providing core functionality such as security, network management, and accessibility will be enabled. Click 'Find out more' for information on how to change your cookie settings.

BACKGROUND: In randomised trials, rather than comparing randomised groups directly some researchers carry out a significance test comparing a baseline with a final measurement separately in each group. METHODS: We give several examples where this has been done. We use simulation to demonstrate that the procedure is invalid and also show this algebraically. RESULTS: This approach is biased and invalid, producing conclusions which are, potentially, highly misleading. The actual alpha level of this procedure can be as high as 0.50 for two groups and 0.75 for three. CONCLUSIONS: Randomised groups should be compared directly by two-sample methods and separate tests against baseline are highly misleading.

Original publication




Journal article



Publication Date





Aging, Back Pain, Computer Simulation, Female, Humans, Menorrhagia, Probability, Randomized Controlled Trials as Topic