Cookies on this website

We use cookies to ensure that we give you the best experience on our website. If you click 'Accept all cookies' we'll assume that you are happy to receive all cookies and you won't see this message again. If you click 'Reject all non-essential cookies' only necessary cookies providing core functionality such as security, network management, and accessibility will be enabled. Click 'Find out more' for information on how to change your cookie settings.

ObjectiveTo design and validate a statistical method for evaluating the performance of surgical units that adjusts for case volume and case mix.DesignValidation study using routinely collected data on in-hospital mortality.Data sourcesTwo UK databases, the ASCOT prospective database and the risk scoring collaborative (RISC) database, covering 1042 patients undergoing surgery in 29 hospitals for gastro-oesophageal cancer between 1995 and 2000.Statistical analysisA two level hierarchical logistic regression model was used to adjust each unit's operative mortality for case mix. Crude or adjusted operative mortality was plotted on mortality control charts (a graphical representation of surgical performance) as a function of number of operations. Control limits defined as 90%, 95%, and 99% confidence intervals identified units whose performance diverged significantly from the mean.ResultsThe mean in-hospital mortality was 12% (range 0% to 50%). The case volume of the units ranged from one to 55 cases a year. When crude figures were plotted on the mortality control chart, four units lay outside the 90% control limit, including two outside the 95% limit. When operative mortality was adjusted for risk, three units lay outside the 90% limit and one outside the 95% limit. The model fitted the data well and had adequate discrimination (area under the receiver operating characteristics curve 0.78).ConclusionsThe mortality control chart is an accurate, risk adjusted means of identifying units whose surgical performance, in terms of operative mortality, diverges significantly from the population mean. It gives an early warning of divergent performance. It could be adapted to monitor performance across various specialties.

Original publication

DOI

10.1136/bmj.326.7393.786

Type

Journal article

Journal

Bmj (clinical research ed.)

Publication Date

04/2003

Volume

326

Pages

786 - 788

Addresses

Academic Department of Surgery, King's College Hospital, London SE5 9RS. ptekkis@blueyonder.co.uk

Keywords

Humans, Surgical Procedures, Operative, Severity of Illness Index, Hospital Mortality, Logistic Models, Risk Assessment, Risk Factors, Surgery Department, Hospital, Hospitals, Public, State Medicine, United Kingdom