2006

Local clinical quality monitoring for detection of excess operative deaths

Arrowsmith JE, Powell SJ, Nashef SAM

Anaesthesia 2006; 61(5): 423-426.

A monitoring system for cardiac surgery has been in use at papworth hospital for 10 years. We wished to determine whether this system would have detected an increase in deaths associated with a single practitioner, whether a poorly performing doctors or a serial killer such as Dr Harold Shipman, whose activities went undetected in the absence of a monitoring system for nearly a quarter of a century. Random extra deaths were artificially introduced into the practice of a surgeon and an anaesthetist in a way that broadly reporduced Shipman's pattern. The standard monitoring system was then used to analyse the hypothetical data thus generated. Using the current standard monitoring, the excess deaths would have been detected in less than 10 months. Suspicions would have been raised even earlier. Robust local clinical quality monitoring of risk-adjusted outcome is possible and, in our opinion, essential.

Media responses

Eurekalert Press release (10.05.06)
BBC News 'Months to find' virtual Shipman (10.05.06)
Political Gateway Virtual deaths used to test hospital staff (10.05.06)
News-Medical.net Local clinical quality monitoring for detection of excess operative deaths (10.05.06)
AlphaGalileo Hospital inputs Shipman death rates to see how fast audit system would raise the alarm (10.05.06)

Cambridge News Virtual killer not spotted for 10 months (11.05.06)
Aerzteblatt.de Studie: Qualitätskontrolle in Klinik erkennt ärztlichen “Todesengel” (11.05.06)
NetDoctor Spotting a killer doctor 'would take months' (11.05.06)
Cambridge News Hospital 'failsafe' system defended (12.05.06)
Medical News Today Hospital Inputs Shipman Death Rates To See How Fast Audit System Would Raise The Alarm (12.05.06)
BlueSci New monitoiring system for clinicians
Pulse-i Future Shipman would be found within 10 months (18.05.06)
AnaesthesiaUK Hospital inputs Shipman death rates to see how fast audit system would raise the alarm (24.05.06)

PRESS RELEASE

Hospital inputs Shipman death rates to see how fast
local audit system would raise the alarm

If convicted murderer Dr Harold Shipman has been working as a surgeon or anaesthetist at a specialist heart hospital in Cambridge, increased patient death rates would have alerted clinical audit staff after eight to ten months, according to research in the latest issue of Anaesthesia.

Dr Shipman, who worked as a family doctor in a single-handed practice in Hyde, Greater Manchester, was convicted of 15 murders. But an official UK Government inquiry found that he was responsible for at least 236 deaths over 24 years.

The Papworth Hospital team analysed the Shipman murders and, with the permission of a heart surgeon and anaesthetist, added in a similar pattern of unexplained deaths to their individual records dating back to April 2000.

They discovered that the hospital’s monitoring system would have rung alarm bells at eight months for the surgeon and ten months for the anaesthetist, as the actual death rates would have fallen outside the tolerance zone for predicted death rates.

Papworth is England’s largest main heart surgery centre and its 1,300 staff treat more than 20,000 inpatients and day cases per year, together with 20,000 outpatients.

Both the surgeon and anaesthetist chosen by the authors to take part in the study had been working at the hospital for more than six years. Their performance figures were closest to the average death rates recorded for all staff at the hospital working in their specialty.

The fake deaths were added into the hospital’s point-of-care deaths records, which include details of the patient, operation performed, the outcome and the risk attached to that particular procedure.

Data from these records are analysed once a month by the hospital’s clinical audit team and the results from the previous 12 months examined in detail. Annual audits are also carried out on the data, which have been validated by external assessors. The hospital has established targets for patient survival after heart surgery. These are based on the profiles of the patients and the operations performed. It is these targets which would have been breached if the extra “virtual” deaths had truly occurred.

“The system at Papworth wasn’t specifically designed to detect serial murders, but to assure that the quality of our surgery service was maintained,” explains co-author and consultant surgeon Mr Sam Nashef.

“There is nothing specific in our study that distinguishes excess death due to malicious intent from any other cause, such as systems failure or human error.

“But it does alert us when death rates fall outside the norm and that is an essential part of any clinical quality assurance programme.”

The hospital carried out the study to test the theory - voiced by Professor Mike Harmer of Wales College of Medicine in an editorial in Anaesthesia - that what had happened in a single-handed GP practice couldn’t happen in a large and accountable hospital.

This followed the publication of the fifth report of the Shipman Inquiry which looked at how lessons could be learnt and patients safeguarded in the future.

“Some patients would have died during the eight to ten months before the death rates became statistically different from the norm and clinical audit staff were alerted,” says consultant anaesthetist Dr Joe Arrowsmith. “But it is sadly inevitable that some harm is done before harm is detected.

“The aim should be to identify and investigate the problem as soon as possible.

“We believe that detailed monitoring of this type is possible in all medical specialities, including general practice, and is preferable to the publication of crude outcome data.

“Universal adoption of robust local monitoring could ensure that terrible events like the Shipman deaths are never repeated.”

Dr Harold Shipman was convicted of 15 counts of murder and sentenced to 15 terms of life imprisonment in January 2000 following a lengthy trial. He committed suicide in Wakefield prison in January 2004.

The Shipman Inquiry was established by the UK Government in January 2001 and headed by High Court judge Dame Janet Smith.

Public hearings into individual cases began in June of that year and throughout the life of the inquiry approximately 2,500 witness statements were taken and 270,000 pages of evidence were scanned into the inquiry database.

Six reports were published between July 2002 and January 2005 and the Shipman Inquiry was decommissioned in Easter 2005.


Notes to editors

Full text versions of all reports from the Shipman enquiry can be found at www.the-shipman-inquiry.org.uk

Anaesthesia, which was established in 1945, is the official journal of the Association of Anaesthetists of Great Britain and Ireland. It publishes original, peer-reviewed articles to an international audience on all aspects of general and regional anaesthesia, intensive care and pain therapy, including research on equipment. Consultant Anaesthetist Dr David Bogod of Nottingham City Hospital, UK, is Editor in Chief of the journal, which is published by Blackwell Publishing Ltd. www.blackwellpublishing.com/ana

Send comments & error reports to WebMaster